a
This commit is contained in:
commit
45c30a5499
8
.gitignore
vendored
Normal file
8
.gitignore
vendored
Normal file
@ -0,0 +1,8 @@
|
|||||||
|
|
||||||
|
*~
|
||||||
|
*.swp
|
||||||
|
*.bak
|
||||||
|
*.pyc
|
||||||
|
*.o
|
||||||
|
.DS_Store
|
||||||
|
.token
|
37
README.md
Normal file
37
README.md
Normal file
@ -0,0 +1,37 @@
|
|||||||
|
# Dataset source and thanks
|
||||||
|
|
||||||
|
Predict the headline category given headine text and year
|
||||||
|
Start Date: 1996-01-01 End Date: 2019-12-31
|
||||||
|
|
||||||
|
|
||||||
|
Dataset taken from https://www.kaggle.com/therohk/ireland-historical-news on 19.06.2020.
|
||||||
|
Special thanks to Rohit Kulkarni who created it.
|
||||||
|
|
||||||
|
You may find whole dataset (including the test dataset) in the link above.
|
||||||
|
The dataset in the link may be updated.
|
||||||
|
Please, do not incorporate any of the data from this kaggle dataset (or others) to your submission in this gonito challange.
|
||||||
|
|
||||||
|
## Context (from https://www.kaggle.com/therohk/ireland-historical-news )
|
||||||
|
|
||||||
|
This news dataset is a composition of 1.48 million headlines posted by the Irish Times operating within Ireland.
|
||||||
|
|
||||||
|
Created over 160 years ago; the agency can provides long term birds eye view of the happenings in Europe.
|
||||||
|
|
||||||
|
|
||||||
|
# Challange creation
|
||||||
|
|
||||||
|
Year is normalized as follows:
|
||||||
|
|
||||||
|
'''
|
||||||
|
days_in_year = 366 if is_leap else 365
|
||||||
|
normalized = d.year + ((day_of_year-1) / days_in_year)
|
||||||
|
'''
|
||||||
|
|
||||||
|
train, dev, test split is 80%, 10%, 10% randomly
|
||||||
|
|
||||||
|
note that there are very similar headlines in the data
|
||||||
|
|
||||||
|
I did not make any effort to prevent from going one sentence like this to the train and second one to the test.
|
||||||
|
|
||||||
|
I used a first category in the classification task. E.g there is "world" instead of "world.us" as on original dataset.
|
||||||
|
|
1
config.txt
Normal file
1
config.txt
Normal file
@ -0,0 +1 @@
|
|||||||
|
--metric Accuracy --precision 5
|
149134
dev-0/expected.tsv
Normal file
149134
dev-0/expected.tsv
Normal file
File diff suppressed because it is too large
Load Diff
149134
dev-0/in.tsv
Normal file
149134
dev-0/in.tsv
Normal file
File diff suppressed because it is too large
Load Diff
148308
test-A/in.tsv
Normal file
148308
test-A/in.tsv
Normal file
File diff suppressed because it is too large
Load Diff
BIN
train/expected.tsv.xz
Normal file
BIN
train/expected.tsv.xz
Normal file
Binary file not shown.
BIN
train/in.tsv.xz
Normal file
BIN
train/in.tsv.xz
Normal file
Binary file not shown.
Loading…
Reference in New Issue
Block a user