Commit Graph

400 Commits

Author SHA1 Message Date
169931be8f Define FLC-F-score 2020-02-07 11:29:37 +01:00
Lukasz Borchmann
00b02680cc Rename out directory. 2020-02-05 10:46:17 +01:00
Lukasz Borchmann
b4f288d7dd Tests for multi-overlap FLC. 2020-02-04 14:37:57 +01:00
Lukasz Borchmann
1e97eb0694 Fix output order. Change span. 2020-02-04 14:04:07 +01:00
Lukasz Borchmann
b22d1777d7 Tests for FLC-F1 metric 2020-02-04 13:13:58 +01:00
a66fa35a42 Mean/Multilabel-F works with Bootstrap 2020-02-01 11:54:54 +01:00
5d895ea1c6 Fix order in line-by-line mode 2020-01-31 22:38:31 +01:00
2b4a416a4f Bump up version 2020-01-31 09:50:26 +01:00
8761965e8e Add option to mark worst features 2020-01-31 09:44:21 +01:00
15946b89db Add helper function for Gonito 2020-01-28 23:06:38 +01:00
9198c38b1b Bump up version number 2020-01-28 22:41:48 +01:00
f21d752634 Fix validating challenges with bootstrap 2020-01-28 22:36:37 +01:00
aad7e20877 Bump up version number 2020-01-28 21:42:54 +01:00
550358f0cd Automatically set precision when bootstrap resampling is used 2020-01-28 20:32:09 +01:00
102b167ffc Bump up version 2020-01-27 22:53:15 +01:00
59e26b683b Change Bootstrap option name 2020-01-27 22:52:15 +01:00
36a3d8c949 Gracefully degrade when bootstrap is not (yet) handled 2020-01-27 22:23:43 +01:00
659b122625 Make Bootstrap work on MultiLabel-F1 2020-01-27 22:14:13 +01:00
43ff22c5dd Show results of bootstrap 2020-01-27 22:06:33 +01:00
1cea36ac93 Helper functions for confidence bounds 2020-01-27 21:54:34 +01:00
ae2769b7b9 Implement bootstrap in GEval 2020-01-25 23:46:33 +01:00
deb14c6702 Add Bootstrap facilities 2020-01-25 22:05:11 +01:00
bfcd5aa631 Most evaluation metrics are handled with dependency types 2020-01-25 19:26:57 +01:00
608b1f9d73 Merge branch 'master' into bootstrap 2020-01-18 18:09:19 +01:00
68dc2fad0c Bump up version 2020-01-11 17:03:57 +01:00
e170c37864 Add substitution operation 2020-01-11 17:02:49 +01:00
8f87b881b8 Bump up versio 2020-01-04 22:01:56 +01:00
4f38ecada9 Fix nix script
(Because new extra dependency was added.)
2020-01-04 21:58:32 +01:00
5171cf0ac6 Results are presented as cross tables (if possible) 2020-01-04 20:48:36 +01:00
4ba61b6e6e Prepare helper functions for cross-tabs 2020-01-04 18:17:14 +01:00
06a0b1148d Bump up version number 2019-12-21 16:05:51 +01:00
01486d23aa Change the meaning of WER 2019-12-21 16:03:52 +01:00
170cc417ca Bump up version 2019-12-16 12:49:18 +01:00
ad30bb9384 Fix bug with preprocessing ops not handled in --line-by-line mode 2019-12-16 12:47:35 +01:00
9a3a28a813 Add --oracle-item-based option 2019-12-16 11:18:49 +01:00
1e74174c0b Bump up version 2019-12-14 21:12:46 +01:00
d95e2878a6 Refactor line-by-line mode 2019-12-14 21:10:40 +01:00
2234efa107 Multiple metrics can be packed via "Cartesian" strings 2019-12-14 20:59:00 +01:00
5f532c71c7 Add setting priorities, names can be set multiple times
If more than one is given for a metric, they are concatenated
(with spaces).
2019-12-14 19:58:02 +01:00
059f81a797 Bump up version number 2019-12-13 20:38:08 +01:00
0826d457b2 Complete move to the new style of train files 2019-12-13 20:31:40 +01:00
26f20ba466 Fixes 2019-12-04 21:15:44 +01:00
6d95dee275 More fixes 2019-12-04 20:41:07 +01:00
76dae8e5c8 Merge branch 'master' into train-new-style 2019-12-04 20:23:03 +01:00
66e2350b1a Remove commented out code 2019-12-04 20:00:45 +01:00
74d999d4bf Towards new-style of train 2019-11-27 16:55:17 +01:00
ef8945af11 Bump up version number 2019-11-25 21:35:22 +01:00
cb4efe1d6b Introduce :S flag (sorting words within a line) 2019-11-25 21:31:17 +01:00
d83c1eeac1 Continue 2019-11-24 14:30:27 +01:00
839ad5ce47 Merge branch 'master' into bootstrap 2019-11-23 13:17:19 +01:00