Commit Graph

282 Commits

Author SHA1 Message Date
e627106dd6 Fix bug in cross-tabs
It was due to a huge bug in ordered-containers.
2020-02-11 09:37:19 +01:00
593871f19b Fix tests 2020-02-07 11:34:42 +01:00
169931be8f Define FLC-F-score 2020-02-07 11:29:37 +01:00
a66fa35a42 Mean/Multilabel-F works with Bootstrap 2020-02-01 11:54:54 +01:00
5d895ea1c6 Fix order in line-by-line mode 2020-01-31 22:38:31 +01:00
2b4a416a4f Bump up version 2020-01-31 09:50:26 +01:00
8761965e8e Add option to mark worst features 2020-01-31 09:44:21 +01:00
15946b89db Add helper function for Gonito 2020-01-28 23:06:38 +01:00
f21d752634 Fix validating challenges with bootstrap 2020-01-28 22:36:37 +01:00
550358f0cd Automatically set precision when bootstrap resampling is used 2020-01-28 20:32:09 +01:00
59e26b683b Change Bootstrap option name 2020-01-27 22:52:15 +01:00
36a3d8c949 Gracefully degrade when bootstrap is not (yet) handled 2020-01-27 22:23:43 +01:00
659b122625 Make Bootstrap work on MultiLabel-F1 2020-01-27 22:14:13 +01:00
1cea36ac93 Helper functions for confidence bounds 2020-01-27 21:54:34 +01:00
ae2769b7b9 Implement bootstrap in GEval 2020-01-25 23:46:33 +01:00
deb14c6702 Add Bootstrap facilities 2020-01-25 22:05:11 +01:00
bfcd5aa631 Most evaluation metrics are handled with dependency types 2020-01-25 19:26:57 +01:00
608b1f9d73 Merge branch 'master' into bootstrap 2020-01-18 18:09:19 +01:00
e170c37864 Add substitution operation 2020-01-11 17:02:49 +01:00
5171cf0ac6 Results are presented as cross tables (if possible) 2020-01-04 20:48:36 +01:00
4ba61b6e6e Prepare helper functions for cross-tabs 2020-01-04 18:17:14 +01:00
01486d23aa Change the meaning of WER 2019-12-21 16:03:52 +01:00
ad30bb9384 Fix bug with preprocessing ops not handled in --line-by-line mode 2019-12-16 12:47:35 +01:00
9a3a28a813 Add --oracle-item-based option 2019-12-16 11:18:49 +01:00
d95e2878a6 Refactor line-by-line mode 2019-12-14 21:10:40 +01:00
2234efa107 Multiple metrics can be packed via "Cartesian" strings 2019-12-14 20:59:00 +01:00
5f532c71c7 Add setting priorities, names can be set multiple times
If more than one is given for a metric, they are concatenated
(with spaces).
2019-12-14 19:58:02 +01:00
0826d457b2 Complete move to the new style of train files 2019-12-13 20:31:40 +01:00
26f20ba466 Fixes 2019-12-04 21:15:44 +01:00
6d95dee275 More fixes 2019-12-04 20:41:07 +01:00
76dae8e5c8 Merge branch 'master' into train-new-style 2019-12-04 20:23:03 +01:00
66e2350b1a Remove commented out code 2019-12-04 20:00:45 +01:00
74d999d4bf Towards new-style of train 2019-11-27 16:55:17 +01:00
cb4efe1d6b Introduce :S flag (sorting words within a line) 2019-11-25 21:31:17 +01:00
d83c1eeac1 Continue 2019-11-24 14:30:27 +01:00
839ad5ce47 Merge branch 'master' into bootstrap 2019-11-23 13:17:19 +01:00
3b7fe8a67c Continue work on refactor 2019-11-23 13:07:24 +01:00
03aacdef98 Add SegmentAccuracy metric 2019-11-18 18:35:01 +01:00
234bac19ce WIP 2019-11-07 12:33:46 +01:00
Filip Graliński
41fe0d2283 Make room for storing the results of bootstrap resampling 2019-11-02 16:44:13 +01:00
Filip Graliński
402ed73111 Add option for bootstrap resampling (not implemented yet) 2019-11-02 11:53:52 +01:00
Filip Graliński
d67061c230 Hande itemStep via dependent types 2019-11-02 11:11:53 +01:00
Filip Graliński
32969bb56a OutputParser handled by dependent types 2019-11-02 09:31:16 +01:00
d5d177bc8d Start using dependent types 2019-11-02 09:06:58 +01:00
6e20e79f5b Start working on usind dependent types 2019-11-02 09:06:58 +01:00
huntekah
3001803c56 Add GLEU metric description #29 2019-10-29 19:12:26 +00:00
62954bf21e Merge branch 'master' of gitlab.com:filipg/geval 2019-10-15 20:51:48 +02:00
mateusz.hinc
f1e7cc792d fix typos, fix grammar, add --single-branch to git commands 2019-10-15 09:45:42 +02:00
fd12a55bcd Add helper function to options 2019-09-23 18:31:52 +02:00
00addc5620 Refactor code 2019-09-20 20:30:12 +02:00