Commit Graph

391 Commits

Author SHA1 Message Date
Filip Gralinski 15946b89db Add helper function for Gonito 2020-01-28 23:06:38 +01:00
Filip Gralinski 9198c38b1b Bump up version number 2020-01-28 22:41:48 +01:00
Filip Gralinski f21d752634 Fix validating challenges with bootstrap 2020-01-28 22:36:37 +01:00
Filip Gralinski aad7e20877 Bump up version number 2020-01-28 21:42:54 +01:00
Filip Gralinski 550358f0cd Automatically set precision when bootstrap resampling is used 2020-01-28 20:32:09 +01:00
Filip Gralinski 102b167ffc Bump up version 2020-01-27 22:53:15 +01:00
Filip Gralinski 59e26b683b Change Bootstrap option name 2020-01-27 22:52:15 +01:00
Filip Gralinski 36a3d8c949 Gracefully degrade when bootstrap is not (yet) handled 2020-01-27 22:23:43 +01:00
Filip Gralinski 659b122625 Make Bootstrap work on MultiLabel-F1 2020-01-27 22:14:13 +01:00
Filip Gralinski 43ff22c5dd Show results of bootstrap 2020-01-27 22:06:33 +01:00
Filip Gralinski 1cea36ac93 Helper functions for confidence bounds 2020-01-27 21:54:34 +01:00
Filip Gralinski ae2769b7b9 Implement bootstrap in GEval 2020-01-25 23:46:33 +01:00
Filip Gralinski deb14c6702 Add Bootstrap facilities 2020-01-25 22:05:11 +01:00
Filip Gralinski bfcd5aa631 Most evaluation metrics are handled with dependency types 2020-01-25 19:26:57 +01:00
Filip Gralinski 608b1f9d73 Merge branch 'master' into bootstrap 2020-01-18 18:09:19 +01:00
Filip Gralinski 68dc2fad0c Bump up version 2020-01-11 17:03:57 +01:00
Filip Gralinski e170c37864 Add substitution operation 2020-01-11 17:02:49 +01:00
Filip Gralinski 8f87b881b8 Bump up versio 2020-01-04 22:01:56 +01:00
Filip Gralinski 4f38ecada9 Fix nix script
(Because new extra dependency was added.)
2020-01-04 21:58:32 +01:00
Filip Gralinski 5171cf0ac6 Results are presented as cross tables (if possible) 2020-01-04 20:48:36 +01:00
Filip Gralinski 4ba61b6e6e Prepare helper functions for cross-tabs 2020-01-04 18:17:14 +01:00
Filip Gralinski 06a0b1148d Bump up version number 2019-12-21 16:05:51 +01:00
Filip Gralinski 01486d23aa Change the meaning of WER 2019-12-21 16:03:52 +01:00
Filip Gralinski 170cc417ca Bump up version 2019-12-16 12:49:18 +01:00
Filip Gralinski ad30bb9384 Fix bug with preprocessing ops not handled in --line-by-line mode 2019-12-16 12:47:35 +01:00
Filip Graliński 9a3a28a813 Add --oracle-item-based option 2019-12-16 11:18:49 +01:00
Filip Gralinski 1e74174c0b Bump up version 2019-12-14 21:12:46 +01:00
Filip Gralinski d95e2878a6 Refactor line-by-line mode 2019-12-14 21:10:40 +01:00
Filip Gralinski 2234efa107 Multiple metrics can be packed via "Cartesian" strings 2019-12-14 20:59:00 +01:00
Filip Gralinski 5f532c71c7 Add setting priorities, names can be set multiple times
If more than one is given for a metric, they are concatenated
(with spaces).
2019-12-14 19:58:02 +01:00
Filip Gralinski 059f81a797 Bump up version number 2019-12-13 20:38:08 +01:00
Filip Gralinski 0826d457b2 Complete move to the new style of train files 2019-12-13 20:31:40 +01:00
Filip Gralinski 26f20ba466 Fixes 2019-12-04 21:15:44 +01:00
Filip Gralinski 6d95dee275 More fixes 2019-12-04 20:41:07 +01:00
Filip Gralinski 76dae8e5c8 Merge branch 'master' into train-new-style 2019-12-04 20:23:03 +01:00
Filip Gralinski 66e2350b1a Remove commented out code 2019-12-04 20:00:45 +01:00
Filip Graliński 74d999d4bf Towards new-style of train 2019-11-27 16:55:17 +01:00
Filip Gralinski ef8945af11 Bump up version number 2019-11-25 21:35:22 +01:00
Filip Gralinski cb4efe1d6b Introduce :S flag (sorting words within a line) 2019-11-25 21:31:17 +01:00
Filip Gralinski d83c1eeac1 Continue 2019-11-24 14:30:27 +01:00
Filip Gralinski 839ad5ce47 Merge branch 'master' into bootstrap 2019-11-23 13:17:19 +01:00
Filip Gralinski 3b7fe8a67c Continue work on refactor 2019-11-23 13:07:24 +01:00
Filip Gralinski db7a1bb03e Bump up version number 2019-11-18 21:53:40 +01:00
Filip Gralinski 03aacdef98 Add SegmentAccuracy metric 2019-11-18 18:35:01 +01:00
Filip Gralinski fb74f568bb Improvements in README 2019-11-16 10:27:03 +01:00
Filip Graliński 9521f0d931 Merge branch 'windows_installation' into 'master'
Windows installation description #24

See merge request filipg/geval!7
2019-11-16 09:18:00 +00:00
Filip Gralinski 234bac19ce WIP 2019-11-07 12:33:46 +01:00
Filip Graliński 41fe0d2283 Make room for storing the results of bootstrap resampling 2019-11-02 16:44:13 +01:00
Filip Graliński 402ed73111 Add option for bootstrap resampling (not implemented yet) 2019-11-02 11:53:52 +01:00
Filip Graliński d67061c230 Hande itemStep via dependent types 2019-11-02 11:11:53 +01:00