Commit Graph

512 Commits

Author SHA1 Message Date
Filip Gralinski 6d586c7238 Handle headers 2020-02-22 11:18:34 +01:00
Filip Gralinski 471d5974cd About challenge README.md 2020-02-21 08:08:19 +01:00
Filip Gralinski 2b508cb9d5 Fix README 2020-02-21 08:05:09 +01:00
Filip Gralinski 40a3b26658 Fixes in README 2020-02-19 06:55:24 +01:00
Filip Gralinski 561f568437 Update README 2020-02-18 21:01:39 +01:00
Filip Gralinski ccd6d919da Bump up version number 2020-02-11 09:38:12 +01:00
Filip Gralinski e627106dd6 Fix bug in cross-tabs
It was due to a huge bug in ordered-containers.
2020-02-11 09:37:19 +01:00
Filip Gralinski 593871f19b Fix tests 2020-02-07 11:34:42 +01:00
Filip Gralinski 169931be8f Define FLC-F-score 2020-02-07 11:29:37 +01:00
Lukasz Borchmann 00b02680cc Rename out directory. 2020-02-05 10:46:17 +01:00
Lukasz Borchmann b4f288d7dd Tests for multi-overlap FLC. 2020-02-04 14:37:57 +01:00
Lukasz Borchmann 1e97eb0694 Fix output order. Change span. 2020-02-04 14:04:07 +01:00
Lukasz Borchmann b22d1777d7 Tests for FLC-F1 metric 2020-02-04 13:13:58 +01:00
Filip Gralinski a66fa35a42 Mean/Multilabel-F works with Bootstrap 2020-02-01 11:54:54 +01:00
Filip Gralinski 5d895ea1c6 Fix order in line-by-line mode 2020-01-31 22:38:31 +01:00
Filip Gralinski 2b4a416a4f Bump up version 2020-01-31 09:50:26 +01:00
Filip Gralinski 8761965e8e Add option to mark worst features 2020-01-31 09:44:21 +01:00
Filip Gralinski 15946b89db Add helper function for Gonito 2020-01-28 23:06:38 +01:00
Filip Gralinski 9198c38b1b Bump up version number 2020-01-28 22:41:48 +01:00
Filip Gralinski f21d752634 Fix validating challenges with bootstrap 2020-01-28 22:36:37 +01:00
Filip Gralinski aad7e20877 Bump up version number 2020-01-28 21:42:54 +01:00
Filip Gralinski 550358f0cd Automatically set precision when bootstrap resampling is used 2020-01-28 20:32:09 +01:00
Filip Gralinski 102b167ffc Bump up version 2020-01-27 22:53:15 +01:00
Filip Gralinski 59e26b683b Change Bootstrap option name 2020-01-27 22:52:15 +01:00
Filip Gralinski 36a3d8c949 Gracefully degrade when bootstrap is not (yet) handled 2020-01-27 22:23:43 +01:00
Filip Gralinski 659b122625 Make Bootstrap work on MultiLabel-F1 2020-01-27 22:14:13 +01:00
Filip Gralinski 43ff22c5dd Show results of bootstrap 2020-01-27 22:06:33 +01:00
Filip Gralinski 1cea36ac93 Helper functions for confidence bounds 2020-01-27 21:54:34 +01:00
Filip Gralinski ae2769b7b9 Implement bootstrap in GEval 2020-01-25 23:46:33 +01:00
Filip Gralinski deb14c6702 Add Bootstrap facilities 2020-01-25 22:05:11 +01:00
Filip Gralinski bfcd5aa631 Most evaluation metrics are handled with dependency types 2020-01-25 19:26:57 +01:00
Filip Gralinski 608b1f9d73 Merge branch 'master' into bootstrap 2020-01-18 18:09:19 +01:00
Filip Gralinski 68dc2fad0c Bump up version 2020-01-11 17:03:57 +01:00
Filip Gralinski e170c37864 Add substitution operation 2020-01-11 17:02:49 +01:00
Filip Gralinski 8f87b881b8 Bump up versio 2020-01-04 22:01:56 +01:00
Filip Gralinski 4f38ecada9 Fix nix script
(Because new extra dependency was added.)
2020-01-04 21:58:32 +01:00
Filip Gralinski 5171cf0ac6 Results are presented as cross tables (if possible) 2020-01-04 20:48:36 +01:00
Filip Gralinski 4ba61b6e6e Prepare helper functions for cross-tabs 2020-01-04 18:17:14 +01:00
Filip Gralinski 06a0b1148d Bump up version number 2019-12-21 16:05:51 +01:00
Filip Gralinski 01486d23aa Change the meaning of WER 2019-12-21 16:03:52 +01:00
Filip Gralinski 170cc417ca Bump up version 2019-12-16 12:49:18 +01:00
Filip Gralinski ad30bb9384 Fix bug with preprocessing ops not handled in --line-by-line mode 2019-12-16 12:47:35 +01:00
Filip Graliński 9a3a28a813 Add --oracle-item-based option 2019-12-16 11:18:49 +01:00
Filip Gralinski 1e74174c0b Bump up version 2019-12-14 21:12:46 +01:00
Filip Gralinski d95e2878a6 Refactor line-by-line mode 2019-12-14 21:10:40 +01:00
Filip Gralinski 2234efa107 Multiple metrics can be packed via "Cartesian" strings 2019-12-14 20:59:00 +01:00
Filip Gralinski 5f532c71c7 Add setting priorities, names can be set multiple times
If more than one is given for a metric, they are concatenated
(with spaces).
2019-12-14 19:58:02 +01:00
Filip Gralinski 059f81a797 Bump up version number 2019-12-13 20:38:08 +01:00
Filip Gralinski 0826d457b2 Complete move to the new style of train files 2019-12-13 20:31:40 +01:00
Mateusz Hinc 3528fcbfca Merge remote-tracking branch 'origin/master' into improvement/#25-issue-when-build-under-linux
# Conflicts:
#	README.md
2019-12-11 10:20:46 +01:00