Commit Graph

512 Commits

Author SHA1 Message Date
Filip Gralinski a7e731a0f8 Remove some warnings 2022-01-22 16:42:52 +01:00
Filip Gralinski dbe4783d3c Merge branch 'repro-guidelines' 2022-01-15 21:18:21 +01:00
Filip Gralinski 4862233cfb Improve README 2022-01-15 15:21:19 +01:00
Filip Gralinski 3ef3416082 More on challenge preparation 2022-01-15 15:18:57 +01:00
Filip Gralinski 94df816065 Reproducibility guidelines 2021-12-22 11:37:57 +01:00
Filip Gralinski 70fc7b8d31 Follow symbolic links when doing validation
Needed for files stored with git-annex.
2021-12-18 14:35:14 +01:00
Filip Gralinski 2dbcedb40e Bump up version 2021-10-28 08:52:44 +02:00
Filip Gralinski 019b5ef8df Add entry on p<P> in README 2021-10-26 08:47:58 +02:00
Filip Gralinski e41115ddcd Refactor filtering 2021-10-26 08:45:08 +02:00
Filip Gralinski 2783a5bed8 Fix handling p<P> with line-by-line mode 2021-10-26 08:31:36 +02:00
Filip Gralinski 40bf850423 Add p<X> operations for choosing the most confident items 2021-10-26 06:48:12 +02:00
Filip Gralinski ac6320bf70 Bump up version 2021-10-09 18:32:31 +02:00
Filip Gralinski 8d8ca7f4b1 Fix line-by-line mode not working for BIO-F1 2021-10-09 18:28:14 +02:00
Filip Gralinski 3e4978fdbf Add test for testing line-by-line
(Commented for the time being)
2021-10-09 15:52:06 +02:00
Filip Gralinski 69f7c64e68 Better message when submitting fails 2021-10-09 14:40:14 +02:00
Filip Gralinski daac240904 Bump up version 2021-08-20 19:40:16 +02:00
Filip Gralinski ef2697a2be Remove some warnings 2021-08-20 19:39:11 +02:00
Filip Gralinski 612792799a Add PerplexityHashed metric 2021-08-20 19:31:32 +02:00
Filip Gralinski 2cd31bd613 Bump up version 2021-08-03 14:36:04 +02:00
Filip Gralinski 8dbcb548ae Improve detecting wrong metrics during validation 2021-07-29 14:55:59 +02:00
Filip Gralinski 905705bfd5 Turn on all warnings 2021-07-29 14:49:59 +02:00
Filip Gralinski 4a010d95cd Bump up version 2021-07-23 18:38:12 +02:00
Filip Gralinski 8c2fa3d8ed Better diagnostics for unknown metrics 2021-07-23 18:34:39 +02:00
Filip Gralinski 36a930d159 Fix bug with no calibration plot for Probabilistic-MultiLabel-F 2021-07-23 17:38:57 +02:00
Filip Gralinski c71bba81f3 Fix bug with inconsistent handling of probs in MultiLabel-F1 2021-07-23 17:26:41 +02:00
Filip Gralinski 4b80625cc2 Bump up version 2021-07-21 14:22:42 +02:00
Filip Gralinski 2175d75aac Properly validate train set 2021-07-21 14:21:24 +02:00
Filip Gralinski 61847f9fdf Bump up version 2021-07-19 17:09:29 +02:00
Filip Gralinski eecd71e8e1 Matching specification can be used for Accuracy 2021-07-19 16:37:43 +02:00
Filip Gralinski 53a5a19af2 Bump up version 2021-06-30 09:34:12 +02:00
Filip Gralinski 0f9ab275ef Handle DOS/Windows end-of-lines 2021-06-30 09:33:07 +02:00
Filip Gralinski ed1bb47a81 Bump up version 2021-06-10 15:08:55 +02:00
Filip Gralinski 4eb20f5bb0 Merge branch 'filter-and-match' 2021-06-10 15:01:27 +02:00
Filip Gralinski fb63894db0 Fix filter and match combination 2021-06-10 15:01:10 +02:00
Filip Gralinski 601a6f5b3c Add helper script for creating tests 2021-06-10 09:22:54 +02:00
Filip Gralinski 0afa1fe0ba Add BIOWeightedF1 metric 2021-06-10 09:21:43 +02:00
Filip Gralinski e26275eff2 Bump up version 2021-06-07 18:17:21 +02:00
Filip Gralinski f1adf725ce Merge branch 'kaczla/geval-master' 2021-06-07 18:15:51 +02:00
Karol Kaczmarek 1dfe3ce7f0 Add Haversine metric 2021-06-06 20:20:25 +02:00
Filip Gralinski 54547fe0f8 More meaningful error messages for regexps 2021-04-30 07:23:43 +02:00
Filip Gralinski 61eb437909 Describe MultiLabel-F1 2021-04-09 15:00:06 +02:00
Filip Gralinski a49abb560b Bump up version 2020-10-17 20:53:31 +02:00
Filip Gralinski 40d5ac602e Handle escaping spaces in configuration files 2020-10-17 18:56:30 +02:00
Filip Gralinski 819fbecedc Add CER metric
(Character-Error Rate)
2020-10-17 16:55:40 +02:00
Filip Gralinski 51c29aabf6 Export function for Gonito 2020-09-28 21:27:10 +02:00
Filip Gralinski 4e033b8adb Refactor helper function (for Gonito) 2020-09-28 21:24:14 +02:00
Filip Gralinski 5bd2eee13e Selecting metric and --show-preprocessed work in the diff mode 2020-09-12 10:45:24 +02:00
Filip Gralinski 1e54427982 Fix typo in README 2020-08-12 16:04:30 +02:00
Filip Gralinski 0f84f2e4ba Bump up version 2020-08-08 21:52:03 +02:00
Filip Gralinski a83ea1d00d Check whether at least one metric has priority one 2020-08-08 21:07:37 +02:00