Commit Graph

131 Commits

Author SHA1 Message Date
698b7a5db8 Add test for filtering (still failing) 2020-05-13 13:32:46 +02:00
8d429b01cb Show column names in extracted features 2020-02-22 12:13:45 +01:00
6d586c7238 Handle headers 2020-02-22 11:18:34 +01:00
e627106dd6 Fix bug in cross-tabs
It was due to a huge bug in ordered-containers.
2020-02-11 09:37:19 +01:00
593871f19b Fix tests 2020-02-07 11:34:42 +01:00
Lukasz Borchmann
00b02680cc Rename out directory. 2020-02-05 10:46:17 +01:00
Lukasz Borchmann
b4f288d7dd Tests for multi-overlap FLC. 2020-02-04 14:37:57 +01:00
Lukasz Borchmann
1e97eb0694 Fix output order. Change span. 2020-02-04 14:04:07 +01:00
Lukasz Borchmann
b22d1777d7 Tests for FLC-F1 metric 2020-02-04 13:13:58 +01:00
59e26b683b Change Bootstrap option name 2020-01-27 22:52:15 +01:00
1cea36ac93 Helper functions for confidence bounds 2020-01-27 21:54:34 +01:00
ae2769b7b9 Implement bootstrap in GEval 2020-01-25 23:46:33 +01:00
deb14c6702 Add Bootstrap facilities 2020-01-25 22:05:11 +01:00
608b1f9d73 Merge branch 'master' into bootstrap 2020-01-18 18:09:19 +01:00
e170c37864 Add substitution operation 2020-01-11 17:02:49 +01:00
4ba61b6e6e Prepare helper functions for cross-tabs 2020-01-04 18:17:14 +01:00
01486d23aa Change the meaning of WER 2019-12-21 16:03:52 +01:00
9a3a28a813 Add --oracle-item-based option 2019-12-16 11:18:49 +01:00
2234efa107 Multiple metrics can be packed via "Cartesian" strings 2019-12-14 20:59:00 +01:00
cb4efe1d6b Introduce :S flag (sorting words within a line) 2019-11-25 21:31:17 +01:00
839ad5ce47 Merge branch 'master' into bootstrap 2019-11-23 13:17:19 +01:00
03aacdef98 Add SegmentAccuracy metric 2019-11-18 18:35:01 +01:00
Filip Graliński
41fe0d2283 Make room for storing the results of bootstrap resampling 2019-11-02 16:44:13 +01:00
b540cba7da Implement Probabilistic-MultiLabel-F1 2019-09-07 14:16:06 +02:00
029e3880f7 Soft2D-F... Metric is inclusive now. 2019-09-03 17:19:05 +02:00
e4a6ed347d Change the meaning of Soft2D-F1 metric.
Now it is averaged per line.
2019-08-22 17:07:32 +02:00
6b63740c4a Add Soft2D-F metric 2019-08-22 13:20:29 +02:00
dab2646798 Start working on --list-metrics options 2019-08-21 23:44:18 +02:00
4d069e8102 Handle preprocessing operations for metrics 2019-08-12 17:50:48 +02:00
9b79b8761d Check whether the maximum values is obtained during the validation 2019-08-10 15:55:51 +02:00
6fa502ccc2 Test challenge creation & validation 2019-08-10 13:00:29 +02:00
b4ad774623 Trying to get references 2019-05-23 16:16:05 +02:00
eb10a4c3b4 Add plotting graphs for selected metrics 2019-03-19 07:31:17 +01:00
ae27029f61 Implement Probabilistic-Soft-F1 2019-03-12 22:35:19 +01:00
8393bec3ae Implement auxiliary calibration function 2019-03-12 08:58:21 +01:00
1a9fe36a9e Handle JSONl (for MultiLabel-F) 2019-02-14 19:01:53 +01:00
709eeec4ef Merge branch 'master' into jsonl 2019-02-14 16:35:41 +01:00
Filip Gralinski
26e9735d31 Handle jsonl files 2019-02-14 10:54:25 +01:00
Filip Gralinski
872724722a Fix SMAPE on zero values 2019-02-12 08:36:52 +01:00
138b77688b Add test for SMAPE 2019-02-01 12:05:22 +01:00
f7bd1b2ccd Add missing file, when generating a challenge 2019-02-01 12:04:52 +01:00
abcce9bf68 Add numerical features 2019-02-01 10:58:29 +01:00
ea5de5c719 Introduce existential features 2019-01-26 17:18:41 +01:00
Filip Gralinski
dbf5c961af Start numerical factors 2019-01-23 13:00:37 +01:00
39bc3964b3 Speed up cartesian features 2019-01-10 22:53:43 +01:00
212457077f Consider word shapes in black-box debugging 2019-01-10 09:58:04 +01:00
5d19fc7585 Add character-by-character tokenization. 2018-12-17 07:54:12 +01:00
60a8c96aa8 Fix tests 2018-12-07 09:22:55 +01:00
Filip Gralinski
9322307813 Handle more than one possibility in TokenAccuracy 2018-10-24 08:02:34 +02:00
Filip Gralinski
2e816c4e38 Add TokenAccuracy metric 2018-10-23 17:01:33 +02:00