Commit Graph

172 Commits

Author SHA1 Message Date
24dbdc4703 Bump up version number 2019-09-03 17:21:27 +02:00
589235d7bf Bump up version 2019-08-22 17:09:58 +02:00
6b63740c4a Add Soft2D-F metric 2019-08-22 13:20:29 +02:00
dab2646798 Start working on --list-metrics options 2019-08-21 23:44:18 +02:00
4d069e8102 Handle preprocessing operations for metrics 2019-08-12 17:50:48 +02:00
4452095538 More checks in validation 2019-08-10 16:31:54 +02:00
9b79b8761d Check whether the maximum values is obtained during the validation 2019-08-10 15:55:51 +02:00
2236899c3d Refactor (introduce GEval.Metric) 2019-08-10 12:30:17 +02:00
Karol Kaczmarek
19d231e140 Add simple validation of a challenge (--validate option) 2019-08-05 09:28:12 +02:00
b4ad774623 Trying to get references 2019-05-23 16:16:05 +02:00
1c0395f2ed Bump up version number 2019-03-19 20:41:48 +01:00
Filip Gralinski
4a8b382669 Bump up version 2019-03-19 08:35:30 +01:00
eb10a4c3b4 Add plotting graphs for selected metrics 2019-03-19 07:31:17 +01:00
bbcb11c498 Bump up version number 2019-03-12 22:41:57 +01:00
ae27029f61 Implement Probabilistic-Soft-F1 2019-03-12 22:35:19 +01:00
8393bec3ae Implement auxiliary calibration function 2019-03-12 08:58:21 +01:00
19642db43f Add auxilliary functions 2019-02-22 11:22:12 +01:00
fcb16d43f1 Export extensionsHandled 2019-02-14 22:29:44 +01:00
94643e2af0 Bump up version number 2019-02-14 20:41:18 +01:00
Filip Gralinski
26e9735d31 Handle jsonl files 2019-02-14 10:54:25 +01:00
Filip Gralinski
872724722a Fix SMAPE on zero values 2019-02-12 08:36:52 +01:00
f7bd1b2ccd Add missing file, when generating a challenge 2019-02-01 12:04:52 +01:00
abcce9bf68 Add numerical features 2019-02-01 10:58:29 +01:00
e0aceb9ca2 Bump up version number 2019-01-14 23:24:24 +01:00
003a8106bb Bump up version number 2019-01-13 12:09:53 +01:00
212457077f Consider word shapes in black-box debugging 2019-01-10 09:58:04 +01:00
e0cfb9c4b0 Add --min-frequency for black box debugging 2019-01-10 08:15:34 +01:00
f72af384a3 Bump up version number 2018-12-17 07:55:07 +01:00
7f2dbee570 bump up version number 2018-12-11 13:26:41 +01:00
9c7f04ec61 Bump up version number 2018-12-07 09:23:11 +01:00
0f57e64775 Bump up version number 2018-11-17 16:56:52 +01:00
Filip Gralinski
9322307813 Handle more than one possibility in TokenAccuracy 2018-10-24 08:02:34 +02:00
Filip Gralinski
b2a0cd28f0 Bump up versionn number 2018-10-23 17:01:48 +02:00
Filip Gralinski
7a3a678034 Bump up version number 2018-10-17 22:42:44 +02:00
8735610745 Implement soft f-score 2018-10-17 22:41:46 +02:00
Filip Gralinski
26ba5ae92a Bump up version number 2018-09-27 21:52:49 +02:00
Filip Gralinski
40481bd5b1 Bump up version number 2018-09-26 22:28:37 +02:00
Filip Gralinski
eb395d9be0 Add WER metric 2018-09-25 08:13:57 +02:00
Filip Gralinski
b419aa7b08 Handle dot decimal separator in parameters 2018-09-12 20:52:56 +02:00
Filip Gralinski
f147438a04 bump up version number 2018-09-10 21:39:50 +02:00
Piotr Halama
bd7c789bae Implement --submit command 2018-08-27 17:57:07 +02:00
Filip Gralinski
d1e9839bee bump up version number 2018-08-17 18:16:11 +02:00
3a68324a6e bump up version number 2018-08-13 10:10:18 +02:00
8388ab4d27 towards tokenization 2018-08-11 22:59:43 +02:00
5098225bc1 improvements in challenge creation 2018-08-10 13:05:42 +02:00
e10f92cf9c create challenge with MultiLabelLikelihood/LogLoss 2018-08-09 16:35:31 +02:00
bd2bfde287 MultiLabel-F1 works on labels given with probs now 2018-08-09 14:08:54 +02:00
da2114e6d2 reverse sides when diffing 2018-08-07 16:21:37 +02:00
6a862c0e82 bump up version number 2018-08-06 12:11:06 +02:00
020b93ccf8 p-value for features counted 2018-08-02 12:50:13 +02:00
2b1cf80601 implement ranking conduit 2018-08-01 22:39:34 +02:00
4b3a4fa665 implement MultiLabel-F metric 2018-07-26 13:01:10 +02:00
c0fd359590 refactor for Gonito 2018-07-14 09:48:45 +02:00
0c6032d166 print params 2018-07-10 16:22:28 +02:00
ab635f2594 add helper function for parsing params in file paths 2018-07-10 11:18:52 +02:00
830de547b0 switch off parallel garbage collector (was slowing down execution on the multi-core system)
see https://github.com/commercialhaskell/stack/issues/680
2018-07-09 09:31:15 +02:00
0708b746a9 fix handling compressed files 2018-06-29 16:59:00 +02:00
1278081a48 results are sorted in the natural manner when multiple outputs are evaluated 2018-06-28 16:32:46 +02:00
338ddb7fbf fully handle multiple outputs 2018-06-28 16:22:22 +02:00
ba26cdb9e0 multiple outs are recognised but not handled 2018-06-28 15:36:47 +02:00
656a194f42 start refactoring to enable evaluating multiple outputs 2018-06-28 14:49:44 +02:00
Tomasz Weissbek
964957b1db Added version flag handling, added changelog 2018-06-13 12:19:06 +02:00
4b06f59d3a bump up version 2018-06-08 12:39:33 +02:00
18ed47322e Merge branch 'master' into smart-conduit 2018-06-02 16:31:36 +02:00
546f2a4e24 bump up version number 2018-06-02 12:24:49 +02:00
3f7384f467 add --sort and --reverse-sort options 2018-05-28 10:04:27 +02:00
f68223409e add test for the line-by-line mode 2018-05-26 21:10:22 +02:00
3e201d11ef update for Stack LTS 11.9 2018-05-19 13:49:53 +02:00
1caec3de35 bump up version 2018-05-17 08:27:15 +02:00
438f013914 automatic decompression 2018-05-17 08:26:57 +02:00
bab4f7d94c bump up version number 2018-05-16 21:01:16 +02:00
82e794ae3c implement BIO-F1 2018-05-16 10:51:50 +02:00
a1c357948e bump up version 2018-05-15 08:16:51 +02:00
bdcd26cddc WIP 2018-05-14 10:37:58 +02:00
cea084c789 accuracy can work on probs now 2018-04-07 21:13:37 +02:00
ff8ec8880e add LogLoss 2018-04-07 08:29:58 +02:00
6c33e2a4ea bump up version number 2018-02-20 21:28:14 +01:00
118d4a5fe9 bump up version number 2018-02-20 21:28:14 +01:00
908248738b bump up version number 2018-02-20 21:28:14 +01:00
e7518a1141 bump up version number 2018-02-20 21:28:14 +01:00
5276e38b42 bump up version number 2018-02-20 21:28:13 +01:00
c70d49c418 add line-by-line mode 2018-02-20 21:28:13 +01:00
2263dd7dd3 bump up version number 2018-02-20 21:28:13 +01:00
a05d850ccf bump up version number 2018-02-20 21:28:13 +01:00
a580030bfb bump up version number 2018-02-20 21:28:13 +01:00
72dbf33b8d make it possible to cover metrics operating on the input, add CharMatch metric 2018-02-20 21:28:13 +01:00
1e8e0e2733 bump up version number 2018-02-20 21:28:13 +01:00
9fb9efafc5 bump up version number 2018-02-20 21:28:13 +01:00
0e9c44a5b5 start working on LogLossHashed 2018-02-20 21:28:13 +01:00
595b2c9650 fix purity 2018-02-20 21:28:13 +01:00
065a3ce9cd add auxiliary function for calculating purity 2018-02-20 21:28:13 +01:00
422d7c63d9 make UTF8 decoding lenient 2018-02-20 21:28:13 +01:00
8c60426bae bump up version 2018-02-20 21:28:13 +01:00
f4568481bc bump up version 2018-02-20 21:28:13 +01:00
d118e15353 refactor 2018-02-20 21:28:12 +01:00
c3a6d94d1c start work on ClippEU 2018-02-20 21:28:12 +01:00
c3106a1ad6 finish general procedure for precision, recall and F-measure 2018-02-20 21:28:12 +01:00
ef9cba2c75 use gonito.net repos insread of GitHub 2018-02-20 21:28:12 +01:00
b4e5dcbd9d add getOptions for extracting options without running the evaluation 2018-02-20 21:28:12 +01:00
a86828e3a8 forgotten export 2018-02-20 21:28:12 +01:00