Commit Graph

392 Commits

Author SHA1 Message Date
a2814f2d12 add function for evaluating single lines 2018-02-20 21:28:13 +01:00
8d87ee4c4b refactor Core so that any conduit source could be accepted, not just file names 2018-02-20 21:28:13 +01:00
2263dd7dd3 bump up version number 2018-02-20 21:28:13 +01:00
9643719193 add MAP metric 2018-02-20 21:28:13 +01:00
7eef53832d update to newer Stack 2018-02-20 21:28:13 +01:00
a05d850ccf bump up version number 2018-02-20 21:28:13 +01:00
c10f3579c6 fix BLEU for empty output 2018-02-20 21:28:13 +01:00
f289cafc03 upgrade to Stack LTS 9.5 2018-02-20 21:28:13 +01:00
a580030bfb bump up version number 2018-02-20 21:28:13 +01:00
54c899ddfc generating sample CharMatch challenge, CharMatch is F0.5 now 2018-02-20 21:28:13 +01:00
72dbf33b8d make it possible to cover metrics operating on the input, add CharMatch metric 2018-02-20 21:28:13 +01:00
1e8e0e2733 bump up version number 2018-02-20 21:28:13 +01:00
6144ae6bdf add sample toy challenge for LogLossHashed 2018-02-20 21:28:13 +01:00
59f19cbe18 change default size of hash 2018-02-20 21:28:13 +01:00
9fb9efafc5 bump up version number 2018-02-20 21:28:13 +01:00
b058cd0095 implement softmax in LogLossHashed 2018-02-20 21:28:13 +01:00
e84a14d069 salt LogLossHashed with line numbers 2018-02-20 21:28:13 +01:00
0e9c44a5b5 start working on LogLossHashed 2018-02-20 21:28:13 +01:00
073d92a4e7 add sample challenge for NMI 2018-02-20 21:28:13 +01:00
37c31e6075 NMI implemented as geval metric 2018-02-20 21:28:13 +01:00
6f428d6496 add NMI 2018-02-20 21:28:13 +01:00
595b2c9650 fix purity 2018-02-20 21:28:13 +01:00
065a3ce9cd add auxiliary function for calculating purity 2018-02-20 21:28:13 +01:00
422d7c63d9 make UTF8 decoding lenient 2018-02-20 21:28:13 +01:00
6dc293a4b9 add more explanation for the F-measure example 2018-02-20 21:28:13 +01:00
8e87e97f2d add F-measure 2018-02-20 21:28:13 +01:00
bc910c3a9b bump up stack 2018-02-20 21:28:13 +01:00
8c60426bae bump up version 2018-02-20 21:28:13 +01:00
f4568481bc bump up version 2018-02-20 21:28:13 +01:00
c3857e8183 fix help 2018-02-20 21:28:12 +01:00
67f73f420e ClippEU passes tests 2018-02-20 21:28:12 +01:00
fcc52d6c3a bump up stack 2018-02-20 21:28:12 +01:00
d118e15353 refactor 2018-02-20 21:28:12 +01:00
c3a6d94d1c start work on ClippEU 2018-02-20 21:28:12 +01:00
0835bc3a4e more tests 2018-02-20 21:28:12 +01:00
c3106a1ad6 finish general procedure for precision, recall and F-measure 2018-02-20 21:28:12 +01:00
Filip Gralinski
b14e6a38a2 start implementing general precision/recall 2018-02-20 21:28:12 +01:00
Filip Gralinski
ea058c9763 prepare a simple test set for ClippEU 2018-02-20 21:28:12 +01:00
592fb3fe1b update resolver 2018-02-20 21:28:12 +01:00
10b1c119bb update and fix README 2018-02-20 21:28:12 +01:00
ef9cba2c75 use gonito.net repos insread of GitHub 2018-02-20 21:28:12 +01:00
b4e5dcbd9d add getOptions for extracting options without running the evaluation 2018-02-20 21:28:12 +01:00
a86828e3a8 forgotten export 2018-02-20 21:28:12 +01:00
995beb6dbc handle metric ordering 2018-02-20 21:28:12 +01:00
e152f5f5ab bump up stack 2018-02-20 21:28:12 +01:00
e979d6b2df minor clean-up 2018-02-20 21:28:12 +01:00
fbe71aef92 minor fix 2018-02-20 21:28:12 +01:00
e66a8d8341 handle numbers combined with text 2018-02-20 21:28:12 +01:00
b52819f67e check whether data is OK 2018-02-20 21:28:12 +01:00
7f3973890d check emptiness 2018-02-20 21:28:12 +01:00