Commit Graph

337 Commits

Author SHA1 Message Date
8a731aaa35 Update geval 2020-01-31 18:55:19 +01:00
d2a59e59a5 Add bootstrap resampling 2020-01-28 23:14:46 +01:00
580c141a8e Fix sorting tests 2020-01-12 19:27:07 +01:00
e323eb6bea Bring back desc for boolean values 2020-01-07 22:02:06 +01:00
70035e5dcf Fix bug with the wrong result being shown 2020-01-04 22:35:25 +01:00
763de554e5 Merge branch 'speedup' 2020-01-04 22:34:34 +01:00
2fd5ee15a2 Format variant results as cross tables 2020-01-04 22:34:03 +01:00
77895c5cdc Fix sorting in leaderboard 2020-01-04 20:53:24 +01:00
00f2c4567a Preselect items for faster generation of leaderboards 2020-01-04 10:32:52 +01:00
13b2ab7169 Optimizing DB querying when a leaderboard is created 2020-01-04 09:30:56 +01:00
9fe07335cd Add more utils for presentations 2019-12-16 17:07:38 +01:00
e27766b0a6 Improve alternative leaderboard 2019-12-16 16:51:52 +01:00
Filip Graliński
9267bf7f32 Alt alternative leaderboard, fix wrong evaluation 2019-12-16 16:39:20 +01:00
b2742f06e2 Handle metric priorities 2019-12-14 22:24:22 +01:00
fc062cbd1f Showing worst lines 2019-12-14 18:21:47 +01:00
9554b45f8a Show the file basename for a variant 2019-12-14 15:27:59 +01:00
c5e43fcbea Implement re-evaluation 2019-12-14 14:10:50 +01:00
770c167753 Refactor towards changing evaluation records 2019-12-14 11:58:52 +01:00
4c9e8357c8 Add comments 2019-12-14 11:45:17 +01:00
12fd6a1c58 Handle switching to the right commit
(Though not robust)
2019-12-14 11:17:12 +01:00
120c87e44a Prepare application structure for re-evaluation 2019-12-14 10:56:07 +01:00
80020ee404 Show current challenge version 2019-12-13 22:29:41 +01:00
f5c480205e Validate challenge when add or update 2019-12-13 22:14:00 +01:00
5bd6e34c6b Fix making public 2019-12-07 23:17:12 +01:00
219349e95a Fix opening 2019-12-07 22:48:58 +01:00
3705c9c0ea Use the proper server when triggering 2019-12-07 22:34:24 +01:00
247e55ba18 Add a helper function 2019-12-07 21:26:50 +01:00
1b3a55ae12 Just score API interface 2019-11-30 20:47:19 +01:00
c1e901afb4 Search and score API works for output hashes now 2019-11-30 19:44:42 +01:00
d94e40efc7 Unify API for querying for results and scores 2019-11-30 12:47:41 +01:00
7b4b8b101d API for scores handles alternative metrics 2019-11-30 11:56:07 +01:00
1d2c2ca78f Variant information reachable from query results 2019-11-30 11:25:53 +01:00
c0a06ae112 First version of viewing a specific variant 2019-11-30 11:04:52 +01:00
c72cc274d5 Continue work viewing variants 2019-11-30 08:36:21 +01:00
48119428fe Refactor showing a specific submission 2019-11-29 22:10:48 +01:00
4ba7ae2212 Use correctly REPO_HOST in as the default host when submitting 2019-11-29 09:17:17 +01:00
9b75d75cbd Change email with user identifier/login 2019-11-25 22:38:59 +01:00
688b7bfc60 Add instructions how to use Gonito when writing a paper 2019-11-07 14:31:10 +01:00
80b5ae6b33 Set challenge deadline 2019-09-24 22:52:25 +02:00
214ee17aaf New presentation 2019-09-23 23:16:46 +02:00
46ddb826a9 Fix update challenge 2019-09-23 17:35:39 +02:00
5b188cf718 Fix version incrementation 2019-09-20 19:51:44 +02:00
9a53a258ff Show metric names parsed from evaluation schemes 2019-09-11 21:30:37 +02:00
Filip Graliński
0f4150a4a5 Fix issue with unwanted messages 2019-09-10 08:59:30 +02:00
284d7e1acf Handle version while sorting 2019-08-29 21:34:13 +02:00
14b78e7cdd Show submission version 2019-08-29 10:01:36 +02:00
1255577259 Tests are shown without duplicates in case of challenge updates 2019-08-29 09:39:21 +02:00
32c77b3c74 Challenges can be updated 2019-08-29 08:56:22 +02:00
ca42fcbf84 Continue work on challenge updating 2019-08-28 08:49:43 +02:00
40a06a8bee Versions are obligatory for challanges and submission
DB-SCEHEME-BREAKING CHANGE
2019-08-27 23:39:24 +02:00
d9b92b772a Add challenge versions 2019-08-27 22:36:51 +02:00
Filip Graliński
3b6846c683 Update for GEval preprocessing operations 2019-08-12 18:19:02 +02:00
e589996530 Add course summaries 2019-06-15 12:21:41 +02:00
Filip Graliński
f58121b407 Local IDs can be longer 2019-03-20 16:32:52 +01:00
Filip Graliński
27efefeb13 Challenges can be archived 2019-03-20 16:31:08 +01:00
Filip Graliński
e424cc361f Check indicator targets 2019-02-22 14:41:43 +01:00
Filip Graliński
84212562bc Remove dead code 2019-02-22 12:06:44 +01:00
Filip Graliński
904cf8ca7e Mark target lines with colors on the dashboard 2019-02-22 12:02:05 +01:00
Filip Graliński
87f37df55f Format indicators 2019-02-22 09:53:00 +01:00
Filip Graliński
81167926bf Fix formatting indicator target values 2019-02-22 09:03:43 +01:00
ba50789fbe Trying to fix the issue with Slack hook 2019-02-16 13:45:58 +01:00
c52b613ac4 Handle JSON Lines files 2019-02-14 22:57:29 +01:00
2de5a8c4d3 Update for new geval 2019-01-24 21:22:02 +01:00
Filip Graliński
de7c1a262d Git-annex remote can be specified when triggering an evaluation 2018-12-07 09:11:50 +01:00
Filip Graliński
21f9302d1f Fix bug with the same dependency being added twice 2018-11-23 12:49:49 +01:00
ccae7e284f Show downstream submissions 2018-11-17 13:49:44 +01:00
879eb4e044 Block terminal 2018-11-17 10:07:59 +01:00
62e282f136 Convert a boolean value to a non-maybe 2018-11-17 09:49:25 +01:00
Filip Graliński
e3d6117590 Add dependency tracking 2018-11-16 12:43:44 +01:00
ec4947254a Fix slack hook 2018-11-14 20:59:40 +01:00
Filip Graliński
3447b29a82 Handle Slack hooks 2018-11-14 17:41:01 +01:00
Filip Graliński
484b98e699 Consider only non-hidden submissions 2018-11-13 16:15:02 +01:00
Filip Graliński
bc34520fdd Fix bug with submission creation 2018-11-13 14:48:41 +01:00
Filip Gralinski
5e14672b2d Check whether the best one 2018-11-12 22:01:51 +01:00
Filip Gralinski
0a5f05604e Add external links 2018-11-12 20:41:46 +01:00
Filip Gralinski
0e8846b06c Show result tables 2018-11-12 14:12:51 +01:00
Filip Gralinski
6b87181454 Add ranks to submission lists 2018-11-12 10:11:58 +01:00
Filip Gralinski
ff2112a745 Improve showing a single submission 2018-11-10 11:20:17 +01:00
Filip Gralinski
2416dacffb Description is clickable 2018-11-03 21:37:44 +01:00
Filip Gralinski
37125b8326 Sets are used instead of strings for tags 2018-11-03 17:25:49 +01:00
Filip Gralinski
9d67e39a06 Take params 2018-11-03 12:30:39 +01:00
Filip Gralinski
d3e2c06b15 Change HashMap to Map, clean up 2018-11-03 10:56:58 +01:00
Filip Graliński
7404dd330d Show all deadline lines 2018-10-25 09:23:05 +02:00
Filip Gralinski
876e98f862 Merge branch 'master' of ssh://gonito.net/gonito 2018-10-15 21:15:29 +02:00
Filip Gralinski
687716f6fe Handle tags and description from gonito.yaml 2018-10-15 21:15:03 +02:00
Filip Graliński
32ae5d7e1a Use --single-branch 2018-10-15 14:19:20 +02:00
Filip Graliński
a2ae700158 Add first version of indicator graphs 2018-09-22 19:22:00 +02:00
Filip Gralinski
e1b1ff53f1 Add indicators to the database, make it possible to edit them in the dashboard.
The dashboard itself (in terms of graphs) is not part of this commit.
2018-09-14 15:50:44 +02:00
Filip Gralinski
69dedeecbd Fix some warnings in Achievements 2018-09-14 15:50:42 +02:00
Filip Gralinski
1415133bab Fix order of tests 2018-09-08 21:24:25 +02:00
Filip Gralinski
055687506b Add by-tag mode for the leaderboard 2018-09-08 21:21:21 +02:00
Filip Gralinski
20fc29159f Show all main metrics in the leaderboard 2018-09-08 19:21:06 +02:00
Filip Gralinski
858f494047 Scores are sorted correctly with N/A and Infinity values correctly handled 2018-09-08 10:20:36 +02:00
Filip Gralinski
1aafff1808 Do not use scientific formatting of scores 2018-09-08 09:03:22 +02:00
2ed724bf05 handle tags correctly in case of re-submission 2018-09-01 15:27:11 +02:00
bed12dee34 show only numerical params on graphs 2018-09-01 14:23:41 +02:00
40016c36e5 fix function name 2018-09-01 14:01:17 +02:00
c23e28250a numbers in graphs are shown with the right precision 2018-09-01 13:56:18 +02:00
6c6c63114f improve creating challenges 2018-09-01 12:01:35 +02:00
63dac77974 improve submission for how-to 2018-09-01 11:06:42 +02:00