Commit Graph

376 Commits

Author SHA1 Message Date
e27766b0a6 Improve alternative leaderboard 2019-12-16 16:51:52 +01:00
Filip Graliński
9267bf7f32 Alt alternative leaderboard, fix wrong evaluation 2019-12-16 16:39:20 +01:00
b2742f06e2 Handle metric priorities 2019-12-14 22:24:22 +01:00
fc062cbd1f Showing worst lines 2019-12-14 18:21:47 +01:00
9554b45f8a Show the file basename for a variant 2019-12-14 15:27:59 +01:00
c5e43fcbea Implement re-evaluation 2019-12-14 14:10:50 +01:00
770c167753 Refactor towards changing evaluation records 2019-12-14 11:58:52 +01:00
4c9e8357c8 Add comments 2019-12-14 11:45:17 +01:00
12fd6a1c58 Handle switching to the right commit
(Though not robust)
2019-12-14 11:17:12 +01:00
120c87e44a Prepare application structure for re-evaluation 2019-12-14 10:56:07 +01:00
80020ee404 Show current challenge version 2019-12-13 22:29:41 +01:00
f5c480205e Validate challenge when add or update 2019-12-13 22:14:00 +01:00
5bd6e34c6b Fix making public 2019-12-07 23:17:12 +01:00
219349e95a Fix opening 2019-12-07 22:48:58 +01:00
3705c9c0ea Use the proper server when triggering 2019-12-07 22:34:24 +01:00
247e55ba18 Add a helper function 2019-12-07 21:26:50 +01:00
1b3a55ae12 Just score API interface 2019-11-30 20:47:19 +01:00
c1e901afb4 Search and score API works for output hashes now 2019-11-30 19:44:42 +01:00
d94e40efc7 Unify API for querying for results and scores 2019-11-30 12:47:41 +01:00
7b4b8b101d API for scores handles alternative metrics 2019-11-30 11:56:07 +01:00
1d2c2ca78f Variant information reachable from query results 2019-11-30 11:25:53 +01:00
c0a06ae112 First version of viewing a specific variant 2019-11-30 11:04:52 +01:00
c72cc274d5 Continue work viewing variants 2019-11-30 08:36:21 +01:00
48119428fe Refactor showing a specific submission 2019-11-29 22:10:48 +01:00
4ba7ae2212 Use correctly REPO_HOST in as the default host when submitting 2019-11-29 09:17:17 +01:00
9b75d75cbd Change email with user identifier/login 2019-11-25 22:38:59 +01:00
688b7bfc60 Add instructions how to use Gonito when writing a paper 2019-11-07 14:31:10 +01:00
80b5ae6b33 Set challenge deadline 2019-09-24 22:52:25 +02:00
214ee17aaf New presentation 2019-09-23 23:16:46 +02:00
46ddb826a9 Fix update challenge 2019-09-23 17:35:39 +02:00
5b188cf718 Fix version incrementation 2019-09-20 19:51:44 +02:00
9a53a258ff Show metric names parsed from evaluation schemes 2019-09-11 21:30:37 +02:00
Filip Graliński
0f4150a4a5 Fix issue with unwanted messages 2019-09-10 08:59:30 +02:00
284d7e1acf Handle version while sorting 2019-08-29 21:34:13 +02:00
14b78e7cdd Show submission version 2019-08-29 10:01:36 +02:00
1255577259 Tests are shown without duplicates in case of challenge updates 2019-08-29 09:39:21 +02:00
32c77b3c74 Challenges can be updated 2019-08-29 08:56:22 +02:00
ca42fcbf84 Continue work on challenge updating 2019-08-28 08:49:43 +02:00
40a06a8bee Versions are obligatory for challanges and submission
DB-SCEHEME-BREAKING CHANGE
2019-08-27 23:39:24 +02:00
d9b92b772a Add challenge versions 2019-08-27 22:36:51 +02:00
Filip Graliński
3b6846c683 Update for GEval preprocessing operations 2019-08-12 18:19:02 +02:00
e589996530 Add course summaries 2019-06-15 12:21:41 +02:00
Filip Graliński
f58121b407 Local IDs can be longer 2019-03-20 16:32:52 +01:00
Filip Graliński
27efefeb13 Challenges can be archived 2019-03-20 16:31:08 +01:00
Filip Graliński
e424cc361f Check indicator targets 2019-02-22 14:41:43 +01:00
Filip Graliński
84212562bc Remove dead code 2019-02-22 12:06:44 +01:00
Filip Graliński
904cf8ca7e Mark target lines with colors on the dashboard 2019-02-22 12:02:05 +01:00
Filip Graliński
87f37df55f Format indicators 2019-02-22 09:53:00 +01:00
Filip Graliński
81167926bf Fix formatting indicator target values 2019-02-22 09:03:43 +01:00
ba50789fbe Trying to fix the issue with Slack hook 2019-02-16 13:45:58 +01:00
c52b613ac4 Handle JSON Lines files 2019-02-14 22:57:29 +01:00
2de5a8c4d3 Update for new geval 2019-01-24 21:22:02 +01:00
Filip Graliński
de7c1a262d Git-annex remote can be specified when triggering an evaluation 2018-12-07 09:11:50 +01:00
Filip Graliński
21f9302d1f Fix bug with the same dependency being added twice 2018-11-23 12:49:49 +01:00
ccae7e284f Show downstream submissions 2018-11-17 13:49:44 +01:00
879eb4e044 Block terminal 2018-11-17 10:07:59 +01:00
62e282f136 Convert a boolean value to a non-maybe 2018-11-17 09:49:25 +01:00
Filip Graliński
e3d6117590 Add dependency tracking 2018-11-16 12:43:44 +01:00
ec4947254a Fix slack hook 2018-11-14 20:59:40 +01:00
Filip Graliński
3447b29a82 Handle Slack hooks 2018-11-14 17:41:01 +01:00
Filip Graliński
484b98e699 Consider only non-hidden submissions 2018-11-13 16:15:02 +01:00
Filip Graliński
bc34520fdd Fix bug with submission creation 2018-11-13 14:48:41 +01:00
Filip Gralinski
5e14672b2d Check whether the best one 2018-11-12 22:01:51 +01:00
Filip Gralinski
0a5f05604e Add external links 2018-11-12 20:41:46 +01:00
Filip Gralinski
0e8846b06c Show result tables 2018-11-12 14:12:51 +01:00
Filip Gralinski
6b87181454 Add ranks to submission lists 2018-11-12 10:11:58 +01:00
Filip Gralinski
ff2112a745 Improve showing a single submission 2018-11-10 11:20:17 +01:00
Filip Gralinski
2416dacffb Description is clickable 2018-11-03 21:37:44 +01:00
Filip Gralinski
37125b8326 Sets are used instead of strings for tags 2018-11-03 17:25:49 +01:00
Filip Gralinski
9d67e39a06 Take params 2018-11-03 12:30:39 +01:00
Filip Gralinski
d3e2c06b15 Change HashMap to Map, clean up 2018-11-03 10:56:58 +01:00
Filip Graliński
7404dd330d Show all deadline lines 2018-10-25 09:23:05 +02:00
Filip Gralinski
876e98f862 Merge branch 'master' of ssh://gonito.net/gonito 2018-10-15 21:15:29 +02:00
Filip Gralinski
687716f6fe Handle tags and description from gonito.yaml 2018-10-15 21:15:03 +02:00
Filip Graliński
32ae5d7e1a Use --single-branch 2018-10-15 14:19:20 +02:00
Filip Graliński
a2ae700158 Add first version of indicator graphs 2018-09-22 19:22:00 +02:00
Filip Gralinski
e1b1ff53f1 Add indicators to the database, make it possible to edit them in the dashboard.
The dashboard itself (in terms of graphs) is not part of this commit.
2018-09-14 15:50:44 +02:00
Filip Gralinski
69dedeecbd Fix some warnings in Achievements 2018-09-14 15:50:42 +02:00
Filip Gralinski
1415133bab Fix order of tests 2018-09-08 21:24:25 +02:00
Filip Gralinski
055687506b Add by-tag mode for the leaderboard 2018-09-08 21:21:21 +02:00
Filip Gralinski
20fc29159f Show all main metrics in the leaderboard 2018-09-08 19:21:06 +02:00
Filip Gralinski
858f494047 Scores are sorted correctly with N/A and Infinity values correctly handled 2018-09-08 10:20:36 +02:00
Filip Gralinski
1aafff1808 Do not use scientific formatting of scores 2018-09-08 09:03:22 +02:00
2ed724bf05 handle tags correctly in case of re-submission 2018-09-01 15:27:11 +02:00
bed12dee34 show only numerical params on graphs 2018-09-01 14:23:41 +02:00
40016c36e5 fix function name 2018-09-01 14:01:17 +02:00
c23e28250a numbers in graphs are shown with the right precision 2018-09-01 13:56:18 +02:00
6c6c63114f improve creating challenges 2018-09-01 12:01:35 +02:00
63dac77974 improve submission for how-to 2018-09-01 11:06:42 +02:00
0758ca3239 fix triggering an evaluation when running in the auto-opening mode 2018-09-01 10:48:08 +02:00
fac5d451d6 use space instead of slash as separator between test-name and metric (in tables)
so that the hear could be wrapped in a more narrow column if needed
(e.g. if the number of test sets/metric is large)
2018-09-01 10:46:39 +02:00
d9a3d56d3d improve showing query results, fix issue with triggering evaluation for the first time 2018-08-30 21:58:27 +02:00
b14e675c61 add a parameter 2018-07-30 07:59:38 +02:00
ff8d8d8e7a param graphs are shown for the challenge main page as well 2018-07-28 22:10:55 +02:00
abef15c905 refactor param graphs 2018-07-28 22:02:47 +02:00
3388971ed6 clean up and refactor 2018-07-28 21:53:13 +02:00
3a4c85c501 clean up ShowChallenge 2018-07-28 21:36:45 +02:00
9d54deb68f show param graphs for all non-dev tests 2018-07-28 21:22:52 +02:00
c60e786025 refactor getMainTest 2018-07-28 19:59:29 +02:00
e263a37eca clean up and generalize code generating param charts 2018-07-28 19:16:07 +02:00
5105652838 clean up code a little bit 2018-07-28 17:30:00 +02:00
0a51543957 show graphs for params 2018-07-28 17:04:27 +02:00
276ca4d596 start working on C3 2018-07-26 22:01:21 +02:00
ae75c806c7 clean up code in Runner, fix a likely bug 2018-07-26 21:46:17 +02:00
70271c81f5 show params in graph labels 2018-07-24 15:36:24 +02:00
c54af512c7 add auto-opening mode 2018-07-24 15:33:35 +02:00
3c157290b9 graph shows challenges with variants correctly 2018-07-24 15:21:20 +02:00
92f16f6c5d generalize toLeaderboardEntries 2018-07-24 15:02:37 +02:00
23c2cb0072 show variant information at leaderboard 2018-07-24 14:08:47 +02:00
623ccfb602 show params 2018-07-14 19:44:33 +02:00
2f796d47cb get parameters when table is shown 2018-07-14 17:10:07 +02:00
ca9bcbac55 refactor tables 2018-07-14 17:02:30 +02:00
f3960c371d multiple outs can be accepted now 2018-07-14 15:27:49 +02:00
bb77049918 clean up some warnings 2018-07-14 07:42:28 +02:00
4dbf64ecfc clean up variants 2018-07-14 07:38:55 +02:00
9b445d6e9c variants are used within within outs - transition completed 2018-07-06 16:54:17 +02:00
b572bf45d0 clean up some warnings 2018-07-05 22:17:25 +02:00
eedf1cd6fa variant is now required for an out 2018-07-05 22:15:21 +02:00
a7bd6a933e dummy variants for "out" files are added now 2018-07-04 17:01:45 +02:00
52ae6ae9a5 start transition to multiple variants per submission 2018-07-04 16:22:10 +02:00
306d9d0af6 update for GEval 1.1.0.0 2018-06-29 08:05:33 +02:00
4ec90bdb10 introducint 2 modes for tags 2018-06-27 13:32:45 +02:00
7b7001845d a submission can be removed now (actually hidden) 2018-06-27 13:09:11 +02:00
252da6316a fix problem with git-annex remote when updating a repo, get rid of some warnings 2018-06-14 20:35:48 +02:00
f7a85e80a0 fix handling compressed expected files 2018-06-09 15:35:31 +02:00
d7c656217f fix mutiple metrics 2018-06-08 22:15:49 +02:00
32f0d1eb12 fix handle compressed out-files 2018-06-08 21:59:06 +02:00
1ea5e4ecbd handle multiple metrics for the same test 2018-06-08 15:00:40 +02:00
fe170e9a05 fix handling GitLab URLs 2018-06-06 14:18:27 +02:00
a9de751d87 showing submissions correctly in "branches" mode 2018-06-06 13:43:17 +02:00
115df0521d improve "branches" mode 2018-06-06 13:08:38 +02:00
92c0927dca fix update a submission when using git-annex 2018-06-06 12:58:50 +02:00
85c9ad6646 improve how-to for self-hosted instances and git-annex 2018-06-06 10:30:53 +02:00
28222d5a37 repo host can be set 2018-06-05 23:04:58 +02:00
1262cc7cb8 does not check for correctness of Git URLs
(URL copied&pasted from, for instance, GitLab does not have the protocol anyway.)
2018-06-05 22:39:02 +02:00
0b1263af27 fix pargins git-annex remote 2018-06-05 16:57:44 +02:00
35bb3c7af6 finished handling git-annex 2018-06-05 16:23:16 +02:00
e06f2120ea start using Runner monad 2018-06-05 09:36:48 +02:00
dcdf71b5e6 prepare Runner for better running stuff 2018-06-05 09:07:01 +02:00
edf0624b95 refactor running stuff 2018-06-05 08:22:51 +02:00
f1502c16e4 start handling git-annex remote 2018-06-05 07:46:42 +02:00
06970317a7 refactored cloning cntd. 2018-06-04 22:14:39 +02:00
ae389aa144 refactor cloning cntd. 2018-06-04 21:58:05 +02:00
61ca7e7839 refactor cloning git repos 2018-06-01 22:52:49 +02:00
0662522a44 update to Stack LTS 11.9 2018-05-20 16:58:48 +02:00
4e3fb94ce0 update for LTS 10.10 2018-05-19 08:05:24 +02:00
a2d13c5b61 using Gonito.net in class 2018-04-07 18:51:58 +02:00
f263913c6b clean up starred 2018-01-25 16:43:50 +01:00
d38e14c07a API for returning scores 2018-01-25 16:34:05 +01:00
3a90144858 update for changes in GEval 2018-01-25 09:13:06 +01:00