Commit Graph

437 Commits

Author SHA1 Message Date
8a731aaa35 Update geval 2020-01-31 18:55:19 +01:00
d2a59e59a5 Add bootstrap resampling 2020-01-28 23:14:46 +01:00
580c141a8e Fix sorting tests 2020-01-12 19:27:07 +01:00
e323eb6bea Bring back desc for boolean values 2020-01-07 22:02:06 +01:00
70035e5dcf Fix bug with the wrong result being shown 2020-01-04 22:35:25 +01:00
763de554e5 Merge branch 'speedup' 2020-01-04 22:34:34 +01:00
2fd5ee15a2 Format variant results as cross tables 2020-01-04 22:34:03 +01:00
77895c5cdc Fix sorting in leaderboard 2020-01-04 20:53:24 +01:00
00f2c4567a Preselect items for faster generation of leaderboards 2020-01-04 10:32:52 +01:00
13b2ab7169 Optimizing DB querying when a leaderboard is created 2020-01-04 09:30:56 +01:00
9fe07335cd Add more utils for presentations 2019-12-16 17:07:38 +01:00
e27766b0a6 Improve alternative leaderboard 2019-12-16 16:51:52 +01:00
Filip Graliński
9267bf7f32 Alt alternative leaderboard, fix wrong evaluation 2019-12-16 16:39:20 +01:00
b2742f06e2 Handle metric priorities 2019-12-14 22:24:22 +01:00
fc062cbd1f Showing worst lines 2019-12-14 18:21:47 +01:00
9554b45f8a Show the file basename for a variant 2019-12-14 15:27:59 +01:00
c5e43fcbea Implement re-evaluation 2019-12-14 14:10:50 +01:00
770c167753 Refactor towards changing evaluation records 2019-12-14 11:58:52 +01:00
4c9e8357c8 Add comments 2019-12-14 11:45:17 +01:00
12fd6a1c58 Handle switching to the right commit
(Though not robust)
2019-12-14 11:17:12 +01:00
120c87e44a Prepare application structure for re-evaluation 2019-12-14 10:56:07 +01:00
80020ee404 Show current challenge version 2019-12-13 22:29:41 +01:00
f5c480205e Validate challenge when add or update 2019-12-13 22:14:00 +01:00
5bd6e34c6b Fix making public 2019-12-07 23:17:12 +01:00
219349e95a Fix opening 2019-12-07 22:48:58 +01:00
3705c9c0ea Use the proper server when triggering 2019-12-07 22:34:24 +01:00
247e55ba18 Add a helper function 2019-12-07 21:26:50 +01:00
1b3a55ae12 Just score API interface 2019-11-30 20:47:19 +01:00
c1e901afb4 Search and score API works for output hashes now 2019-11-30 19:44:42 +01:00
d94e40efc7 Unify API for querying for results and scores 2019-11-30 12:47:41 +01:00
7b4b8b101d API for scores handles alternative metrics 2019-11-30 11:56:07 +01:00
1d2c2ca78f Variant information reachable from query results 2019-11-30 11:25:53 +01:00
c0a06ae112 First version of viewing a specific variant 2019-11-30 11:04:52 +01:00
c72cc274d5 Continue work viewing variants 2019-11-30 08:36:21 +01:00
48119428fe Refactor showing a specific submission 2019-11-29 22:10:48 +01:00
4ba7ae2212 Use correctly REPO_HOST in as the default host when submitting 2019-11-29 09:17:17 +01:00
9b75d75cbd Change email with user identifier/login 2019-11-25 22:38:59 +01:00
688b7bfc60 Add instructions how to use Gonito when writing a paper 2019-11-07 14:31:10 +01:00
80b5ae6b33 Set challenge deadline 2019-09-24 22:52:25 +02:00
214ee17aaf New presentation 2019-09-23 23:16:46 +02:00
46ddb826a9 Fix update challenge 2019-09-23 17:35:39 +02:00
5b188cf718 Fix version incrementation 2019-09-20 19:51:44 +02:00
9a53a258ff Show metric names parsed from evaluation schemes 2019-09-11 21:30:37 +02:00
Filip Graliński
0f4150a4a5 Fix issue with unwanted messages 2019-09-10 08:59:30 +02:00
284d7e1acf Handle version while sorting 2019-08-29 21:34:13 +02:00
14b78e7cdd Show submission version 2019-08-29 10:01:36 +02:00
1255577259 Tests are shown without duplicates in case of challenge updates 2019-08-29 09:39:21 +02:00
32c77b3c74 Challenges can be updated 2019-08-29 08:56:22 +02:00
ca42fcbf84 Continue work on challenge updating 2019-08-28 08:49:43 +02:00
40a06a8bee Versions are obligatory for challanges and submission
DB-SCEHEME-BREAKING CHANGE
2019-08-27 23:39:24 +02:00
d9b92b772a Add challenge versions 2019-08-27 22:36:51 +02:00
Filip Graliński
3b6846c683 Update for GEval preprocessing operations 2019-08-12 18:19:02 +02:00
e589996530 Add course summaries 2019-06-15 12:21:41 +02:00
Filip Graliński
f58121b407 Local IDs can be longer 2019-03-20 16:32:52 +01:00
Filip Graliński
27efefeb13 Challenges can be archived 2019-03-20 16:31:08 +01:00
Filip Graliński
e424cc361f Check indicator targets 2019-02-22 14:41:43 +01:00
Filip Graliński
84212562bc Remove dead code 2019-02-22 12:06:44 +01:00
Filip Graliński
904cf8ca7e Mark target lines with colors on the dashboard 2019-02-22 12:02:05 +01:00
Filip Graliński
87f37df55f Format indicators 2019-02-22 09:53:00 +01:00
Filip Graliński
81167926bf Fix formatting indicator target values 2019-02-22 09:03:43 +01:00
ba50789fbe Trying to fix the issue with Slack hook 2019-02-16 13:45:58 +01:00
c52b613ac4 Handle JSON Lines files 2019-02-14 22:57:29 +01:00
2de5a8c4d3 Update for new geval 2019-01-24 21:22:02 +01:00
Filip Graliński
de7c1a262d Git-annex remote can be specified when triggering an evaluation 2018-12-07 09:11:50 +01:00
Filip Graliński
21f9302d1f Fix bug with the same dependency being added twice 2018-11-23 12:49:49 +01:00
ccae7e284f Show downstream submissions 2018-11-17 13:49:44 +01:00
879eb4e044 Block terminal 2018-11-17 10:07:59 +01:00
62e282f136 Convert a boolean value to a non-maybe 2018-11-17 09:49:25 +01:00
Filip Graliński
e3d6117590 Add dependency tracking 2018-11-16 12:43:44 +01:00
ec4947254a Fix slack hook 2018-11-14 20:59:40 +01:00
Filip Graliński
3447b29a82 Handle Slack hooks 2018-11-14 17:41:01 +01:00
Filip Graliński
484b98e699 Consider only non-hidden submissions 2018-11-13 16:15:02 +01:00
Filip Graliński
bc34520fdd Fix bug with submission creation 2018-11-13 14:48:41 +01:00
Filip Gralinski
5e14672b2d Check whether the best one 2018-11-12 22:01:51 +01:00
Filip Gralinski
0a5f05604e Add external links 2018-11-12 20:41:46 +01:00
Filip Gralinski
0e8846b06c Show result tables 2018-11-12 14:12:51 +01:00
Filip Gralinski
6b87181454 Add ranks to submission lists 2018-11-12 10:11:58 +01:00
Filip Gralinski
ff2112a745 Improve showing a single submission 2018-11-10 11:20:17 +01:00
Filip Gralinski
2416dacffb Description is clickable 2018-11-03 21:37:44 +01:00
Filip Gralinski
37125b8326 Sets are used instead of strings for tags 2018-11-03 17:25:49 +01:00
Filip Gralinski
9d67e39a06 Take params 2018-11-03 12:30:39 +01:00
Filip Gralinski
d3e2c06b15 Change HashMap to Map, clean up 2018-11-03 10:56:58 +01:00
Filip Graliński
7404dd330d Show all deadline lines 2018-10-25 09:23:05 +02:00
Filip Gralinski
876e98f862 Merge branch 'master' of ssh://gonito.net/gonito 2018-10-15 21:15:29 +02:00
Filip Gralinski
687716f6fe Handle tags and description from gonito.yaml 2018-10-15 21:15:03 +02:00
Filip Graliński
32ae5d7e1a Use --single-branch 2018-10-15 14:19:20 +02:00
Filip Graliński
a2ae700158 Add first version of indicator graphs 2018-09-22 19:22:00 +02:00
Filip Gralinski
e1b1ff53f1 Add indicators to the database, make it possible to edit them in the dashboard.
The dashboard itself (in terms of graphs) is not part of this commit.
2018-09-14 15:50:44 +02:00
Filip Gralinski
69dedeecbd Fix some warnings in Achievements 2018-09-14 15:50:42 +02:00
Filip Gralinski
1415133bab Fix order of tests 2018-09-08 21:24:25 +02:00
Filip Gralinski
055687506b Add by-tag mode for the leaderboard 2018-09-08 21:21:21 +02:00
Filip Gralinski
20fc29159f Show all main metrics in the leaderboard 2018-09-08 19:21:06 +02:00
Filip Gralinski
858f494047 Scores are sorted correctly with N/A and Infinity values correctly handled 2018-09-08 10:20:36 +02:00
Filip Gralinski
1aafff1808 Do not use scientific formatting of scores 2018-09-08 09:03:22 +02:00
2ed724bf05 handle tags correctly in case of re-submission 2018-09-01 15:27:11 +02:00
bed12dee34 show only numerical params on graphs 2018-09-01 14:23:41 +02:00
40016c36e5 fix function name 2018-09-01 14:01:17 +02:00
c23e28250a numbers in graphs are shown with the right precision 2018-09-01 13:56:18 +02:00
6c6c63114f improve creating challenges 2018-09-01 12:01:35 +02:00
63dac77974 improve submission for how-to 2018-09-01 11:06:42 +02:00
0758ca3239 fix triggering an evaluation when running in the auto-opening mode 2018-09-01 10:48:08 +02:00
fac5d451d6 use space instead of slash as separator between test-name and metric (in tables)
so that the hear could be wrapped in a more narrow column if needed
(e.g. if the number of test sets/metric is large)
2018-09-01 10:46:39 +02:00
d9a3d56d3d improve showing query results, fix issue with triggering evaluation for the first time 2018-08-30 21:58:27 +02:00
b14e675c61 add a parameter 2018-07-30 07:59:38 +02:00
ff8d8d8e7a param graphs are shown for the challenge main page as well 2018-07-28 22:10:55 +02:00
abef15c905 refactor param graphs 2018-07-28 22:02:47 +02:00
3388971ed6 clean up and refactor 2018-07-28 21:53:13 +02:00
3a4c85c501 clean up ShowChallenge 2018-07-28 21:36:45 +02:00
9d54deb68f show param graphs for all non-dev tests 2018-07-28 21:22:52 +02:00
c60e786025 refactor getMainTest 2018-07-28 19:59:29 +02:00
e263a37eca clean up and generalize code generating param charts 2018-07-28 19:16:07 +02:00
5105652838 clean up code a little bit 2018-07-28 17:30:00 +02:00
0a51543957 show graphs for params 2018-07-28 17:04:27 +02:00
276ca4d596 start working on C3 2018-07-26 22:01:21 +02:00
ae75c806c7 clean up code in Runner, fix a likely bug 2018-07-26 21:46:17 +02:00
70271c81f5 show params in graph labels 2018-07-24 15:36:24 +02:00
c54af512c7 add auto-opening mode 2018-07-24 15:33:35 +02:00
3c157290b9 graph shows challenges with variants correctly 2018-07-24 15:21:20 +02:00
92f16f6c5d generalize toLeaderboardEntries 2018-07-24 15:02:37 +02:00
23c2cb0072 show variant information at leaderboard 2018-07-24 14:08:47 +02:00
623ccfb602 show params 2018-07-14 19:44:33 +02:00
2f796d47cb get parameters when table is shown 2018-07-14 17:10:07 +02:00
ca9bcbac55 refactor tables 2018-07-14 17:02:30 +02:00
f3960c371d multiple outs can be accepted now 2018-07-14 15:27:49 +02:00
bb77049918 clean up some warnings 2018-07-14 07:42:28 +02:00
4dbf64ecfc clean up variants 2018-07-14 07:38:55 +02:00
9b445d6e9c variants are used within within outs - transition completed 2018-07-06 16:54:17 +02:00
b572bf45d0 clean up some warnings 2018-07-05 22:17:25 +02:00
eedf1cd6fa variant is now required for an out 2018-07-05 22:15:21 +02:00
a7bd6a933e dummy variants for "out" files are added now 2018-07-04 17:01:45 +02:00
52ae6ae9a5 start transition to multiple variants per submission 2018-07-04 16:22:10 +02:00
306d9d0af6 update for GEval 1.1.0.0 2018-06-29 08:05:33 +02:00
4ec90bdb10 introducint 2 modes for tags 2018-06-27 13:32:45 +02:00
7b7001845d a submission can be removed now (actually hidden) 2018-06-27 13:09:11 +02:00
252da6316a fix problem with git-annex remote when updating a repo, get rid of some warnings 2018-06-14 20:35:48 +02:00
f7a85e80a0 fix handling compressed expected files 2018-06-09 15:35:31 +02:00
d7c656217f fix mutiple metrics 2018-06-08 22:15:49 +02:00
32f0d1eb12 fix handle compressed out-files 2018-06-08 21:59:06 +02:00
1ea5e4ecbd handle multiple metrics for the same test 2018-06-08 15:00:40 +02:00
fe170e9a05 fix handling GitLab URLs 2018-06-06 14:18:27 +02:00
a9de751d87 showing submissions correctly in "branches" mode 2018-06-06 13:43:17 +02:00
115df0521d improve "branches" mode 2018-06-06 13:08:38 +02:00
92c0927dca fix update a submission when using git-annex 2018-06-06 12:58:50 +02:00
85c9ad6646 improve how-to for self-hosted instances and git-annex 2018-06-06 10:30:53 +02:00
28222d5a37 repo host can be set 2018-06-05 23:04:58 +02:00
1262cc7cb8 does not check for correctness of Git URLs
(URL copied&pasted from, for instance, GitLab does not have the protocol anyway.)
2018-06-05 22:39:02 +02:00
0b1263af27 fix pargins git-annex remote 2018-06-05 16:57:44 +02:00
35bb3c7af6 finished handling git-annex 2018-06-05 16:23:16 +02:00
e06f2120ea start using Runner monad 2018-06-05 09:36:48 +02:00
dcdf71b5e6 prepare Runner for better running stuff 2018-06-05 09:07:01 +02:00
edf0624b95 refactor running stuff 2018-06-05 08:22:51 +02:00
f1502c16e4 start handling git-annex remote 2018-06-05 07:46:42 +02:00
06970317a7 refactored cloning cntd. 2018-06-04 22:14:39 +02:00
ae389aa144 refactor cloning cntd. 2018-06-04 21:58:05 +02:00
61ca7e7839 refactor cloning git repos 2018-06-01 22:52:49 +02:00
0662522a44 update to Stack LTS 11.9 2018-05-20 16:58:48 +02:00
4e3fb94ce0 update for LTS 10.10 2018-05-19 08:05:24 +02:00
a2d13c5b61 using Gonito.net in class 2018-04-07 18:51:58 +02:00
f263913c6b clean up starred 2018-01-25 16:43:50 +01:00
d38e14c07a API for returning scores 2018-01-25 16:34:05 +01:00
3a90144858 update for changes in GEval 2018-01-25 09:13:06 +01:00
828ae71006 starred challenges 2018-01-18 09:21:21 +01:00
ce9ef289f6 add background image 2018-01-18 08:21:06 +01:00
069e3cf5e1 fixes for the new geval 2018-01-17 22:07:54 +01:00
9f947e79f9 show extra points 2018-01-02 20:37:11 +01:00
ffd746d51a show message when extra points added 2018-01-02 19:36:41 +01:00
0243665bb0 organize score per course 2018-01-02 19:34:23 +01:00
f3b6f4b050 add extra points 2018-01-02 18:55:35 +01:00
6784d8cec5 take precision 2018-01-02 17:17:54 +01:00
14c5c59aaa a user can start working on a task in a different course 2017-12-12 09:39:02 +01:00
08b357fb64 filter achievements 2017-10-20 10:00:03 +02:00
6aba6be745 course can be given 2017-10-20 09:49:37 +02:00
c1f8e2d83e achievement can be edited now 2017-10-20 09:24:36 +02:00
ab76d28b43 filtre out closed courses in achievements 2017-10-03 22:16:00 +02:00
c8500ea128 show course in Achievements 2017-10-03 07:23:52 +02:00
f54dd4ec8f achievement can be linked to a course now 2017-09-29 15:53:20 +02:00
0a745175aa add table for courses, challenge could be selected for an achievement 2017-09-29 14:50:09 +02:00
cf860889d7 info on triggering 2017-09-28 16:51:10 +02:00
e32a9e3aa5 split triggering into local and remote 2017-09-28 16:11:22 +02:00
d79e03e956 change triggering 2017-09-28 15:12:14 +02:00
bed791a5c6 trigger evaluation remotely 2017-09-28 11:29:48 +02:00
029ff775a4 take description & tags from commit log message 2017-09-27 22:44:00 +02:00
ef00b8d9d1 tags can be added during submission 2017-09-27 19:38:42 +02:00
2949ce3a8a improve HowTo 2017-09-25 12:47:01 +02:00
7a9eb28b48 setting up an account more intuitive 2017-09-23 15:30:10 +02:00
e3a3f28da0 use tooltips instead of a list 2017-09-23 15:04:40 +02:00
8be73e73a1 trying to switch off autocomplete in account settings (not fully possible) 2017-09-23 14:51:15 +02:00
2729ccd68f use HTTPS for gitlist 2017-09-23 10:33:39 +02:00
de84c23900 improve readability of password reset messages 2017-09-23 08:45:04 +02:00
40cd97ee2b switch to Stack LTS 9.5, remove Fay 2017-09-22 14:23:03 +02:00
Filip Gralinski
8f12613b54 update presentation 2017-05-30 14:20:22 +02:00
f4e1870011 fix challenge 2017-05-29 23:35:58 +02:00
0ed348fc4f update datech presentation 2017-05-29 23:24:12 +02:00
372d814983 tags can be accepted now 2017-05-28 10:06:50 +02:00
f8779ce044 show tag status 2017-05-27 22:31:53 +02:00
051ba92394 start DATeCH presentation 2017-05-27 08:59:10 +02:00
ea217896be score table usable now 2017-05-15 14:25:54 +02:00
b033d0c4b5 initial work on score 2017-05-15 13:55:56 +02:00
e2c5ae179c submissions can be sent to review now 2017-04-03 12:22:52 +02:00
d63223837e give up option for achievements 2017-04-03 11:27:08 +02:00