Commit Graph

183 Commits

Author SHA1 Message Date
9155f52315 Add to challenge submission to API 2021-01-17 20:37:25 +01:00
09f05a1498 Add api/challenge-{my,all}-submissions 2020-12-31 08:46:35 +01:00
476b45bef4 Add user via a JWS token 2020-12-10 23:24:10 +01:00
2009ad4504 Extract ident info from JWT tokens 2020-12-10 21:36:17 +01:00
ceef7ae5ac Handle JWT tokens 2020-12-09 21:55:31 +01:00
acedcef793 Add leaderboard JSON 2020-10-15 22:27:16 +02:00
0337f8dafd Try to limit number of tests shown for a submission 2020-09-05 16:14:20 +02:00
06d31dfb69 Force evaluation when re-evaluating 2020-09-05 15:07:23 +02:00
dce08f5ce6 Repository is cloned if not found on a local disk 2020-09-05 14:22:12 +02:00
Filip Gralinski
5c6afe3bda Handle GitLab/Gogs webhooks 2020-05-30 23:40:03 +02:00
Filip Gralinski
19263fe851 More filtering 2020-05-30 22:06:21 +02:00
Filip Gralinski
bea0787271 Filter out some unwanted submissions 2020-05-30 21:56:52 +02:00
f016e673ce Use alt repo scheme when creating the default URL for submission 2020-03-28 18:21:32 +01:00
7e48e0c9fc Refactor challenge submissions 2020-03-28 18:08:44 +01:00
c5048d7007 Fix some warnings 2020-02-22 19:12:07 +01:00
5398783636 Finish handling alternative repo schemes 2020-02-22 09:12:13 +01:00
e935cb6182 Trigger via simple GET/POST URL 2020-02-21 22:56:39 +01:00
00f2c4567a Preselect items for faster generation of leaderboards 2020-01-04 10:32:52 +01:00
Filip Graliński
9267bf7f32 Alt alternative leaderboard, fix wrong evaluation 2019-12-16 16:39:20 +01:00
b2742f06e2 Handle metric priorities 2019-12-14 22:24:22 +01:00
c5e43fcbea Implement re-evaluation 2019-12-14 14:10:50 +01:00
770c167753 Refactor towards changing evaluation records 2019-12-14 11:58:52 +01:00
4c9e8357c8 Add comments 2019-12-14 11:45:17 +01:00
80020ee404 Show current challenge version 2019-12-13 22:29:41 +01:00
3705c9c0ea Use the proper server when triggering 2019-12-07 22:34:24 +01:00
c0a06ae112 First version of viewing a specific variant 2019-11-30 11:04:52 +01:00
4ba7ae2212 Use correctly REPO_HOST in as the default host when submitting 2019-11-29 09:17:17 +01:00
80b5ae6b33 Set challenge deadline 2019-09-24 22:52:25 +02:00
Filip Graliński
0f4150a4a5 Fix issue with unwanted messages 2019-09-10 08:59:30 +02:00
284d7e1acf Handle version while sorting 2019-08-29 21:34:13 +02:00
32c77b3c74 Challenges can be updated 2019-08-29 08:56:22 +02:00
d9b92b772a Add challenge versions 2019-08-27 22:36:51 +02:00
Filip Graliński
3b6846c683 Update for GEval preprocessing operations 2019-08-12 18:19:02 +02:00
Filip Graliński
27efefeb13 Challenges can be archived 2019-03-20 16:31:08 +01:00
Filip Graliński
e424cc361f Check indicator targets 2019-02-22 14:41:43 +01:00
ba50789fbe Trying to fix the issue with Slack hook 2019-02-16 13:45:58 +01:00
c52b613ac4 Handle JSON Lines files 2019-02-14 22:57:29 +01:00
2de5a8c4d3 Update for new geval 2019-01-24 21:22:02 +01:00
Filip Graliński
de7c1a262d Git-annex remote can be specified when triggering an evaluation 2018-12-07 09:11:50 +01:00
Filip Graliński
21f9302d1f Fix bug with the same dependency being added twice 2018-11-23 12:49:49 +01:00
62e282f136 Convert a boolean value to a non-maybe 2018-11-17 09:49:25 +01:00
Filip Graliński
e3d6117590 Add dependency tracking 2018-11-16 12:43:44 +01:00
ec4947254a Fix slack hook 2018-11-14 20:59:40 +01:00
Filip Graliński
3447b29a82 Handle Slack hooks 2018-11-14 17:41:01 +01:00
Filip Graliński
484b98e699 Consider only non-hidden submissions 2018-11-13 16:15:02 +01:00
Filip Graliński
bc34520fdd Fix bug with submission creation 2018-11-13 14:48:41 +01:00
Filip Gralinski
5e14672b2d Check whether the best one 2018-11-12 22:01:51 +01:00
Filip Gralinski
0a5f05604e Add external links 2018-11-12 20:41:46 +01:00
Filip Gralinski
0e8846b06c Show result tables 2018-11-12 14:12:51 +01:00
Filip Gralinski
6b87181454 Add ranks to submission lists 2018-11-12 10:11:58 +01:00
Filip Gralinski
37125b8326 Sets are used instead of strings for tags 2018-11-03 17:25:49 +01:00
Filip Gralinski
9d67e39a06 Take params 2018-11-03 12:30:39 +01:00
Filip Gralinski
d3e2c06b15 Change HashMap to Map, clean up 2018-11-03 10:56:58 +01:00
Filip Gralinski
687716f6fe Handle tags and description from gonito.yaml 2018-10-15 21:15:03 +02:00
Filip Gralinski
1415133bab Fix order of tests 2018-09-08 21:24:25 +02:00
Filip Gralinski
055687506b Add by-tag mode for the leaderboard 2018-09-08 21:21:21 +02:00
Filip Gralinski
20fc29159f Show all main metrics in the leaderboard 2018-09-08 19:21:06 +02:00
Filip Gralinski
858f494047 Scores are sorted correctly with N/A and Infinity values correctly handled 2018-09-08 10:20:36 +02:00
Filip Gralinski
1aafff1808 Do not use scientific formatting of scores 2018-09-08 09:03:22 +02:00
2ed724bf05 handle tags correctly in case of re-submission 2018-09-01 15:27:11 +02:00
bed12dee34 show only numerical params on graphs 2018-09-01 14:23:41 +02:00
40016c36e5 fix function name 2018-09-01 14:01:17 +02:00
63dac77974 improve submission for how-to 2018-09-01 11:06:42 +02:00
0758ca3239 fix triggering an evaluation when running in the auto-opening mode 2018-09-01 10:48:08 +02:00
d9a3d56d3d improve showing query results, fix issue with triggering evaluation for the first time 2018-08-30 21:58:27 +02:00
ff8d8d8e7a param graphs are shown for the challenge main page as well 2018-07-28 22:10:55 +02:00
abef15c905 refactor param graphs 2018-07-28 22:02:47 +02:00
3388971ed6 clean up and refactor 2018-07-28 21:53:13 +02:00
3a4c85c501 clean up ShowChallenge 2018-07-28 21:36:45 +02:00
9d54deb68f show param graphs for all non-dev tests 2018-07-28 21:22:52 +02:00
e263a37eca clean up and generalize code generating param charts 2018-07-28 19:16:07 +02:00
5105652838 clean up code a little bit 2018-07-28 17:30:00 +02:00
0a51543957 show graphs for params 2018-07-28 17:04:27 +02:00
c54af512c7 add auto-opening mode 2018-07-24 15:33:35 +02:00
ca9bcbac55 refactor tables 2018-07-14 17:02:30 +02:00
f3960c371d multiple outs can be accepted now 2018-07-14 15:27:49 +02:00
bb77049918 clean up some warnings 2018-07-14 07:42:28 +02:00
4dbf64ecfc clean up variants 2018-07-14 07:38:55 +02:00
9b445d6e9c variants are used within within outs - transition completed 2018-07-06 16:54:17 +02:00
b572bf45d0 clean up some warnings 2018-07-05 22:17:25 +02:00
eedf1cd6fa variant is now required for an out 2018-07-05 22:15:21 +02:00
a7bd6a933e dummy variants for "out" files are added now 2018-07-04 17:01:45 +02:00
52ae6ae9a5 start transition to multiple variants per submission 2018-07-04 16:22:10 +02:00
306d9d0af6 update for GEval 1.1.0.0 2018-06-29 08:05:33 +02:00
7b7001845d a submission can be removed now (actually hidden) 2018-06-27 13:09:11 +02:00
252da6316a fix problem with git-annex remote when updating a repo, get rid of some warnings 2018-06-14 20:35:48 +02:00
f7a85e80a0 fix handling compressed expected files 2018-06-09 15:35:31 +02:00
d7c656217f fix mutiple metrics 2018-06-08 22:15:49 +02:00
32f0d1eb12 fix handle compressed out-files 2018-06-08 21:59:06 +02:00
1ea5e4ecbd handle multiple metrics for the same test 2018-06-08 15:00:40 +02:00
a9de751d87 showing submissions correctly in "branches" mode 2018-06-06 13:43:17 +02:00
85c9ad6646 improve how-to for self-hosted instances and git-annex 2018-06-06 10:30:53 +02:00
28222d5a37 repo host can be set 2018-06-05 23:04:58 +02:00
35bb3c7af6 finished handling git-annex 2018-06-05 16:23:16 +02:00
edf0624b95 refactor running stuff 2018-06-05 08:22:51 +02:00
06970317a7 refactored cloning cntd. 2018-06-04 22:14:39 +02:00
ae389aa144 refactor cloning cntd. 2018-06-04 21:58:05 +02:00
61ca7e7839 refactor cloning git repos 2018-06-01 22:52:49 +02:00
069e3cf5e1 fixes for the new geval 2018-01-17 22:07:54 +01:00
cf860889d7 info on triggering 2017-09-28 16:51:10 +02:00