Commit Graph

418 Commits

Author SHA1 Message Date
e158459bf8 Handle showing as percentage 2020-09-05 16:45:09 +02:00
0337f8dafd Try to limit number of tests shown for a submission 2020-09-05 16:14:20 +02:00
c0ef2319ca When viewing variants, metrics up to priority 4 are shown 2020-09-05 15:28:52 +02:00
48506a69fd Fix bug with the button for re-evalation
It appeared in cases when it should not appear.
2020-09-05 15:18:29 +02:00
06d31dfb69 Force evaluation when re-evaluating 2020-09-05 15:07:23 +02:00
dce08f5ce6 Repository is cloned if not found on a local disk 2020-09-05 14:22:12 +02:00
7311a2a012 Minor refactor in cloning code 2020-09-05 11:52:33 +02:00
Filip Gralinski
c028e4b6cc Fix anchoring when viewing output 2020-08-14 21:07:19 +02:00
Filip Gralinski
08c9a534c7 Add helper anchors when the output is viewed 2020-08-14 18:33:38 +02:00
Filip Gralinski
b8e7c2172b Ability to see analyses for other metrics 2020-08-14 08:47:37 +02:00
Filip Gralinski
55d06e3347 Update to the newest GEval 2020-08-08 21:52:44 +02:00
Filip Gralinski
b42549cede Add user id in dumped data 2020-07-12 17:20:46 +02:00
Karol Kaczmarek
ac1c41f586 Add simple annotation option 2020-07-11 14:14:35 +02:00
Filip Gralinski
a314155903 Try to make some URLs clickable 2020-05-31 21:26:29 +02:00
Filip Gralinski
5c6afe3bda Handle GitLab/Gogs webhooks 2020-05-30 23:40:03 +02:00
Filip Gralinski
19263fe851 More filtering 2020-05-30 22:06:21 +02:00
Filip Gralinski
bea0787271 Filter out some unwanted submissions 2020-05-30 21:56:52 +02:00
f6b696cffa Teacher can see results of his students' 2020-03-28 21:18:05 +01:00
3bbbff7291 Simplify code 2020-03-28 20:59:10 +01:00
4791b5bcda Check for teachers when considering visibility 2020-03-28 20:52:12 +01:00
f016e673ce Use alt repo scheme when creating the default URL for submission 2020-03-28 18:21:32 +01:00
7e48e0c9fc Refactor challenge submissions 2020-03-28 18:08:44 +01:00
f036c50370 Validation can be switched off 2020-03-26 21:01:04 +01:00
ba0d89ab7d Refactor challenge creation & update - cntd. 2020-03-26 19:36:36 +01:00
8c7243f2d5 Refactor challenge creation 2020-03-26 18:55:01 +01:00
389a018254 Fix issue with multiple evaluation results 2020-03-04 08:36:37 +01:00
6347d6fbb8 Fix showing line-by-line in variants 2020-03-03 10:01:39 +01:00
c5048d7007 Fix some warnings 2020-02-22 19:12:07 +01:00
5398783636 Finish handling alternative repo schemes 2020-02-22 09:12:13 +01:00
7560d3ca17 Be possible to set alternative repo scheme 2020-02-21 23:16:06 +01:00
e935cb6182 Trigger via simple GET/POST URL 2020-02-21 22:56:39 +01:00
8a731aaa35 Update geval 2020-01-31 18:55:19 +01:00
d2a59e59a5 Add bootstrap resampling 2020-01-28 23:14:46 +01:00
580c141a8e Fix sorting tests 2020-01-12 19:27:07 +01:00
e323eb6bea Bring back desc for boolean values 2020-01-07 22:02:06 +01:00
70035e5dcf Fix bug with the wrong result being shown 2020-01-04 22:35:25 +01:00
763de554e5 Merge branch 'speedup' 2020-01-04 22:34:34 +01:00
2fd5ee15a2 Format variant results as cross tables 2020-01-04 22:34:03 +01:00
77895c5cdc Fix sorting in leaderboard 2020-01-04 20:53:24 +01:00
00f2c4567a Preselect items for faster generation of leaderboards 2020-01-04 10:32:52 +01:00
13b2ab7169 Optimizing DB querying when a leaderboard is created 2020-01-04 09:30:56 +01:00
9fe07335cd Add more utils for presentations 2019-12-16 17:07:38 +01:00
e27766b0a6 Improve alternative leaderboard 2019-12-16 16:51:52 +01:00
Filip Graliński
9267bf7f32 Alt alternative leaderboard, fix wrong evaluation 2019-12-16 16:39:20 +01:00
b2742f06e2 Handle metric priorities 2019-12-14 22:24:22 +01:00
fc062cbd1f Showing worst lines 2019-12-14 18:21:47 +01:00
9554b45f8a Show the file basename for a variant 2019-12-14 15:27:59 +01:00
c5e43fcbea Implement re-evaluation 2019-12-14 14:10:50 +01:00
770c167753 Refactor towards changing evaluation records 2019-12-14 11:58:52 +01:00
4c9e8357c8 Add comments 2019-12-14 11:45:17 +01:00
12fd6a1c58 Handle switching to the right commit
(Though not robust)
2019-12-14 11:17:12 +01:00
120c87e44a Prepare application structure for re-evaluation 2019-12-14 10:56:07 +01:00
80020ee404 Show current challenge version 2019-12-13 22:29:41 +01:00
f5c480205e Validate challenge when add or update 2019-12-13 22:14:00 +01:00
5bd6e34c6b Fix making public 2019-12-07 23:17:12 +01:00
219349e95a Fix opening 2019-12-07 22:48:58 +01:00
3705c9c0ea Use the proper server when triggering 2019-12-07 22:34:24 +01:00
247e55ba18 Add a helper function 2019-12-07 21:26:50 +01:00
1b3a55ae12 Just score API interface 2019-11-30 20:47:19 +01:00
c1e901afb4 Search and score API works for output hashes now 2019-11-30 19:44:42 +01:00
d94e40efc7 Unify API for querying for results and scores 2019-11-30 12:47:41 +01:00
7b4b8b101d API for scores handles alternative metrics 2019-11-30 11:56:07 +01:00
1d2c2ca78f Variant information reachable from query results 2019-11-30 11:25:53 +01:00
c0a06ae112 First version of viewing a specific variant 2019-11-30 11:04:52 +01:00
c72cc274d5 Continue work viewing variants 2019-11-30 08:36:21 +01:00
48119428fe Refactor showing a specific submission 2019-11-29 22:10:48 +01:00
4ba7ae2212 Use correctly REPO_HOST in as the default host when submitting 2019-11-29 09:17:17 +01:00
9b75d75cbd Change email with user identifier/login 2019-11-25 22:38:59 +01:00
688b7bfc60 Add instructions how to use Gonito when writing a paper 2019-11-07 14:31:10 +01:00
80b5ae6b33 Set challenge deadline 2019-09-24 22:52:25 +02:00
214ee17aaf New presentation 2019-09-23 23:16:46 +02:00
46ddb826a9 Fix update challenge 2019-09-23 17:35:39 +02:00
5b188cf718 Fix version incrementation 2019-09-20 19:51:44 +02:00
9a53a258ff Show metric names parsed from evaluation schemes 2019-09-11 21:30:37 +02:00
Filip Graliński
0f4150a4a5 Fix issue with unwanted messages 2019-09-10 08:59:30 +02:00
284d7e1acf Handle version while sorting 2019-08-29 21:34:13 +02:00
14b78e7cdd Show submission version 2019-08-29 10:01:36 +02:00
1255577259 Tests are shown without duplicates in case of challenge updates 2019-08-29 09:39:21 +02:00
32c77b3c74 Challenges can be updated 2019-08-29 08:56:22 +02:00
ca42fcbf84 Continue work on challenge updating 2019-08-28 08:49:43 +02:00
40a06a8bee Versions are obligatory for challanges and submission
DB-SCEHEME-BREAKING CHANGE
2019-08-27 23:39:24 +02:00
d9b92b772a Add challenge versions 2019-08-27 22:36:51 +02:00
Filip Graliński
3b6846c683 Update for GEval preprocessing operations 2019-08-12 18:19:02 +02:00
e589996530 Add course summaries 2019-06-15 12:21:41 +02:00
Filip Graliński
f58121b407 Local IDs can be longer 2019-03-20 16:32:52 +01:00
Filip Graliński
27efefeb13 Challenges can be archived 2019-03-20 16:31:08 +01:00
Filip Graliński
e424cc361f Check indicator targets 2019-02-22 14:41:43 +01:00
Filip Graliński
84212562bc Remove dead code 2019-02-22 12:06:44 +01:00
Filip Graliński
904cf8ca7e Mark target lines with colors on the dashboard 2019-02-22 12:02:05 +01:00
Filip Graliński
87f37df55f Format indicators 2019-02-22 09:53:00 +01:00
Filip Graliński
81167926bf Fix formatting indicator target values 2019-02-22 09:03:43 +01:00
ba50789fbe Trying to fix the issue with Slack hook 2019-02-16 13:45:58 +01:00
c52b613ac4 Handle JSON Lines files 2019-02-14 22:57:29 +01:00
2de5a8c4d3 Update for new geval 2019-01-24 21:22:02 +01:00
Filip Graliński
de7c1a262d Git-annex remote can be specified when triggering an evaluation 2018-12-07 09:11:50 +01:00
Filip Graliński
21f9302d1f Fix bug with the same dependency being added twice 2018-11-23 12:49:49 +01:00
ccae7e284f Show downstream submissions 2018-11-17 13:49:44 +01:00
879eb4e044 Block terminal 2018-11-17 10:07:59 +01:00
62e282f136 Convert a boolean value to a non-maybe 2018-11-17 09:49:25 +01:00
Filip Graliński
e3d6117590 Add dependency tracking 2018-11-16 12:43:44 +01:00
ec4947254a Fix slack hook 2018-11-14 20:59:40 +01:00
Filip Graliński
3447b29a82 Handle Slack hooks 2018-11-14 17:41:01 +01:00
Filip Graliński
484b98e699 Consider only non-hidden submissions 2018-11-13 16:15:02 +01:00
Filip Graliński
bc34520fdd Fix bug with submission creation 2018-11-13 14:48:41 +01:00
Filip Gralinski
5e14672b2d Check whether the best one 2018-11-12 22:01:51 +01:00
Filip Gralinski
0a5f05604e Add external links 2018-11-12 20:41:46 +01:00
Filip Gralinski
0e8846b06c Show result tables 2018-11-12 14:12:51 +01:00
Filip Gralinski
6b87181454 Add ranks to submission lists 2018-11-12 10:11:58 +01:00
Filip Gralinski
ff2112a745 Improve showing a single submission 2018-11-10 11:20:17 +01:00
Filip Gralinski
2416dacffb Description is clickable 2018-11-03 21:37:44 +01:00
Filip Gralinski
37125b8326 Sets are used instead of strings for tags 2018-11-03 17:25:49 +01:00
Filip Gralinski
9d67e39a06 Take params 2018-11-03 12:30:39 +01:00
Filip Gralinski
d3e2c06b15 Change HashMap to Map, clean up 2018-11-03 10:56:58 +01:00
Filip Graliński
7404dd330d Show all deadline lines 2018-10-25 09:23:05 +02:00
Filip Gralinski
876e98f862 Merge branch 'master' of ssh://gonito.net/gonito 2018-10-15 21:15:29 +02:00
Filip Gralinski
687716f6fe Handle tags and description from gonito.yaml 2018-10-15 21:15:03 +02:00
Filip Graliński
32ae5d7e1a Use --single-branch 2018-10-15 14:19:20 +02:00
Filip Graliński
a2ae700158 Add first version of indicator graphs 2018-09-22 19:22:00 +02:00
Filip Gralinski
e1b1ff53f1 Add indicators to the database, make it possible to edit them in the dashboard.
The dashboard itself (in terms of graphs) is not part of this commit.
2018-09-14 15:50:44 +02:00
Filip Gralinski
69dedeecbd Fix some warnings in Achievements 2018-09-14 15:50:42 +02:00
Filip Gralinski
1415133bab Fix order of tests 2018-09-08 21:24:25 +02:00
Filip Gralinski
055687506b Add by-tag mode for the leaderboard 2018-09-08 21:21:21 +02:00
Filip Gralinski
20fc29159f Show all main metrics in the leaderboard 2018-09-08 19:21:06 +02:00
Filip Gralinski
858f494047 Scores are sorted correctly with N/A and Infinity values correctly handled 2018-09-08 10:20:36 +02:00
Filip Gralinski
1aafff1808 Do not use scientific formatting of scores 2018-09-08 09:03:22 +02:00
2ed724bf05 handle tags correctly in case of re-submission 2018-09-01 15:27:11 +02:00
bed12dee34 show only numerical params on graphs 2018-09-01 14:23:41 +02:00
40016c36e5 fix function name 2018-09-01 14:01:17 +02:00
c23e28250a numbers in graphs are shown with the right precision 2018-09-01 13:56:18 +02:00
6c6c63114f improve creating challenges 2018-09-01 12:01:35 +02:00
63dac77974 improve submission for how-to 2018-09-01 11:06:42 +02:00
0758ca3239 fix triggering an evaluation when running in the auto-opening mode 2018-09-01 10:48:08 +02:00
fac5d451d6 use space instead of slash as separator between test-name and metric (in tables)
so that the hear could be wrapped in a more narrow column if needed
(e.g. if the number of test sets/metric is large)
2018-09-01 10:46:39 +02:00
d9a3d56d3d improve showing query results, fix issue with triggering evaluation for the first time 2018-08-30 21:58:27 +02:00
b14e675c61 add a parameter 2018-07-30 07:59:38 +02:00
ff8d8d8e7a param graphs are shown for the challenge main page as well 2018-07-28 22:10:55 +02:00
abef15c905 refactor param graphs 2018-07-28 22:02:47 +02:00
3388971ed6 clean up and refactor 2018-07-28 21:53:13 +02:00
3a4c85c501 clean up ShowChallenge 2018-07-28 21:36:45 +02:00
9d54deb68f show param graphs for all non-dev tests 2018-07-28 21:22:52 +02:00
c60e786025 refactor getMainTest 2018-07-28 19:59:29 +02:00
e263a37eca clean up and generalize code generating param charts 2018-07-28 19:16:07 +02:00
5105652838 clean up code a little bit 2018-07-28 17:30:00 +02:00
0a51543957 show graphs for params 2018-07-28 17:04:27 +02:00
276ca4d596 start working on C3 2018-07-26 22:01:21 +02:00
ae75c806c7 clean up code in Runner, fix a likely bug 2018-07-26 21:46:17 +02:00
70271c81f5 show params in graph labels 2018-07-24 15:36:24 +02:00
c54af512c7 add auto-opening mode 2018-07-24 15:33:35 +02:00
3c157290b9 graph shows challenges with variants correctly 2018-07-24 15:21:20 +02:00
92f16f6c5d generalize toLeaderboardEntries 2018-07-24 15:02:37 +02:00