Commit Graph

360 Commits

Author SHA1 Message Date
Filip Gralinski
08c9a534c7 Add helper anchors when the output is viewed 2020-08-14 18:33:38 +02:00
Filip Gralinski
b8e7c2172b Ability to see analyses for other metrics 2020-08-14 08:47:37 +02:00
Filip Gralinski
55d06e3347 Update to the newest GEval 2020-08-08 21:52:44 +02:00
Filip Gralinski
b42549cede Add user id in dumped data 2020-07-12 17:20:46 +02:00
Karol Kaczmarek
ac1c41f586 Add simple annotation option 2020-07-11 14:14:35 +02:00
Filip Gralinski
a314155903 Try to make some URLs clickable 2020-05-31 21:26:29 +02:00
Filip Gralinski
5c6afe3bda Handle GitLab/Gogs webhooks 2020-05-30 23:40:03 +02:00
Filip Gralinski
19263fe851 More filtering 2020-05-30 22:06:21 +02:00
Filip Gralinski
bea0787271 Filter out some unwanted submissions 2020-05-30 21:56:52 +02:00
f6b696cffa Teacher can see results of his students' 2020-03-28 21:18:05 +01:00
3bbbff7291 Simplify code 2020-03-28 20:59:10 +01:00
4791b5bcda Check for teachers when considering visibility 2020-03-28 20:52:12 +01:00
f016e673ce Use alt repo scheme when creating the default URL for submission 2020-03-28 18:21:32 +01:00
7e48e0c9fc Refactor challenge submissions 2020-03-28 18:08:44 +01:00
f036c50370 Validation can be switched off 2020-03-26 21:01:04 +01:00
ba0d89ab7d Refactor challenge creation & update - cntd. 2020-03-26 19:36:36 +01:00
8c7243f2d5 Refactor challenge creation 2020-03-26 18:55:01 +01:00
389a018254 Fix issue with multiple evaluation results 2020-03-04 08:36:37 +01:00
6347d6fbb8 Fix showing line-by-line in variants 2020-03-03 10:01:39 +01:00
c5048d7007 Fix some warnings 2020-02-22 19:12:07 +01:00
5398783636 Finish handling alternative repo schemes 2020-02-22 09:12:13 +01:00
7560d3ca17 Be possible to set alternative repo scheme 2020-02-21 23:16:06 +01:00
e935cb6182 Trigger via simple GET/POST URL 2020-02-21 22:56:39 +01:00
8a731aaa35 Update geval 2020-01-31 18:55:19 +01:00
d2a59e59a5 Add bootstrap resampling 2020-01-28 23:14:46 +01:00
580c141a8e Fix sorting tests 2020-01-12 19:27:07 +01:00
e323eb6bea Bring back desc for boolean values 2020-01-07 22:02:06 +01:00
70035e5dcf Fix bug with the wrong result being shown 2020-01-04 22:35:25 +01:00
763de554e5 Merge branch 'speedup' 2020-01-04 22:34:34 +01:00
2fd5ee15a2 Format variant results as cross tables 2020-01-04 22:34:03 +01:00
77895c5cdc Fix sorting in leaderboard 2020-01-04 20:53:24 +01:00
00f2c4567a Preselect items for faster generation of leaderboards 2020-01-04 10:32:52 +01:00
13b2ab7169 Optimizing DB querying when a leaderboard is created 2020-01-04 09:30:56 +01:00
9fe07335cd Add more utils for presentations 2019-12-16 17:07:38 +01:00
e27766b0a6 Improve alternative leaderboard 2019-12-16 16:51:52 +01:00
Filip Graliński
9267bf7f32 Alt alternative leaderboard, fix wrong evaluation 2019-12-16 16:39:20 +01:00
b2742f06e2 Handle metric priorities 2019-12-14 22:24:22 +01:00
fc062cbd1f Showing worst lines 2019-12-14 18:21:47 +01:00
9554b45f8a Show the file basename for a variant 2019-12-14 15:27:59 +01:00
c5e43fcbea Implement re-evaluation 2019-12-14 14:10:50 +01:00
770c167753 Refactor towards changing evaluation records 2019-12-14 11:58:52 +01:00
4c9e8357c8 Add comments 2019-12-14 11:45:17 +01:00
12fd6a1c58 Handle switching to the right commit
(Though not robust)
2019-12-14 11:17:12 +01:00
120c87e44a Prepare application structure for re-evaluation 2019-12-14 10:56:07 +01:00
80020ee404 Show current challenge version 2019-12-13 22:29:41 +01:00
f5c480205e Validate challenge when add or update 2019-12-13 22:14:00 +01:00
5bd6e34c6b Fix making public 2019-12-07 23:17:12 +01:00
219349e95a Fix opening 2019-12-07 22:48:58 +01:00
3705c9c0ea Use the proper server when triggering 2019-12-07 22:34:24 +01:00
247e55ba18 Add a helper function 2019-12-07 21:26:50 +01:00
1b3a55ae12 Just score API interface 2019-11-30 20:47:19 +01:00
c1e901afb4 Search and score API works for output hashes now 2019-11-30 19:44:42 +01:00
d94e40efc7 Unify API for querying for results and scores 2019-11-30 12:47:41 +01:00
7b4b8b101d API for scores handles alternative metrics 2019-11-30 11:56:07 +01:00
1d2c2ca78f Variant information reachable from query results 2019-11-30 11:25:53 +01:00
c0a06ae112 First version of viewing a specific variant 2019-11-30 11:04:52 +01:00
c72cc274d5 Continue work viewing variants 2019-11-30 08:36:21 +01:00
48119428fe Refactor showing a specific submission 2019-11-29 22:10:48 +01:00
4ba7ae2212 Use correctly REPO_HOST in as the default host when submitting 2019-11-29 09:17:17 +01:00
9b75d75cbd Change email with user identifier/login 2019-11-25 22:38:59 +01:00
688b7bfc60 Add instructions how to use Gonito when writing a paper 2019-11-07 14:31:10 +01:00
80b5ae6b33 Set challenge deadline 2019-09-24 22:52:25 +02:00
214ee17aaf New presentation 2019-09-23 23:16:46 +02:00
46ddb826a9 Fix update challenge 2019-09-23 17:35:39 +02:00
5b188cf718 Fix version incrementation 2019-09-20 19:51:44 +02:00
9a53a258ff Show metric names parsed from evaluation schemes 2019-09-11 21:30:37 +02:00
Filip Graliński
0f4150a4a5 Fix issue with unwanted messages 2019-09-10 08:59:30 +02:00
284d7e1acf Handle version while sorting 2019-08-29 21:34:13 +02:00
14b78e7cdd Show submission version 2019-08-29 10:01:36 +02:00
1255577259 Tests are shown without duplicates in case of challenge updates 2019-08-29 09:39:21 +02:00
32c77b3c74 Challenges can be updated 2019-08-29 08:56:22 +02:00
ca42fcbf84 Continue work on challenge updating 2019-08-28 08:49:43 +02:00
40a06a8bee Versions are obligatory for challanges and submission
DB-SCEHEME-BREAKING CHANGE
2019-08-27 23:39:24 +02:00
d9b92b772a Add challenge versions 2019-08-27 22:36:51 +02:00
Filip Graliński
3b6846c683 Update for GEval preprocessing operations 2019-08-12 18:19:02 +02:00
e589996530 Add course summaries 2019-06-15 12:21:41 +02:00
Filip Graliński
f58121b407 Local IDs can be longer 2019-03-20 16:32:52 +01:00
Filip Graliński
27efefeb13 Challenges can be archived 2019-03-20 16:31:08 +01:00
Filip Graliński
e424cc361f Check indicator targets 2019-02-22 14:41:43 +01:00
Filip Graliński
84212562bc Remove dead code 2019-02-22 12:06:44 +01:00
Filip Graliński
904cf8ca7e Mark target lines with colors on the dashboard 2019-02-22 12:02:05 +01:00
Filip Graliński
87f37df55f Format indicators 2019-02-22 09:53:00 +01:00
Filip Graliński
81167926bf Fix formatting indicator target values 2019-02-22 09:03:43 +01:00
ba50789fbe Trying to fix the issue with Slack hook 2019-02-16 13:45:58 +01:00
c52b613ac4 Handle JSON Lines files 2019-02-14 22:57:29 +01:00
2de5a8c4d3 Update for new geval 2019-01-24 21:22:02 +01:00
Filip Graliński
de7c1a262d Git-annex remote can be specified when triggering an evaluation 2018-12-07 09:11:50 +01:00
Filip Graliński
21f9302d1f Fix bug with the same dependency being added twice 2018-11-23 12:49:49 +01:00
ccae7e284f Show downstream submissions 2018-11-17 13:49:44 +01:00
879eb4e044 Block terminal 2018-11-17 10:07:59 +01:00
62e282f136 Convert a boolean value to a non-maybe 2018-11-17 09:49:25 +01:00
Filip Graliński
e3d6117590 Add dependency tracking 2018-11-16 12:43:44 +01:00
ec4947254a Fix slack hook 2018-11-14 20:59:40 +01:00
Filip Graliński
3447b29a82 Handle Slack hooks 2018-11-14 17:41:01 +01:00
Filip Graliński
484b98e699 Consider only non-hidden submissions 2018-11-13 16:15:02 +01:00
Filip Graliński
bc34520fdd Fix bug with submission creation 2018-11-13 14:48:41 +01:00
Filip Gralinski
5e14672b2d Check whether the best one 2018-11-12 22:01:51 +01:00
Filip Gralinski
0a5f05604e Add external links 2018-11-12 20:41:46 +01:00
Filip Gralinski
0e8846b06c Show result tables 2018-11-12 14:12:51 +01:00
Filip Gralinski
6b87181454 Add ranks to submission lists 2018-11-12 10:11:58 +01:00