Filip Gralinski
|
b8e7c2172b
|
Ability to see analyses for other metrics
|
2020-08-14 08:47:37 +02:00 |
|
Filip Gralinski
|
55d06e3347
|
Update to the newest GEval
|
2020-08-08 21:52:44 +02:00 |
|
Filip Gralinski
|
b42549cede
|
Add user id in dumped data
|
2020-07-12 17:20:46 +02:00 |
|
Karol Kaczmarek
|
ac1c41f586
|
Add simple annotation option
|
2020-07-11 14:14:35 +02:00 |
|
Filip Gralinski
|
a314155903
|
Try to make some URLs clickable
|
2020-05-31 21:26:29 +02:00 |
|
Filip Gralinski
|
5c6afe3bda
|
Handle GitLab/Gogs webhooks
|
2020-05-30 23:40:03 +02:00 |
|
Filip Gralinski
|
19263fe851
|
More filtering
|
2020-05-30 22:06:21 +02:00 |
|
Filip Gralinski
|
bea0787271
|
Filter out some unwanted submissions
|
2020-05-30 21:56:52 +02:00 |
|
|
|
f6b696cffa
|
Teacher can see results of his students'
|
2020-03-28 21:18:05 +01:00 |
|
|
|
3bbbff7291
|
Simplify code
|
2020-03-28 20:59:10 +01:00 |
|
|
|
4791b5bcda
|
Check for teachers when considering visibility
|
2020-03-28 20:52:12 +01:00 |
|
|
|
f016e673ce
|
Use alt repo scheme when creating the default URL for submission
|
2020-03-28 18:21:32 +01:00 |
|
|
|
7e48e0c9fc
|
Refactor challenge submissions
|
2020-03-28 18:08:44 +01:00 |
|
|
|
f036c50370
|
Validation can be switched off
|
2020-03-26 21:01:04 +01:00 |
|
|
|
ba0d89ab7d
|
Refactor challenge creation & update - cntd.
|
2020-03-26 19:36:36 +01:00 |
|
|
|
8c7243f2d5
|
Refactor challenge creation
|
2020-03-26 18:55:01 +01:00 |
|
|
|
389a018254
|
Fix issue with multiple evaluation results
|
2020-03-04 08:36:37 +01:00 |
|
|
|
6347d6fbb8
|
Fix showing line-by-line in variants
|
2020-03-03 10:01:39 +01:00 |
|
|
|
c5048d7007
|
Fix some warnings
|
2020-02-22 19:12:07 +01:00 |
|
|
|
5398783636
|
Finish handling alternative repo schemes
|
2020-02-22 09:12:13 +01:00 |
|
|
|
7560d3ca17
|
Be possible to set alternative repo scheme
|
2020-02-21 23:16:06 +01:00 |
|
|
|
e935cb6182
|
Trigger via simple GET/POST URL
|
2020-02-21 22:56:39 +01:00 |
|
|
|
8a731aaa35
|
Update geval
|
2020-01-31 18:55:19 +01:00 |
|
|
|
d2a59e59a5
|
Add bootstrap resampling
|
2020-01-28 23:14:46 +01:00 |
|
|
|
580c141a8e
|
Fix sorting tests
|
2020-01-12 19:27:07 +01:00 |
|
|
|
e323eb6bea
|
Bring back desc for boolean values
|
2020-01-07 22:02:06 +01:00 |
|
|
|
70035e5dcf
|
Fix bug with the wrong result being shown
|
2020-01-04 22:35:25 +01:00 |
|
|
|
763de554e5
|
Merge branch 'speedup'
|
2020-01-04 22:34:34 +01:00 |
|
|
|
2fd5ee15a2
|
Format variant results as cross tables
|
2020-01-04 22:34:03 +01:00 |
|
|
|
77895c5cdc
|
Fix sorting in leaderboard
|
2020-01-04 20:53:24 +01:00 |
|
|
|
00f2c4567a
|
Preselect items for faster generation of leaderboards
|
2020-01-04 10:32:52 +01:00 |
|
|
|
13b2ab7169
|
Optimizing DB querying when a leaderboard is created
|
2020-01-04 09:30:56 +01:00 |
|
|
|
9fe07335cd
|
Add more utils for presentations
|
2019-12-16 17:07:38 +01:00 |
|
|
|
e27766b0a6
|
Improve alternative leaderboard
|
2019-12-16 16:51:52 +01:00 |
|
Filip Graliński
|
9267bf7f32
|
Alt alternative leaderboard, fix wrong evaluation
|
2019-12-16 16:39:20 +01:00 |
|
|
|
b2742f06e2
|
Handle metric priorities
|
2019-12-14 22:24:22 +01:00 |
|
|
|
fc062cbd1f
|
Showing worst lines
|
2019-12-14 18:21:47 +01:00 |
|
|
|
9554b45f8a
|
Show the file basename for a variant
|
2019-12-14 15:27:59 +01:00 |
|
|
|
c5e43fcbea
|
Implement re-evaluation
|
2019-12-14 14:10:50 +01:00 |
|
|
|
770c167753
|
Refactor towards changing evaluation records
|
2019-12-14 11:58:52 +01:00 |
|
|
|
4c9e8357c8
|
Add comments
|
2019-12-14 11:45:17 +01:00 |
|
|
|
12fd6a1c58
|
Handle switching to the right commit
(Though not robust)
|
2019-12-14 11:17:12 +01:00 |
|
|
|
120c87e44a
|
Prepare application structure for re-evaluation
|
2019-12-14 10:56:07 +01:00 |
|
|
|
80020ee404
|
Show current challenge version
|
2019-12-13 22:29:41 +01:00 |
|
|
|
f5c480205e
|
Validate challenge when add or update
|
2019-12-13 22:14:00 +01:00 |
|
|
|
5bd6e34c6b
|
Fix making public
|
2019-12-07 23:17:12 +01:00 |
|
|
|
219349e95a
|
Fix opening
|
2019-12-07 22:48:58 +01:00 |
|
|
|
3705c9c0ea
|
Use the proper server when triggering
|
2019-12-07 22:34:24 +01:00 |
|
|
|
247e55ba18
|
Add a helper function
|
2019-12-07 21:26:50 +01:00 |
|
|
|
1b3a55ae12
|
Just score API interface
|
2019-11-30 20:47:19 +01:00 |
|
|
|
c1e901afb4
|
Search and score API works for output hashes now
|
2019-11-30 19:44:42 +01:00 |
|
|
|
d94e40efc7
|
Unify API for querying for results and scores
|
2019-11-30 12:47:41 +01:00 |
|
|
|
7b4b8b101d
|
API for scores handles alternative metrics
|
2019-11-30 11:56:07 +01:00 |
|
|
|
1d2c2ca78f
|
Variant information reachable from query results
|
2019-11-30 11:25:53 +01:00 |
|
|
|
c0a06ae112
|
First version of viewing a specific variant
|
2019-11-30 11:04:52 +01:00 |
|
|
|
c72cc274d5
|
Continue work viewing variants
|
2019-11-30 08:36:21 +01:00 |
|
|
|
48119428fe
|
Refactor showing a specific submission
|
2019-11-29 22:10:48 +01:00 |
|
|
|
4ba7ae2212
|
Use correctly REPO_HOST in as the default host when submitting
|
2019-11-29 09:17:17 +01:00 |
|
|
|
9b75d75cbd
|
Change email with user identifier/login
|
2019-11-25 22:38:59 +01:00 |
|
|
|
688b7bfc60
|
Add instructions how to use Gonito when writing a paper
|
2019-11-07 14:31:10 +01:00 |
|
|
|
80b5ae6b33
|
Set challenge deadline
|
2019-09-24 22:52:25 +02:00 |
|
|
|
214ee17aaf
|
New presentation
|
2019-09-23 23:16:46 +02:00 |
|
|
|
46ddb826a9
|
Fix update challenge
|
2019-09-23 17:35:39 +02:00 |
|
|
|
5b188cf718
|
Fix version incrementation
|
2019-09-20 19:51:44 +02:00 |
|
|
|
9a53a258ff
|
Show metric names parsed from evaluation schemes
|
2019-09-11 21:30:37 +02:00 |
|
Filip Graliński
|
0f4150a4a5
|
Fix issue with unwanted messages
|
2019-09-10 08:59:30 +02:00 |
|
|
|
284d7e1acf
|
Handle version while sorting
|
2019-08-29 21:34:13 +02:00 |
|
|
|
14b78e7cdd
|
Show submission version
|
2019-08-29 10:01:36 +02:00 |
|
|
|
1255577259
|
Tests are shown without duplicates in case of challenge updates
|
2019-08-29 09:39:21 +02:00 |
|
|
|
32c77b3c74
|
Challenges can be updated
|
2019-08-29 08:56:22 +02:00 |
|
|
|
ca42fcbf84
|
Continue work on challenge updating
|
2019-08-28 08:49:43 +02:00 |
|
|
|
40a06a8bee
|
Versions are obligatory for challanges and submission
DB-SCEHEME-BREAKING CHANGE
|
2019-08-27 23:39:24 +02:00 |
|
|
|
d9b92b772a
|
Add challenge versions
|
2019-08-27 22:36:51 +02:00 |
|
Filip Graliński
|
3b6846c683
|
Update for GEval preprocessing operations
|
2019-08-12 18:19:02 +02:00 |
|
|
|
e589996530
|
Add course summaries
|
2019-06-15 12:21:41 +02:00 |
|
Filip Graliński
|
f58121b407
|
Local IDs can be longer
|
2019-03-20 16:32:52 +01:00 |
|
Filip Graliński
|
27efefeb13
|
Challenges can be archived
|
2019-03-20 16:31:08 +01:00 |
|
Filip Graliński
|
e424cc361f
|
Check indicator targets
|
2019-02-22 14:41:43 +01:00 |
|
Filip Graliński
|
84212562bc
|
Remove dead code
|
2019-02-22 12:06:44 +01:00 |
|
Filip Graliński
|
904cf8ca7e
|
Mark target lines with colors on the dashboard
|
2019-02-22 12:02:05 +01:00 |
|
Filip Graliński
|
87f37df55f
|
Format indicators
|
2019-02-22 09:53:00 +01:00 |
|
Filip Graliński
|
81167926bf
|
Fix formatting indicator target values
|
2019-02-22 09:03:43 +01:00 |
|
|
|
ba50789fbe
|
Trying to fix the issue with Slack hook
|
2019-02-16 13:45:58 +01:00 |
|
|
|
c52b613ac4
|
Handle JSON Lines files
|
2019-02-14 22:57:29 +01:00 |
|
|
|
2de5a8c4d3
|
Update for new geval
|
2019-01-24 21:22:02 +01:00 |
|
Filip Graliński
|
de7c1a262d
|
Git-annex remote can be specified when triggering an evaluation
|
2018-12-07 09:11:50 +01:00 |
|
Filip Graliński
|
21f9302d1f
|
Fix bug with the same dependency being added twice
|
2018-11-23 12:49:49 +01:00 |
|
|
|
ccae7e284f
|
Show downstream submissions
|
2018-11-17 13:49:44 +01:00 |
|
|
|
879eb4e044
|
Block terminal
|
2018-11-17 10:07:59 +01:00 |
|
|
|
62e282f136
|
Convert a boolean value to a non-maybe
|
2018-11-17 09:49:25 +01:00 |
|
Filip Graliński
|
e3d6117590
|
Add dependency tracking
|
2018-11-16 12:43:44 +01:00 |
|
|
|
ec4947254a
|
Fix slack hook
|
2018-11-14 20:59:40 +01:00 |
|
Filip Graliński
|
3447b29a82
|
Handle Slack hooks
|
2018-11-14 17:41:01 +01:00 |
|
Filip Graliński
|
484b98e699
|
Consider only non-hidden submissions
|
2018-11-13 16:15:02 +01:00 |
|
Filip Graliński
|
bc34520fdd
|
Fix bug with submission creation
|
2018-11-13 14:48:41 +01:00 |
|
Filip Gralinski
|
5e14672b2d
|
Check whether the best one
|
2018-11-12 22:01:51 +01:00 |
|
Filip Gralinski
|
0a5f05604e
|
Add external links
|
2018-11-12 20:41:46 +01:00 |
|
Filip Gralinski
|
0e8846b06c
|
Show result tables
|
2018-11-12 14:12:51 +01:00 |
|
Filip Gralinski
|
6b87181454
|
Add ranks to submission lists
|
2018-11-12 10:11:58 +01:00 |
|
Filip Gralinski
|
ff2112a745
|
Improve showing a single submission
|
2018-11-10 11:20:17 +01:00 |
|
Filip Gralinski
|
2416dacffb
|
Description is clickable
|
2018-11-03 21:37:44 +01:00 |
|
Filip Gralinski
|
37125b8326
|
Sets are used instead of strings for tags
|
2018-11-03 17:25:49 +01:00 |
|
Filip Gralinski
|
9d67e39a06
|
Take params
|
2018-11-03 12:30:39 +01:00 |
|
Filip Gralinski
|
d3e2c06b15
|
Change HashMap to Map, clean up
|
2018-11-03 10:56:58 +01:00 |
|
Filip Graliński
|
7404dd330d
|
Show all deadline lines
|
2018-10-25 09:23:05 +02:00 |
|
Filip Gralinski
|
876e98f862
|
Merge branch 'master' of ssh://gonito.net/gonito
|
2018-10-15 21:15:29 +02:00 |
|
Filip Gralinski
|
687716f6fe
|
Handle tags and description from gonito.yaml
|
2018-10-15 21:15:03 +02:00 |
|
Filip Graliński
|
32ae5d7e1a
|
Use --single-branch
|
2018-10-15 14:19:20 +02:00 |
|
Filip Graliński
|
a2ae700158
|
Add first version of indicator graphs
|
2018-09-22 19:22:00 +02:00 |
|
Filip Gralinski
|
e1b1ff53f1
|
Add indicators to the database, make it possible to edit them in the dashboard.
The dashboard itself (in terms of graphs) is not part of this commit.
|
2018-09-14 15:50:44 +02:00 |
|
Filip Gralinski
|
69dedeecbd
|
Fix some warnings in Achievements
|
2018-09-14 15:50:42 +02:00 |
|
Filip Gralinski
|
1415133bab
|
Fix order of tests
|
2018-09-08 21:24:25 +02:00 |
|
Filip Gralinski
|
055687506b
|
Add by-tag mode for the leaderboard
|
2018-09-08 21:21:21 +02:00 |
|
Filip Gralinski
|
20fc29159f
|
Show all main metrics in the leaderboard
|
2018-09-08 19:21:06 +02:00 |
|
Filip Gralinski
|
858f494047
|
Scores are sorted correctly with N/A and Infinity values correctly handled
|
2018-09-08 10:20:36 +02:00 |
|
Filip Gralinski
|
1aafff1808
|
Do not use scientific formatting of scores
|
2018-09-08 09:03:22 +02:00 |
|
|
|
2ed724bf05
|
handle tags correctly in case of re-submission
|
2018-09-01 15:27:11 +02:00 |
|
|
|
bed12dee34
|
show only numerical params on graphs
|
2018-09-01 14:23:41 +02:00 |
|
|
|
40016c36e5
|
fix function name
|
2018-09-01 14:01:17 +02:00 |
|
|
|
c23e28250a
|
numbers in graphs are shown with the right precision
|
2018-09-01 13:56:18 +02:00 |
|
|
|
6c6c63114f
|
improve creating challenges
|
2018-09-01 12:01:35 +02:00 |
|
|
|
63dac77974
|
improve submission for how-to
|
2018-09-01 11:06:42 +02:00 |
|
|
|
0758ca3239
|
fix triggering an evaluation when running in the auto-opening mode
|
2018-09-01 10:48:08 +02:00 |
|
|
|
fac5d451d6
|
use space instead of slash as separator between test-name and metric (in tables)
so that the hear could be wrapped in a more narrow column if needed
(e.g. if the number of test sets/metric is large)
|
2018-09-01 10:46:39 +02:00 |
|
|
|
d9a3d56d3d
|
improve showing query results, fix issue with triggering evaluation for the first time
|
2018-08-30 21:58:27 +02:00 |
|
|
|
b14e675c61
|
add a parameter
|
2018-07-30 07:59:38 +02:00 |
|
|
|
ff8d8d8e7a
|
param graphs are shown for the challenge main page as well
|
2018-07-28 22:10:55 +02:00 |
|
|
|
abef15c905
|
refactor param graphs
|
2018-07-28 22:02:47 +02:00 |
|
|
|
3388971ed6
|
clean up and refactor
|
2018-07-28 21:53:13 +02:00 |
|
|
|
3a4c85c501
|
clean up ShowChallenge
|
2018-07-28 21:36:45 +02:00 |
|
|
|
9d54deb68f
|
show param graphs for all non-dev tests
|
2018-07-28 21:22:52 +02:00 |
|
|
|
c60e786025
|
refactor getMainTest
|
2018-07-28 19:59:29 +02:00 |
|
|
|
e263a37eca
|
clean up and generalize code generating param charts
|
2018-07-28 19:16:07 +02:00 |
|
|
|
5105652838
|
clean up code a little bit
|
2018-07-28 17:30:00 +02:00 |
|
|
|
0a51543957
|
show graphs for params
|
2018-07-28 17:04:27 +02:00 |
|
|
|
276ca4d596
|
start working on C3
|
2018-07-26 22:01:21 +02:00 |
|
|
|
ae75c806c7
|
clean up code in Runner, fix a likely bug
|
2018-07-26 21:46:17 +02:00 |
|
|
|
70271c81f5
|
show params in graph labels
|
2018-07-24 15:36:24 +02:00 |
|
|
|
c54af512c7
|
add auto-opening mode
|
2018-07-24 15:33:35 +02:00 |
|
|
|
3c157290b9
|
graph shows challenges with variants correctly
|
2018-07-24 15:21:20 +02:00 |
|
|
|
92f16f6c5d
|
generalize toLeaderboardEntries
|
2018-07-24 15:02:37 +02:00 |
|
|
|
23c2cb0072
|
show variant information at leaderboard
|
2018-07-24 14:08:47 +02:00 |
|
|
|
623ccfb602
|
show params
|
2018-07-14 19:44:33 +02:00 |
|
|
|
2f796d47cb
|
get parameters when table is shown
|
2018-07-14 17:10:07 +02:00 |
|
|
|
ca9bcbac55
|
refactor tables
|
2018-07-14 17:02:30 +02:00 |
|
|
|
f3960c371d
|
multiple outs can be accepted now
|
2018-07-14 15:27:49 +02:00 |
|
|
|
bb77049918
|
clean up some warnings
|
2018-07-14 07:42:28 +02:00 |
|
|
|
4dbf64ecfc
|
clean up variants
|
2018-07-14 07:38:55 +02:00 |
|
|
|
9b445d6e9c
|
variants are used within within outs - transition completed
|
2018-07-06 16:54:17 +02:00 |
|
|
|
b572bf45d0
|
clean up some warnings
|
2018-07-05 22:17:25 +02:00 |
|
