|
|
77895c5cdc
|
Fix sorting in leaderboard
|
2020-01-04 20:53:24 +01:00 |
|
|
|
00f2c4567a
|
Preselect items for faster generation of leaderboards
|
2020-01-04 10:32:52 +01:00 |
|
|
|
13b2ab7169
|
Optimizing DB querying when a leaderboard is created
|
2020-01-04 09:30:56 +01:00 |
|
|
|
9fe07335cd
|
Add more utils for presentations
|
2019-12-16 17:07:38 +01:00 |
|
|
|
e27766b0a6
|
Improve alternative leaderboard
|
2019-12-16 16:51:52 +01:00 |
|
Filip Graliński
|
9267bf7f32
|
Alt alternative leaderboard, fix wrong evaluation
|
2019-12-16 16:39:20 +01:00 |
|
|
|
b2742f06e2
|
Handle metric priorities
|
2019-12-14 22:24:22 +01:00 |
|
|
|
fc062cbd1f
|
Showing worst lines
|
2019-12-14 18:21:47 +01:00 |
|
|
|
9554b45f8a
|
Show the file basename for a variant
|
2019-12-14 15:27:59 +01:00 |
|
|
|
c5e43fcbea
|
Implement re-evaluation
|
2019-12-14 14:10:50 +01:00 |
|
|
|
770c167753
|
Refactor towards changing evaluation records
|
2019-12-14 11:58:52 +01:00 |
|
|
|
4c9e8357c8
|
Add comments
|
2019-12-14 11:45:17 +01:00 |
|
|
|
12fd6a1c58
|
Handle switching to the right commit
(Though not robust)
|
2019-12-14 11:17:12 +01:00 |
|
|
|
120c87e44a
|
Prepare application structure for re-evaluation
|
2019-12-14 10:56:07 +01:00 |
|
|
|
80020ee404
|
Show current challenge version
|
2019-12-13 22:29:41 +01:00 |
|
|
|
f5c480205e
|
Validate challenge when add or update
|
2019-12-13 22:14:00 +01:00 |
|
|
|
5bd6e34c6b
|
Fix making public
|
2019-12-07 23:17:12 +01:00 |
|
|
|
219349e95a
|
Fix opening
|
2019-12-07 22:48:58 +01:00 |
|
|
|
3705c9c0ea
|
Use the proper server when triggering
|
2019-12-07 22:34:24 +01:00 |
|
|
|
247e55ba18
|
Add a helper function
|
2019-12-07 21:26:50 +01:00 |
|
|
|
1b3a55ae12
|
Just score API interface
|
2019-11-30 20:47:19 +01:00 |
|
|
|
c1e901afb4
|
Search and score API works for output hashes now
|
2019-11-30 19:44:42 +01:00 |
|
|
|
d94e40efc7
|
Unify API for querying for results and scores
|
2019-11-30 12:47:41 +01:00 |
|
|
|
7b4b8b101d
|
API for scores handles alternative metrics
|
2019-11-30 11:56:07 +01:00 |
|
|
|
1d2c2ca78f
|
Variant information reachable from query results
|
2019-11-30 11:25:53 +01:00 |
|
|
|
c0a06ae112
|
First version of viewing a specific variant
|
2019-11-30 11:04:52 +01:00 |
|
|
|
c72cc274d5
|
Continue work viewing variants
|
2019-11-30 08:36:21 +01:00 |
|
|
|
48119428fe
|
Refactor showing a specific submission
|
2019-11-29 22:10:48 +01:00 |
|
|
|
4ba7ae2212
|
Use correctly REPO_HOST in as the default host when submitting
|
2019-11-29 09:17:17 +01:00 |
|
|
|
9b75d75cbd
|
Change email with user identifier/login
|
2019-11-25 22:38:59 +01:00 |
|
|
|
688b7bfc60
|
Add instructions how to use Gonito when writing a paper
|
2019-11-07 14:31:10 +01:00 |
|
|
|
80b5ae6b33
|
Set challenge deadline
|
2019-09-24 22:52:25 +02:00 |
|
|
|
214ee17aaf
|
New presentation
|
2019-09-23 23:16:46 +02:00 |
|
|
|
46ddb826a9
|
Fix update challenge
|
2019-09-23 17:35:39 +02:00 |
|
|
|
5b188cf718
|
Fix version incrementation
|
2019-09-20 19:51:44 +02:00 |
|
|
|
9a53a258ff
|
Show metric names parsed from evaluation schemes
|
2019-09-11 21:30:37 +02:00 |
|
Filip Graliński
|
0f4150a4a5
|
Fix issue with unwanted messages
|
2019-09-10 08:59:30 +02:00 |
|
|
|
284d7e1acf
|
Handle version while sorting
|
2019-08-29 21:34:13 +02:00 |
|
|
|
14b78e7cdd
|
Show submission version
|
2019-08-29 10:01:36 +02:00 |
|
|
|
1255577259
|
Tests are shown without duplicates in case of challenge updates
|
2019-08-29 09:39:21 +02:00 |
|
|
|
32c77b3c74
|
Challenges can be updated
|
2019-08-29 08:56:22 +02:00 |
|
|
|
ca42fcbf84
|
Continue work on challenge updating
|
2019-08-28 08:49:43 +02:00 |
|
|
|
40a06a8bee
|
Versions are obligatory for challanges and submission
DB-SCEHEME-BREAKING CHANGE
|
2019-08-27 23:39:24 +02:00 |
|
|
|
d9b92b772a
|
Add challenge versions
|
2019-08-27 22:36:51 +02:00 |
|
Filip Graliński
|
3b6846c683
|
Update for GEval preprocessing operations
|
2019-08-12 18:19:02 +02:00 |
|
|
|
e589996530
|
Add course summaries
|
2019-06-15 12:21:41 +02:00 |
|
Filip Graliński
|
f58121b407
|
Local IDs can be longer
|
2019-03-20 16:32:52 +01:00 |
|
Filip Graliński
|
27efefeb13
|
Challenges can be archived
|
2019-03-20 16:31:08 +01:00 |
|
Filip Graliński
|
e424cc361f
|
Check indicator targets
|
2019-02-22 14:41:43 +01:00 |
|
Filip Graliński
|
84212562bc
|
Remove dead code
|
2019-02-22 12:06:44 +01:00 |
|
Filip Graliński
|
904cf8ca7e
|
Mark target lines with colors on the dashboard
|
2019-02-22 12:02:05 +01:00 |
|
Filip Graliński
|
87f37df55f
|
Format indicators
|
2019-02-22 09:53:00 +01:00 |
|
Filip Graliński
|
81167926bf
|
Fix formatting indicator target values
|
2019-02-22 09:03:43 +01:00 |
|
|
|
ba50789fbe
|
Trying to fix the issue with Slack hook
|
2019-02-16 13:45:58 +01:00 |
|
|
|
c52b613ac4
|
Handle JSON Lines files
|
2019-02-14 22:57:29 +01:00 |
|
|
|
2de5a8c4d3
|
Update for new geval
|
2019-01-24 21:22:02 +01:00 |
|
Filip Graliński
|
de7c1a262d
|
Git-annex remote can be specified when triggering an evaluation
|
2018-12-07 09:11:50 +01:00 |
|
Filip Graliński
|
21f9302d1f
|
Fix bug with the same dependency being added twice
|
2018-11-23 12:49:49 +01:00 |
|
|
|
ccae7e284f
|
Show downstream submissions
|
2018-11-17 13:49:44 +01:00 |
|
|
|
879eb4e044
|
Block terminal
|
2018-11-17 10:07:59 +01:00 |
|
|
|
62e282f136
|
Convert a boolean value to a non-maybe
|
2018-11-17 09:49:25 +01:00 |
|
Filip Graliński
|
e3d6117590
|
Add dependency tracking
|
2018-11-16 12:43:44 +01:00 |
|
|
|
ec4947254a
|
Fix slack hook
|
2018-11-14 20:59:40 +01:00 |
|
Filip Graliński
|
3447b29a82
|
Handle Slack hooks
|
2018-11-14 17:41:01 +01:00 |
|
Filip Graliński
|
484b98e699
|
Consider only non-hidden submissions
|
2018-11-13 16:15:02 +01:00 |
|
Filip Graliński
|
bc34520fdd
|
Fix bug with submission creation
|
2018-11-13 14:48:41 +01:00 |
|
Filip Gralinski
|
5e14672b2d
|
Check whether the best one
|
2018-11-12 22:01:51 +01:00 |
|
Filip Gralinski
|
0a5f05604e
|
Add external links
|
2018-11-12 20:41:46 +01:00 |
|
Filip Gralinski
|
0e8846b06c
|
Show result tables
|
2018-11-12 14:12:51 +01:00 |
|
Filip Gralinski
|
6b87181454
|
Add ranks to submission lists
|
2018-11-12 10:11:58 +01:00 |
|
Filip Gralinski
|
ff2112a745
|
Improve showing a single submission
|
2018-11-10 11:20:17 +01:00 |
|
Filip Gralinski
|
2416dacffb
|
Description is clickable
|
2018-11-03 21:37:44 +01:00 |
|
Filip Gralinski
|
37125b8326
|
Sets are used instead of strings for tags
|
2018-11-03 17:25:49 +01:00 |
|
Filip Gralinski
|
9d67e39a06
|
Take params
|
2018-11-03 12:30:39 +01:00 |
|
Filip Gralinski
|
d3e2c06b15
|
Change HashMap to Map, clean up
|
2018-11-03 10:56:58 +01:00 |
|
Filip Graliński
|
7404dd330d
|
Show all deadline lines
|
2018-10-25 09:23:05 +02:00 |
|
Filip Gralinski
|
876e98f862
|
Merge branch 'master' of ssh://gonito.net/gonito
|
2018-10-15 21:15:29 +02:00 |
|
Filip Gralinski
|
687716f6fe
|
Handle tags and description from gonito.yaml
|
2018-10-15 21:15:03 +02:00 |
|
Filip Graliński
|
32ae5d7e1a
|
Use --single-branch
|
2018-10-15 14:19:20 +02:00 |
|
Filip Graliński
|
a2ae700158
|
Add first version of indicator graphs
|
2018-09-22 19:22:00 +02:00 |
|
Filip Gralinski
|
e1b1ff53f1
|
Add indicators to the database, make it possible to edit them in the dashboard.
The dashboard itself (in terms of graphs) is not part of this commit.
|
2018-09-14 15:50:44 +02:00 |
|
Filip Gralinski
|
69dedeecbd
|
Fix some warnings in Achievements
|
2018-09-14 15:50:42 +02:00 |
|
Filip Gralinski
|
1415133bab
|
Fix order of tests
|
2018-09-08 21:24:25 +02:00 |
|
Filip Gralinski
|
055687506b
|
Add by-tag mode for the leaderboard
|
2018-09-08 21:21:21 +02:00 |
|
Filip Gralinski
|
20fc29159f
|
Show all main metrics in the leaderboard
|
2018-09-08 19:21:06 +02:00 |
|
Filip Gralinski
|
858f494047
|
Scores are sorted correctly with N/A and Infinity values correctly handled
|
2018-09-08 10:20:36 +02:00 |
|
Filip Gralinski
|
1aafff1808
|
Do not use scientific formatting of scores
|
2018-09-08 09:03:22 +02:00 |
|
|
|
2ed724bf05
|
handle tags correctly in case of re-submission
|
2018-09-01 15:27:11 +02:00 |
|
|
|
bed12dee34
|
show only numerical params on graphs
|
2018-09-01 14:23:41 +02:00 |
|
|
|
40016c36e5
|
fix function name
|
2018-09-01 14:01:17 +02:00 |
|
|
|
c23e28250a
|
numbers in graphs are shown with the right precision
|
2018-09-01 13:56:18 +02:00 |
|
|
|
6c6c63114f
|
improve creating challenges
|
2018-09-01 12:01:35 +02:00 |
|
|
|
63dac77974
|
improve submission for how-to
|
2018-09-01 11:06:42 +02:00 |
|
|
|
0758ca3239
|
fix triggering an evaluation when running in the auto-opening mode
|
2018-09-01 10:48:08 +02:00 |
|
|
|
fac5d451d6
|
use space instead of slash as separator between test-name and metric (in tables)
so that the hear could be wrapped in a more narrow column if needed
(e.g. if the number of test sets/metric is large)
|
2018-09-01 10:46:39 +02:00 |
|
|
|
d9a3d56d3d
|
improve showing query results, fix issue with triggering evaluation for the first time
|
2018-08-30 21:58:27 +02:00 |
|
|
|
b14e675c61
|
add a parameter
|
2018-07-30 07:59:38 +02:00 |
|
|
|
ff8d8d8e7a
|
param graphs are shown for the challenge main page as well
|
2018-07-28 22:10:55 +02:00 |
|
|
|
abef15c905
|
refactor param graphs
|
2018-07-28 22:02:47 +02:00 |
|
|
|
3388971ed6
|
clean up and refactor
|
2018-07-28 21:53:13 +02:00 |
|
|
|
3a4c85c501
|
clean up ShowChallenge
|
2018-07-28 21:36:45 +02:00 |
|
|
|
9d54deb68f
|
show param graphs for all non-dev tests
|
2018-07-28 21:22:52 +02:00 |
|
|
|
c60e786025
|
refactor getMainTest
|
2018-07-28 19:59:29 +02:00 |
|
|
|
e263a37eca
|
clean up and generalize code generating param charts
|
2018-07-28 19:16:07 +02:00 |
|
|
|
5105652838
|
clean up code a little bit
|
2018-07-28 17:30:00 +02:00 |
|
|
|
0a51543957
|
show graphs for params
|
2018-07-28 17:04:27 +02:00 |
|
|
|
276ca4d596
|
start working on C3
|
2018-07-26 22:01:21 +02:00 |
|
|
|
ae75c806c7
|
clean up code in Runner, fix a likely bug
|
2018-07-26 21:46:17 +02:00 |
|
|
|
70271c81f5
|
show params in graph labels
|
2018-07-24 15:36:24 +02:00 |
|
|
|
c54af512c7
|
add auto-opening mode
|
2018-07-24 15:33:35 +02:00 |
|
|
|
3c157290b9
|
graph shows challenges with variants correctly
|
2018-07-24 15:21:20 +02:00 |
|
|
|
92f16f6c5d
|
generalize toLeaderboardEntries
|
2018-07-24 15:02:37 +02:00 |
|
|
|
23c2cb0072
|
show variant information at leaderboard
|
2018-07-24 14:08:47 +02:00 |
|
|
|
623ccfb602
|
show params
|
2018-07-14 19:44:33 +02:00 |
|
|
|
2f796d47cb
|
get parameters when table is shown
|
2018-07-14 17:10:07 +02:00 |
|
|
|
ca9bcbac55
|
refactor tables
|
2018-07-14 17:02:30 +02:00 |
|
|
|
f3960c371d
|
multiple outs can be accepted now
|
2018-07-14 15:27:49 +02:00 |
|
|
|
bb77049918
|
clean up some warnings
|
2018-07-14 07:42:28 +02:00 |
|
|
|
4dbf64ecfc
|
clean up variants
|
2018-07-14 07:38:55 +02:00 |
|
|
|
9b445d6e9c
|
variants are used within within outs - transition completed
|
2018-07-06 16:54:17 +02:00 |
|
|
|
b572bf45d0
|
clean up some warnings
|
2018-07-05 22:17:25 +02:00 |
|
|
|
eedf1cd6fa
|
variant is now required for an out
|
2018-07-05 22:15:21 +02:00 |
|
|
|
a7bd6a933e
|
dummy variants for "out" files are added now
|
2018-07-04 17:01:45 +02:00 |
|
|
|
52ae6ae9a5
|
start transition to multiple variants per submission
|
2018-07-04 16:22:10 +02:00 |
|
|
|
306d9d0af6
|
update for GEval 1.1.0.0
|
2018-06-29 08:05:33 +02:00 |
|
|
|
4ec90bdb10
|
introducint 2 modes for tags
|
2018-06-27 13:32:45 +02:00 |
|
|
|
7b7001845d
|
a submission can be removed now (actually hidden)
|
2018-06-27 13:09:11 +02:00 |
|
|
|
252da6316a
|
fix problem with git-annex remote when updating a repo, get rid of some warnings
|
2018-06-14 20:35:48 +02:00 |
|
|
|
f7a85e80a0
|
fix handling compressed expected files
|
2018-06-09 15:35:31 +02:00 |
|
|
|
d7c656217f
|
fix mutiple metrics
|
2018-06-08 22:15:49 +02:00 |
|
|
|
32f0d1eb12
|
fix handle compressed out-files
|
2018-06-08 21:59:06 +02:00 |
|
|
|
1ea5e4ecbd
|
handle multiple metrics for the same test
|
2018-06-08 15:00:40 +02:00 |
|
|
|
fe170e9a05
|
fix handling GitLab URLs
|
2018-06-06 14:18:27 +02:00 |
|
|
|
a9de751d87
|
showing submissions correctly in "branches" mode
|
2018-06-06 13:43:17 +02:00 |
|
|
|
115df0521d
|
improve "branches" mode
|
2018-06-06 13:08:38 +02:00 |
|
|
|
92c0927dca
|
fix update a submission when using git-annex
|
2018-06-06 12:58:50 +02:00 |
|
|
|
85c9ad6646
|
improve how-to for self-hosted instances and git-annex
|
2018-06-06 10:30:53 +02:00 |
|
|
|
28222d5a37
|
repo host can be set
|
2018-06-05 23:04:58 +02:00 |
|
|
|
1262cc7cb8
|
does not check for correctness of Git URLs
(URL copied&pasted from, for instance, GitLab does not have the protocol anyway.)
|
2018-06-05 22:39:02 +02:00 |
|
|
|
0b1263af27
|
fix pargins git-annex remote
|
2018-06-05 16:57:44 +02:00 |
|
|
|
35bb3c7af6
|
finished handling git-annex
|
2018-06-05 16:23:16 +02:00 |
|
|
|
e06f2120ea
|
start using Runner monad
|
2018-06-05 09:36:48 +02:00 |
|
|
|
dcdf71b5e6
|
prepare Runner for better running stuff
|
2018-06-05 09:07:01 +02:00 |
|
|
|
edf0624b95
|
refactor running stuff
|
2018-06-05 08:22:51 +02:00 |
|
|
|
f1502c16e4
|
start handling git-annex remote
|
2018-06-05 07:46:42 +02:00 |
|
|
|
06970317a7
|
refactored cloning cntd.
|
2018-06-04 22:14:39 +02:00 |
|
|
|
ae389aa144
|
refactor cloning cntd.
|
2018-06-04 21:58:05 +02:00 |
|
|
|
61ca7e7839
|
refactor cloning git repos
|
2018-06-01 22:52:49 +02:00 |
|
|
|
0662522a44
|
update to Stack LTS 11.9
|
2018-05-20 16:58:48 +02:00 |
|
|
|
4e3fb94ce0
|
update for LTS 10.10
|
2018-05-19 08:05:24 +02:00 |
|
