Update a challenge
Be careful about choosing the change. It has consequences!
- major change: the new challenge version is completely incompatible with the previous versions,
\ and as a consequence all the submissions done for the previous versions will be demoted (even if their score is numerically higher);
- minor change: the score obtained for the new version will be roughly comparable with the scores you got
\ for the previous version, but there is no guarantee that the existing submissions could be re-evaluated
\ (e.g. because the number of items changed);
- patch change: the score obtained for the new version will be comparable with the scores you got
\ for the previous version and it is guaranteed that the existing submissions could be re-evaluated
\ (you will actually see the button
\ for such submissions), i.e:
- the number of items in all tests has not changed,
- changes to the input and expected files are possible, but are not significant (but note that some changes might break re-evaluation for some metrics)
- in particular, changing README.md and adding extra evaluation metrics could usually be done as a patch change.