Gonito.net

open platform for research competition, cooperation and reproducibility

Filip Graliński, Rafał Jaworski, Łukasz Borchmann, Piotr Wierzchoń

LREC 2016 / 4REAL Workshop

Motivation

• We needed a place to keep track of our results for
  • our research
  • teaching our students
  • just playing with our data sets
  • (but didn't want to save the world and earn $$$)

    Alternatives?

    • Kaggle
      • you need to ask Kaggle people
      • Kaggle in class only for teaching
      • not fully open ☹
      • DrivenData
        • more or less similar to Kaggle
        • CodaLab
          • open!
          • trying hard but didn't find it ☹
          • no git

            That's why we created

            Gonito.net

            open platform for machine learning competition

            • Be open
              • GNU Affero General Public License
              • Anyone can set up their own instance
              • Users are encouraged to share source codes
              • Users are free to use whatever programming language and tools
              • Use git
                • Challenges are created as Git repositories
                • Solutions uploaded with Git
                • Solutions can be forked and reused
                • Even if a Gonito.net ceases to exist, Git repos may live

                  … and

                  GEval

                  companion Haskell library and stand-alone tool for machine learning evaluation

                  • accuracy
                  • (R)MSE
                  • BLEU
                  • … more to come

                    A challenge…

                    ^{readme}

                    Current status…

                    ^{Table.buildBootstrap (leaderboardTable Nothing (challengeName challenge) test) leaderboardWithRanks}