s452629/challenging-america-word-gap-prediction
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
main
challenging-america-word-ga.../README.md
Marcin Czerniak 0734c5d906 Final model
2024-04-28 00:56:04 +02:00

466 B
Raw Permalink Blame History

Challenging America word-gap prediction

This task is to predict the word-gap between two sentences.

Evaluation

PerplexityHashed is the metric so to check the performance of the model. The lower the perplexity, the better the model. To run evaluation run the following command:

./geval --metric PerplexityHashed --test-name dev-0

Perplexity calculated on dev-0 is equal 981.69