challenging-america-word-ga.../README.md

Challenging America word-gap prediction
===================================

This task is to predict the word-gap between two sentences.

Evaluation
-----------------

PerplexityHashed is the metric so to check the performance of the model. The lower the perplexity, the better the model. To run evaluation run the following command:

```bash
./geval --metric PerplexityHashed --test-name dev-0
```

Perplexity calculated on `dev-0` is equal `981.69`
Final model 2024-04-28 00:56:04 +02:00			`Challenging America word-gap prediction`
			`===================================`

			`This task is to predict the word-gap between two sentences.`

			`Evaluation`
			`-----------------`

			`PerplexityHashed is the metric so to check the performance of the model. The lower the perplexity, the better the model. To run evaluation run the following command:`

			```bash
			`./geval --metric PerplexityHashed --test-name dev-0`
			```

			Perplexity calculated on `dev-0` is equal `981.69`