16 lines
466 B
Markdown
16 lines
466 B
Markdown
Challenging America word-gap prediction
|
|
===================================
|
|
|
|
This task is to predict the word-gap between two sentences.
|
|
|
|
Evaluation
|
|
-----------------
|
|
|
|
PerplexityHashed is the metric so to check the performance of the model. The lower the perplexity, the better the model. To run evaluation run the following command:
|
|
|
|
```bash
|
|
./geval --metric PerplexityHashed --test-name dev-0
|
|
```
|
|
|
|
Perplexity calculated on `dev-0` is equal `981.69`
|