Trigram model

This commit is contained in:
$uname 2023-05-07 08:43:51 +00:00
parent b30ed83944
commit b13b56a8c8
6 changed files with 17933 additions and 10532 deletions

File diff suppressed because it is too large Load Diff

BIN
geval

Binary file not shown.

13
lm0.py
View File

@ -1,13 +0,0 @@
#!/usr/bin/python3
import sys
for i, line in enumerate(sys.stdin):
if(line.split('\t')[6].endswith('\n')):
print('hence:0.95 :0.05')
elif(line.split('\t')[6].endswith('ot')):
print('be:0.6 a:0.35 :0.05')
elif(line.split('\t')[6].endswith('.')):
print('but:0.85 :0.15')
elif([l.split(' ') for l in line.split('\t')][5][0].endswith('ing')):
print('this:0.88 :0.12')
else:
print('the:0.5 a:0.3 :0.2')

7414
test-A/out.tsv Normal file

File diff suppressed because it is too large Load Diff

Binary file not shown.