This commit is contained in:
ZarebaMichal 2022-04-03 19:57:18 +02:00
parent 290a1f802c
commit 9d77a3a7ee
3 changed files with 13847 additions and 13848 deletions

File diff suppressed because it is too large Load Diff

1
run.py
View File

@ -14,7 +14,6 @@ DEFAULT_PREDICTION = 'the:0.2 be:0.2 to:0.2 of:0.1 and:0.1 a:0.1 :0.1'
def preprocess_text(text):
text = text.lower().replace("-\\n", "").replace("\\n", " ")
text = re.sub(r"\p{P}", "", text)
return text

File diff suppressed because it is too large Load Diff