kenlm solution

This commit is contained in:
Jakub Eichner 2023-04-26 08:17:51 +02:00
parent dfe830ac26
commit 64b2612ef1

View File

@ -7397,18 +7397,18 @@ and:-13.406027793884277 might:-14.193289756774902 will:-14.347307205200195 am:-1
think:-13.905092239379883 wish:-14.324577331542969 thought:-14.372810363769531 believe:-14.441351890563965 am:-14.592143058776855 the:-14.657515525817871 said:-14.749709129333496 suppose:-14.759977340698242 guess:-14.779799461364746 feel:-14.835762977600098 and:-14.91838264465332 was:-15.02481460571289 have:-15.03286361694336 know:-15.077351570129395 had:-15.148760795593262 :-0.5228787452803376 think:-13.905092239379883 wish:-14.324577331542969 thought:-14.372810363769531 believe:-14.441351890563965 am:-14.592143058776855 the:-14.657515525817871 said:-14.749709129333496 suppose:-14.759977340698242 guess:-14.779799461364746 feel:-14.835762977600098 and:-14.91838264465332 was:-15.02481460571289 have:-15.03286361694336 know:-15.077351570129395 had:-15.148760795593262 :-0.5228787452803376
lhe:-40.980621337890625 a:-41.08258056640625 the:-41.13759994506836 and:-41.231746673583984 c:-41.30368423461914 e:-41.33385467529297 in:-41.36534118652344 thence:-41.3653450012207 of:-41.480224609375 to:-41.577640533447266 m:-41.57769012451172 i:-41.64754867553711 ist:-41.65333938598633 it:-41.72843933105469 nellie:-41.82480239868164 :-0.5228787452803376 lhe:-40.980621337890625 a:-41.08258056640625 the:-41.13759994506836 and:-41.231746673583984 c:-41.30368423461914 e:-41.33385467529297 in:-41.36534118652344 thence:-41.3653450012207 of:-41.480224609375 to:-41.577640533447266 m:-41.57769012451172 i:-41.64754867553711 ist:-41.65333938598633 it:-41.72843933105469 nellie:-41.82480239868164 :-0.5228787452803376
by:-31.016029357910156 in:-31.228208541870117 of:-31.268461227416992 and:-31.522672653198242 n:-31.624755859375 to:-31.743688583374023 ed:-31.765939712524414 the:-31.784482955932617 on:-31.888891220092773 that:-31.904966354370117 with:-32.054847717285156 a:-32.072593688964844 at:-32.182044982910156 for:-32.209327697753906 d:-32.212364196777344 :-0.5228787452803376 by:-31.016029357910156 in:-31.228208541870117 of:-31.268461227416992 and:-31.522672653198242 n:-31.624755859375 to:-31.743688583374023 ed:-31.765939712524414 the:-31.784482955932617 on:-31.888891220092773 that:-31.904966354370117 with:-32.054847717285156 a:-32.072593688964844 at:-32.182044982910156 for:-32.209327697753906 d:-32.212364196777344 :-0.5228787452803376
j:-26.48394203186035 8:-26.767391204833984 n:-26.862573623657227 and:-27.011852264404297 of:-27.083877563476562 a:-27.262195587158203 the:-27.338623046875 it:-27.507593154907227 south:-27.616207122802734 c:-27.625471115112305 in:-27.734935760498047 s:-27.77220916748047 to:-27.813976287841797 by:-27.92045783996582 r:-27.977252960205078 :-0.5228787452803376 <unk>:0.0859765112400055 a:0.056805115193128586 the:0.04047727212309837 not:0.035569388419389725 in:0.024933019652962685 to:0.0178549624979496 no:0.0147812869399786 made:0.010334793478250504
is:-18.00448226928711 of:-18.279361724853516 r:-18.288917541503906 the:-18.33664321899414 a:-18.436607360839844 thence:-18.503948211669922 and:-18.515357971191406 i:-18.5637149810791 he:-18.644733428955078 lie:-18.6765079498291 to:-18.758106231689453 in:-18.78129005432129 h:-18.81551742553711 it:-18.84563446044922 j:-18.878585815429688 :-0.5228787452803376 the:0.26979193091392517 <unk>:0.09528635442256927 a:0.03725918382406235 this:0.016859158873558044 his:0.016808202490210533 tho:0.009696063585579395 said:0.008991764858365059 our:0.008593185804784298
the:-28.85363006591797 and:-28.886672973632812 m:-28.904674530029297 a:-28.964706420898438 e:-29.215843200683594 j:-29.318531036376953 g:-29.335166931152344 8:-29.37281036376953 in:-29.385822296142578 w:-29.387020111083984 of:-29.396060943603516 it:-29.4219970703125 to:-29.52533721923828 s:-29.652599334716797 i:-29.67190933227539 :-0.5228787452803376 who:0.045222751796245575 in:0.03897800296545029 and:0.031102389097213745 have:0.030241383239626884 to:0.02948344126343727 of:0.02910313755273819 are:0.02715952694416046 <unk>:0.02558850683271885
of:-17.24025535583496 j:-17.328182220458984 the:-17.375564575195312 r:-17.478078842163086 by:-17.546476364135742 a:-17.59041404724121 and:-17.604568481445312 sat:-17.61820411682129 much:-17.66471290588379 on:-17.736839294433594 he:-17.747047424316406 lie:-17.778823852539062 to:-17.808042526245117 o:-17.829578399658203 in:-17.944772720336914 :-0.5228787452803376 <unk>:0.07084603607654572 be:0.07014978677034378 to:0.03722590580582619 only:0.032003190368413925 a:0.030743595212697983 the:0.02526315115392208 in:0.019770784303545952 have:0.017810005694627762
of:-32.43745040893555 h:-33.538597106933594 he:-33.68940353393555 the:-33.89900588989258 a:-33.982200622558594 and:-34.035430908203125 oi:-34.116050720214844 lie:-34.231056213378906 f:-34.2359733581543 j:-34.315223693847656 c:-34.42073059082031 hat:-34.487884521484375 st:-34.4934196472168 is:-34.53209686279297 an:-34.5380859375 :-0.5228787452803376 <unk>:0.10069399327039719 of:0.050821974873542786 and:0.05027756839990616 the:0.02932741306722164 to:0.02773895300924778 in:0.023948313668370247 for:0.012773370370268822 </s>:0.01246299035847187
of:-13.548358917236328 out:-13.817424774169922 and:-14.380260467529297 in:-14.488433837890625 or:-14.48904800415039 at:-14.536022186279297 with:-14.560842514038086 as:-14.637140274047852 for:-14.682178497314453 j:-14.703125 to:-14.721824645996094 was:-14.74964714050293 by:-14.75954818725586 is:-14.826005935668945 ws:-14.840429306030273 :-0.5228787452803376 and:0.08925677090883255 of:0.07264605164527893 <unk>:0.0475117489695549 the:0.022295700386166573 in:0.02114931307733059 is:0.016647029668092728 to:0.01522457879036665 as:0.01498371921479702
the:-14.66730785369873 n:-15.04631519317627 by:-15.150270462036133 and:-15.188070297241211 of:-15.217846870422363 california:-15.229001998901367 second:-15.268150329589844 f:-15.321789741516113 to:-15.346095085144043 clock:-15.409099578857422 a:-15.50026798248291 in:-15.532136917114258 on:-15.587092399597168 e:-15.706502914428711 that:-15.714273452758789 :-0.5228787452803376 and:0.07805665582418442 <unk>:0.06022694706916809 the:0.03467823565006256 of:0.025452006608247757 </s>:0.02275770716369152 in:0.022473478689789772 is:0.021684998646378517 was:0.021087991073727608
of:-14.026212692260742 opening:-14.725385665893555 and:-14.858114242553711 in:-14.966287612915039 or:-14.966901779174805 at:-15.013875961303711 with:-15.0386962890625 as:-15.114994049072266 for:-15.160032272338867 j:-15.180978775024414 same:-15.195228576660156 out:-15.196023941040039 to:-15.199678421020508 was:-15.227500915527344 by:-15.237401962280273 :-0.5228787452803376 <unk>:0.10069399327039719 of:0.050821974873542786 and:0.05027756839990616 the:0.02932741306722164 to:0.02773895300924778 in:0.023948313668370247 for:0.012773370370268822 </s>:0.01246299035847187
j:-24.514467239379883 the:-24.865821838378906 and:-24.88568687438965 as:-24.962427139282227 of:-25.087738037109375 he:-25.151029586791992 a:-25.21127700805664 lie:-25.447633743286133 large:-25.466299057006836 i:-25.480619430541992 h:-25.590293884277344 to:-25.598346710205078 it:-25.620420455932617 in:-25.69431495666504 hat:-25.704465866088867 :-0.5228787452803376 <unk>:0.10069399327039719 of:0.050821974873542786 and:0.05027756839990616 the:0.02932741306722164 to:0.02773895300924778 in:0.023948313668370247 for:0.012773370370268822 </s>:0.01246299035847187
ihe:-10.598146438598633 and:-12.245075225830078 of:-12.249516487121582 in:-12.27627944946289 the:-12.302587509155273 n:-12.344058990478516 by:-12.350017547607422 on:-12.366474151611328 1:-12.39460563659668 all:-12.640067100524902 to:-12.744705200195312 a:-12.747564315795898 few:-12.822758674621582 14:-12.837106704711914 for:-12.886234283447266 :-0.5228787452803376 of:0.20969586074352264 and:0.054293714463710785 to:0.03350410982966423 how:0.03313615918159485 in:0.030119670554995537 is:0.02976115606725216 that:0.023617122322320938 was:0.023210695013403893
t:-15.13003921508789 box:-15.224635124206543 s:-15.509126663208008 and:-15.550649642944336 the:-15.589263916015625 e:-15.827945709228516 i:-15.90423583984375 n:-15.933784484863281 f:-16.1368350982666 one:-16.27021026611328 a:-16.291831970214844 in:-16.294662475585938 of:-16.31292152404785 to:-16.319726943969727 tho:-16.39401626586914 :-0.5228787452803376 the:0.22281692922115326 <unk>:0.07168595492839813 a:0.06440594047307968 his:0.015171307139098644 this:0.013056053780019283 it:0.012502728961408138 their:0.01115209236741066 all:0.009231016971170902
same:-37.496681213378906 c:-37.53227233886719 r:-37.56279373168945 of:-37.6998176574707 opening:-37.75733184814453 and:-37.77164840698242 a:-37.79479217529297 thence:-37.928585052490234 wilson:-37.98771667480469 south:-38.02183532714844 the:-38.037315368652344 n:-38.0859260559082 in:-38.129173278808594 j:-38.15532302856445 to:-38.28099822998047 :-0.5228787452803376 the:0.2147059291601181 <unk>:0.07058662921190262 least:0.035882383584976196 a:0.03362666815519333 once:0.026820126920938492 all:0.02492222934961319 this:0.020157158374786377 his:0.013571113348007202
and:-23.7930908203125 j:-23.906131744384766 a:-24.067289352416992 of:-24.082300186157227 by:-24.101415634155273 in:-24.157888412475586 that:-24.17036247253418 v:-24.27743911743164 the:-24.394990921020508 on:-24.41094970703125 o:-24.414945602416992 to:-24.437746047973633 n:-24.499231338500977 e:-24.53434944152832 i:-24.578022003173828 :-0.5228787452803376 be:0.3076408803462982 not:0.04943064972758293 <unk>:0.04283434525132179 have:0.024055495858192444 take:0.016619397327303886 probably:0.010238772258162498 bo:0.009679237380623817 find:0.009229996241629124
e:-42.958900451660156 bow:-43.57109069824219 and:-43.725860595703125 the:-43.96368408203125 as:-43.990577697753906 but:-44.048309326171875 of:-44.090171813964844 when:-44.103553771972656 a:-44.11572265625 i:-44.11698913574219 f:-44.12977600097656 that:-44.18537902832031 week:-44.22154998779297 m:-44.22559356689453 1:-44.235008239746094 :-0.5228787452803376 the:0.054253950715065 be:0.05239039286971092 not:0.05194757133722305 <unk>:0.046643905341625214 a:0.030184635892510414 is:0.015700705349445343 it:0.015550229698419571 to:0.015128018334507942
m:-1.118197441101074 and:-10.475425720214844 but:-10.80013656616211 when:-10.81490707397461 ii:-10.884469985961914 that:-10.912216186523438 as:-10.926169395446777 1:-10.935317039489746 if:-10.992217063903809 which:-11.005592346191406 the:-11.042283058166504 had:-11.045080184936523 of:-11.079920768737793 to:-11.121822357177734 in:-11.160901069641113 :-0.5228787452803376 <unk>:0.04472367465496063 and:0.044175446033477
Can't render this file because it is too large.