decoder-only #2

This commit is contained in:
Szymon Parafiński 2023-06-07 15:42:52 +02:00
parent dc04167fee
commit 9d658c7d4a
4 changed files with 10525 additions and 18032 deletions

File diff suppressed because it is too large Load Diff

View File

@ -1,6 +1,7 @@
description: s444018
tags:
-transformer-decoder
-gpt2
params:
- topk: 20
- max_prob: 0.7

View File

@ -7407,3 +7407,8 @@ the:0.046122509986162186 a:0.03487784042954445 1:0.021276846528053284 produce:0.
accident:0.46734729409217834 collision:0.20758198201656342 crash:0.0671108290553093 acc:0.04365186020731926 incident:0.014989766292273998 wreck:0.008686074055731297 cr:0.0063369302079081535 coll:0.0052143270149827 car:0.004091491457074881 car:0.004083959851413965 hit:0.0036712849978357553 impact:0.003627571975812316 mish:0.0025008306838572025 inc:0.0020336497109383345 event:0.002021190244704485 accidents:0.0016602787654846907 con:0.0014115726808086038 f:0.0013916033785790205 c:0.0012257782509550452 in:0.0012023814488202333 :0.1501593440771103
they:0.12709197402000427 he:0.062176886945962906 they:0.0621095634996891 the:0.05553677678108215 he:0.03334697335958481 the:0.026920653879642487 if:0.026775222271680832 if:0.022032596170902252 his:0.019649945199489594 some:0.019522778689861298 one:0.015201570466160774 their:0.014571324922144413 there:0.012564144097268581 a:0.011225194670259953 one:0.011078684590756893 it:0.009650844149291515 all:0.009303173050284386 ,:0.006559448316693306 his:0.006152777001261711 some:0.00557577284052968 :0.44295358657836914
the:0.268485963344574 a:0.13012783229351044 th:0.03151635453104973 t:0.03058645874261856 an:0.02141306921839714 one:0.019206928089261055 and:0.017069771885871887 all:0.009207503870129585 w:0.0089134331792593 said:0.007912634871900082 ,:0.007860497571527958 *:0.0077324057929217815 *:0.007668691221624613 i:0.007571170572191477 that:0.007265669759362936 this:0.006979041267186403 tho:0.006906895432621241 two:0.006725620944052935 c:0.00602949783205986 l:0.0051517179235816 :0.3856687843799591
t:0.12997841835021973 r:0.05670608952641487 n:0.02474575862288475 m:0.01822815276682377 r:0.017963973805308342 t:0.016492467373609543 tion:0.011465256102383137 ment:0.00772376311942935 e:0.0066743213683366776 c:0.00620688172057271 b:0.0060881064273417 ri:0.005889842752367258 re:0.005868872161954641 p:0.005799657665193081 d:0.0055593568831682205 m:0.005439054220914841 re:0.004028200637549162 s:0.003997158259153366 th:0.0038161086849868298 g:0.0038069775328040123 :0.6535216569900513
plan:0.07229527086019516 idea:0.03543581813573837 war:0.02138577401638031 rebel:0.008282778784632683 fact:0.0070967539213597775 necessity:0.006562123075127602 need:0.006351887248456478 question:0.005572814028710127 use:0.005437161773443222 proposal:0.005305904895067215 surrender:0.00508646946400404 possibility:0.004456444643437862 attack:0.004408660810440779 whole:0.004397776443511248 first:0.004321905318647623 right:0.003931418992578983 peace:0.0039213234558701515 policy:0.003915285225957632 general:0.003641353454440832 w:0.0035757485311478376 :0.7846173644065857
le:0.023078233003616333 ng:0.015730543062090874 -:0.012768562883138657 .:0.012574009597301483 ii:0.010570500046014786 ter:0.010153884999454021 j:0.008129485882818699 nt:0.008045692928135395 of:0.00791962631046772 ce:0.007694435305893421 ,:0.006955931428819895 m:0.006206282414495945 ai:0.00563065754249692 ion:0.005574917420744896 ^:0.005412575788795948 k:0.0052376301027834415 ty:0.004930481780320406 «:0.004915476776659489 re:0.004766315221786499 ne:0.0041243513114750385 :0.8295803666114807
the:0.46427732706069946 that:0.060817282646894455 the:0.043307092040777206 a:0.030293714255094528 that:0.012019982561469078 divine:0.007968428544700146 an:0.007664916105568409 th:0.006341265980154276 all:0.006262201815843582 our:0.005982687696814537 its:0.005600973963737488 those:0.005347382742911577 this:0.00512273283675313 their:0.004459834191948175 equal:0.004360861610621214 great:0.004222566727548838 his:0.004062987398356199 it:0.0038250295910984278 God:0.0037919057067483664 a:0.0031630871817469597 :0.3111077547073364
.:0.60224848985672 aul:0.10468064993619919 itt:0.019490400329232216 eter:0.007845375686883926 on:0.00784413330256939 ere:0.005550040863454342 arson:0.004542703274637461 yl:0.003937355242669582 au:0.0034747635945677757 ital:0.0033272167202085257 .,:0.0033268423285335302 th:0.003229144960641861 ett:0.003084417898207903 om:0.002811996266245842 ott:0.0025585114490240812 he:0.0025376954581588507 .':0.002464493503794074 enn:0.0023580139968544245 ew:0.0023058652877807617 her:0.0022950011771172285 :0.2100869119167328

Can't render this file because it is too large.

File diff suppressed because it is too large Load Diff