Generate a new dataset with no author overlap between train and test splits

This commit is contained in:
“Kacper 2024-09-25 14:46:27 +02:00
parent 81405c0d61
commit f6261514c8
366 changed files with 1336 additions and 1420 deletions
README.md
test/images
00e88d035b787281cebc2ce40b69a2f4.png01a8c4f6ac0e64d66f48bdbcf346d485.png0308b8e5e912befb2abaac60d5af7823.png039ad78bfb0526ee1e9e298383b61b67.png03f753f9d0fdf443069e83684c41c782.png04364ae1ce1ab6fc89804f5649a57b17.png04445e42d57485bd59919c7e8233f2ec.png05aaff412384eea95f6df58c2520b622.png05db99b884474930abfdbcf69f423d53.png063b564c742f3d97019b61a137fecdc8.png06e6d0b8dbefdfec2baa25cfcad76e84.png073dd5c1017ca55940e9e024c61a1d06.png077115213bebbb4f872118ec937ebef0.png086c8d6dccf766ba69f90a997e266628.png0a3864f04555e1b5061493742d62c89c.png0d93d24fe333906647415520b468f25c.png162cdde6c3316e5c89c3dab81cd2f138.png16964648a28d4219aa91e0992326c125.png177747fc8fad755af7f1fb5dccf48ba0.png179a98e410784709c88e31d8d8ad8fc4.png190a05debc108e093abab494f79cb511.png1b3f8243e4fe56d5d05d9cef9e683207.png1bedb2bac474c174ab22b09278beb92b.png1ca33aee565c3f9c5fdbd8d7f70341b8.png1f4979f4bdf3a11651a17b84ca22c640.png1ff242c1e4921a1a69e5940e5bf278fc.png21abeead870d49bccb563378ea08c02f.png22b747031866d2a474a7ae4942df73ae.png24c3ca711551ffc08b905dd14d7315d5.png25f48cf0eac552a84186b0c1ec140211.png2665994d9858c146d4a7255cfdbb52f3.png274a43423d75e76ce7821a54a93918d7.png2910bc8603205c0911804abfc5a586c9.png29337caba9f1a9213199f1765557373a.png29fb5f5bc512f2876ae5651c794623ab.png2c221c5073e7a7df0ac45f2c5094d730.png2c6255bc909ac7fbd83aef4d02f10138.png2d754b92f06437a85cbfb2949735d3ee.png2f277ef1b83abb087508a2c8712c16c9.png2f42a34a46f9fd6f2ff6209d75154b09.png31f22fd70ba00f5ce096832c58798f28.png32a2eeda81dd9a6ebeacebae8240e41a.png342992368e071d6d15a07222c8a2ff3b.png34e07e1f89746197272e81a9fa7cb5c6.png36b650596b957eda87e6c10f95b214b7.png377dc041d1fadb4e860d9766cf214221.png395edf957a4958e05ba989877688d28d.png3bb2b6578a401ceaf0a9bef4a9a63989.png4000ded288cd3799474115b34653a8b8.png402478d1cec6e7e57bb356b5d9e9479f.png407eedc21a9981588b3022757546f538.png40d23714465e7d9b208fb37dc94eb937.png423334f24a8d910ed81630dd753f0c0f.png4389d7df29010f9648f98543d96f111e.png43d6cc7e9467db034c930baea9f18cbe.png44ddc01ab3f0d1833bfe4ed3266d6649.png45c2195a00a737236f9033f0eb8adfd4.png48367184d0caa632fc001c290af64d32.png4a5137bbde7bd1434e8784a93d92c622.png4acbea9e64c00bd287c01c21361a8d2c.png4bd68276e7fed8c33631828b454e333a.png4c585b92086eba6d9d9141dc1f812541.png4e7637d0f803cb9835e5e30149afd061.png4f2c47d4edabd41d8404788729b8d29a.png5147a46acd2294b8991f75b87d6861a5.png51e183b557b089abac7e5f5251944b88.png5232826939f8a89845fda4ba31893576.png549ea2de0980508e76d794509b9cf657.png55af23a6ad24e8756a04c0df57bf5728.png56e3c50635602834cb291cd8c8e3880b.png573b98c822f9cd89143273b85fe368cb.png57506feb6916d610861ceaebebad4da7.png59267d7eb4dc34c23fe1c4f16d8fa47f.png5f1aace832e7c5e107a51876e29916b9.png5f6236eb3807c76bafa3b702ce583472.png5ffe33bcc0a853ea03f91c14f7dec1f5.png6122dacb17afbf9234d2e6d30a0596bc.png63550ed5b97b4fe0e6ced71e605c33a2.png65c49de4cc02c4c7ec6580a8f6a4bd9d.png68db384fd6b988fa90ad76ada26aaf70.png6944e81041d1332e2947df79a5e8904b.png6a491dd0c931e739205bc70073ce41e0.png6a824059cb1ab340b94fcf6d9b427682.png6b27ca9daefa306901cee4a0a1e0f698.png6f2ab23ddd47792323242bba11f2ff82.png70e93c66d854d6f1409b2d3d3e04d585.png71469d7d749e7aff6d703044ed5a0487.png717a3d5605630b08571d58fcba30c5fa.png75881e439ce25fbf600c8bab2a9c5868.png75ea638b712211f051f365e9552a55cf.png784763395888b1add20bc03db1e3519f.png7906db31b06b217f7afd9e163edfbc7d.png792cbd0eb067099ad6061f493e70fdf1.png793988c8fa25b79d16ed27823c8c1c3b.png7bfbfc4083407aac71ed8743404b0521.png7cb5ef22507e197449a4a9949fb6db2e.png7d2bd1ed8ce14ee136f94e78e3efbd41.png7dd8a237fc8d58946e1e400fd57aafc8.png7de0c682eac138e69b003be12257f940.png

View File

@ -1,6 +1,6 @@
HANOI challenge
This challenge is based on the contents of the HANOI corpus described in detail below. This is a binary classification challenge: the aim is to classify interpreter notes as either being written by a trainee or a professional. The training split of the dataset consists of 988 training examples in the form of scans of interpreter notes, with 786 of them being made by professionals and 202 by trainees (university students during an interpreting course).
This challenge is based on the contents of the HANOI corpus described in detail below. This is a binary classification challenge: the aim is to classify interpreter notes as either being written by a trainee or a professional. The training split of the dataset consists of 905 training examples in the form of scans of interpreter notes, with 744 of them being made by professionals and 160 by trainees (university students during an interpreting course).
HANOI, or Handwritten Notation of Interpreters, is a corpus of handwritten notes for consecutive interpreting, collected from professional interpreters and interpreting students. It is the only resource of its kind in the world.

View File

Before

(image error) Size: 355 KiB

After

(image error) Size: 355 KiB

View File

Before

(image error) Size: 1.4 MiB

After

(image error) Size: 1.4 MiB

View File

Before

(image error) Size: 954 KiB

After

(image error) Size: 954 KiB

View File

Before

(image error) Size: 839 KiB

After

(image error) Size: 839 KiB

View File

Before

(image error) Size: 574 KiB

After

(image error) Size: 574 KiB

View File

Before

(image error) Size: 413 KiB

After

(image error) Size: 413 KiB

View File

Before

(image error) Size: 1.3 MiB

After

(image error) Size: 1.3 MiB

View File

Before

(image error) Size: 287 KiB

After

(image error) Size: 287 KiB

View File

Before

(image error) Size: 526 KiB

After

(image error) Size: 526 KiB

View File

Before

(image error) Size: 259 KiB

After

(image error) Size: 259 KiB

View File

Before

(image error) Size: 543 KiB

After

(image error) Size: 543 KiB

View File

Before

(image error) Size: 1.6 MiB

After

(image error) Size: 1.6 MiB

View File

Before

(image error) Size: 313 KiB

After

(image error) Size: 313 KiB

View File

Before

(image error) Size: 1.3 MiB

After

(image error) Size: 1.3 MiB

View File

Before

(image error) Size: 393 KiB

After

(image error) Size: 393 KiB

View File

Before

(image error) Size: 464 KiB

After

(image error) Size: 464 KiB

View File

Before

(image error) Size: 467 KiB

After

(image error) Size: 467 KiB

View File

Before

(image error) Size: 593 KiB

After

(image error) Size: 593 KiB

View File

Before

(image error) Size: 681 KiB

After

(image error) Size: 681 KiB

View File

Before

(image error) Size: 579 KiB

After

(image error) Size: 579 KiB

View File

Before

(image error) Size: 503 KiB

After

(image error) Size: 503 KiB

View File

Before

(image error) Size: 1.2 MiB

After

(image error) Size: 1.2 MiB

View File

Before

(image error) Size: 1.6 MiB

After

(image error) Size: 1.6 MiB

View File

Before

(image error) Size: 585 KiB

After

(image error) Size: 585 KiB

View File

Before

(image error) Size: 597 KiB

After

(image error) Size: 597 KiB

View File

Before

(image error) Size: 568 KiB

After

(image error) Size: 568 KiB

View File

Before

(image error) Size: 541 KiB

After

(image error) Size: 541 KiB

View File

Before

(image error) Size: 385 KiB

After

(image error) Size: 385 KiB

View File

Before

(image error) Size: 664 KiB

After

(image error) Size: 664 KiB

View File

Before

(image error) Size: 346 KiB

After

(image error) Size: 346 KiB

View File

Before

(image error) Size: 424 KiB

After

(image error) Size: 424 KiB

View File

Before

(image error) Size: 488 KiB

After

(image error) Size: 488 KiB

View File

Before

(image error) Size: 1.8 MiB

After

(image error) Size: 1.8 MiB

View File

Before

(image error) Size: 444 KiB

After

(image error) Size: 444 KiB

View File

Before

(image error) Size: 415 KiB

After

(image error) Size: 415 KiB

View File

Before

(image error) Size: 425 KiB

After

(image error) Size: 425 KiB

View File

Before

(image error) Size: 469 KiB

After

(image error) Size: 469 KiB

View File

Before

(image error) Size: 555 KiB

After

(image error) Size: 555 KiB

View File

Before

(image error) Size: 506 KiB

After

(image error) Size: 506 KiB

View File

Before

(image error) Size: 208 KiB

After

(image error) Size: 208 KiB

View File

Before

(image error) Size: 420 KiB

After

(image error) Size: 420 KiB

View File

Before

(image error) Size: 801 KiB

After

(image error) Size: 801 KiB

View File

Before

(image error) Size: 509 KiB

After

(image error) Size: 509 KiB

View File

Before

(image error) Size: 654 KiB

After

(image error) Size: 654 KiB

View File

Before

(image error) Size: 394 KiB

After

(image error) Size: 394 KiB

View File

Before

(image error) Size: 452 KiB

After

(image error) Size: 452 KiB

View File

Before

(image error) Size: 584 KiB

After

(image error) Size: 584 KiB

View File

Before

(image error) Size: 737 KiB

After

(image error) Size: 737 KiB

View File

Before

(image error) Size: 529 KiB

After

(image error) Size: 529 KiB

View File

Before

(image error) Size: 589 KiB

After

(image error) Size: 589 KiB

View File

Before

(image error) Size: 749 KiB

After

(image error) Size: 749 KiB

View File

Before

(image error) Size: 622 KiB

After

(image error) Size: 622 KiB

View File

Before

(image error) Size: 411 KiB

After

(image error) Size: 411 KiB

View File

Before

(image error) Size: 1.8 MiB

After

(image error) Size: 1.8 MiB

View File

Before

(image error) Size: 445 KiB

After

(image error) Size: 445 KiB

View File

Before

(image error) Size: 517 KiB

After

(image error) Size: 517 KiB

View File

Before

(image error) Size: 1.4 MiB

After

(image error) Size: 1.4 MiB

View File

Before

(image error) Size: 644 KiB

After

(image error) Size: 644 KiB

View File

Before

(image error) Size: 514 KiB

After

(image error) Size: 514 KiB

View File

Before

(image error) Size: 576 KiB

After

(image error) Size: 576 KiB

View File

Before

(image error) Size: 507 KiB

After

(image error) Size: 507 KiB

View File

Before

(image error) Size: 595 KiB

After

(image error) Size: 595 KiB

View File

Before

(image error) Size: 1.0 MiB

After

(image error) Size: 1.0 MiB

View File

Before

(image error) Size: 394 KiB

After

(image error) Size: 394 KiB

View File

Before

(image error) Size: 535 KiB

After

(image error) Size: 535 KiB

View File

Before

(image error) Size: 335 KiB

After

(image error) Size: 335 KiB

View File

Before

(image error) Size: 366 KiB

After

(image error) Size: 366 KiB

View File

Before

(image error) Size: 235 KiB

After

(image error) Size: 235 KiB

View File

Before

(image error) Size: 565 KiB

After

(image error) Size: 565 KiB

View File

Before

(image error) Size: 644 KiB

After

(image error) Size: 644 KiB

View File

Before

(image error) Size: 234 KiB

After

(image error) Size: 234 KiB

View File

Before

(image error) Size: 2.1 MiB

After

(image error) Size: 2.1 MiB

View File

Before

(image error) Size: 487 KiB

After

(image error) Size: 487 KiB

View File

Before

(image error) Size: 467 KiB

After

(image error) Size: 467 KiB

View File

Before

(image error) Size: 1010 KiB

After

(image error) Size: 1010 KiB

View File

Before

(image error) Size: 920 KiB

After

(image error) Size: 920 KiB

View File

Before

(image error) Size: 560 KiB

After

(image error) Size: 560 KiB

View File

Before

(image error) Size: 1.2 MiB

After

(image error) Size: 1.2 MiB

View File

Before

(image error) Size: 552 KiB

After

(image error) Size: 552 KiB

View File

Before

(image error) Size: 536 KiB

After

(image error) Size: 536 KiB

View File

Before

(image error) Size: 692 KiB

After

(image error) Size: 692 KiB

View File

Before

(image error) Size: 362 KiB

After

(image error) Size: 362 KiB

View File

Before

(image error) Size: 244 KiB

After

(image error) Size: 244 KiB

View File

Before

(image error) Size: 543 KiB

After

(image error) Size: 543 KiB

View File

Before

(image error) Size: 647 KiB

After

(image error) Size: 647 KiB

View File

Before

(image error) Size: 572 KiB

After

(image error) Size: 572 KiB

View File

Before

(image error) Size: 1012 KiB

After

(image error) Size: 1012 KiB

View File

Before

(image error) Size: 278 KiB

After

(image error) Size: 278 KiB

View File

Before

(image error) Size: 583 KiB

After

(image error) Size: 583 KiB

View File

Before

(image error) Size: 582 KiB

After

(image error) Size: 582 KiB

View File

Before

(image error) Size: 600 KiB

After

(image error) Size: 600 KiB

View File

Before

(image error) Size: 454 KiB

After

(image error) Size: 454 KiB

View File

Before

(image error) Size: 625 KiB

After

(image error) Size: 625 KiB

View File

Before

(image error) Size: 494 KiB

After

(image error) Size: 494 KiB

View File

Before

(image error) Size: 598 KiB

After

(image error) Size: 598 KiB

View File

Before

(image error) Size: 760 KiB

After

(image error) Size: 760 KiB

View File

Before

(image error) Size: 1.2 MiB

After

(image error) Size: 1.2 MiB

View File

Before

(image error) Size: 701 KiB

After

(image error) Size: 701 KiB

View File

Before

(image error) Size: 1.0 MiB

After

(image error) Size: 1.0 MiB

Some files were not shown because too many files have changed in this diff Show More