RandomSec/OpenRefine/main/tests/data/euc-jp.txt

mixi(<28>ߥ<EFBFBD><DFA5><EFBFBD><EFBFBD><EFBFBD>)<29>ϡ<EFBFBD>ͧ<EFBFBD>͡<EFBFBD><CDA1>οͤȤΥ<C8A4><CEA5>ߥ<EFBFBD><DFA5>˥<EFBFBD><CBA5><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>򤵤<EFBFBD><F2A4B5A4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>˳ڤ<CBB3><DAA4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>SNS<4E>Ȥ<EFBFBD><C8A4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ӥ<EFBFBD><D3A5>Ǥ<EFBFBD><C7A4><EFBFBD>
ͧ<EFBFBD>ͤȥ<EFBFBD><EFBFBD>ߥ<EFBFBD><EFBFBD>˥<EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ڤ<EFBFBD><EFBFBD>⤦<EFBFBD><EFBFBD>
mixi(<28>ߥ<EFBFBD><DFA5><EFBFBD><EFBFBD><EFBFBD>)<29>ϡ<EFBFBD><CFA1><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>̿<EFBFBD><CCBF><EFBFBD>ͭ<EFBFBD><CDAD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ġ<EFBFBD><C4A1><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ܤΥ<DCA4><CEA5>ץ<EFBFBD><D7A5>ʤɡ<CAA4><C9A1><EFBFBD><EFBFBD>ޤ<EFBFBD><DEA4>ޤʥ<DEA4><CAA5><EFBFBD><EFBFBD>ӥ<EFBFBD><D3A5><EFBFBD>ͧ<EFBFBD>͡<EFBFBD><CDA1>οͤȤΥ<C8A4><CEA5>ߥ<EFBFBD><DFA5>˥<EFBFBD><CBA5><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>򤵤<EFBFBD><F2A4B5A4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>˳ڤ<CBB3><DAA4><EFBFBD><EFBFBD><EFBFBD><EFBFBD>롢<EFBFBD><EBA1A2><EFBFBD>ܺ<EFBFBD><DCBA>絬<EFBFBD>ϤΥ<CFA4><CEA5><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>롦<EFBFBD>ͥåȥ<C8A5><EFA1BC><EFBFBD>󥰥<EFBFBD><F3A5B0A5><EFBFBD><EFBFBD>ӥ<EFBFBD><D3A5>Ǥ<EFBFBD><C7A4><EFBFBD>
-												Restore character encoding guesser (#2755)

* Fixes #486. Builds on code from Steffen Stundzig

- Switch from ICU4J to juniversalchardet
  (Java port of Mozilla charset detector)
- Replace org.json code with Jackson
- Add tests
- Add TODO for multi-file character encoding mismatches

* Restore dependency lost in rebase

Co-authored-by: Steffen Stundzig <git@stundzig.de>
											
										
										
											2020-06-22 06:04:51 +02:00
+								mixi(<28>ߥ<EFBFBD><DFA5><EFBFBD><EFBFBD><EFBFBD>)<29>ϡ<EFBFBD>ͧ<EFBFBD>͡<EFBFBD><CDA1>οͤȤΥ<C8A4><CEA5>ߥ<EFBFBD><DFA5>˥<EFBFBD><CBA5><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>򤵤<EFBFBD><F2A4B5A4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>˳ڤ<CBB3><DAA4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>SNS<4E>Ȥ<EFBFBD><C8A4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ӥ<EFBFBD><D3A5>Ǥ<EFBFBD><C7A4><EFBFBD>
 								ͧ<EFBFBD>ͤȥ<EFBFBD><EFBFBD>ߥ<EFBFBD><EFBFBD>˥<EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ڤ<EFBFBD><EFBFBD>⤦<EFBFBD><EFBFBD>
 								mixi(<28>ߥ<EFBFBD><DFA5><EFBFBD><EFBFBD><EFBFBD>)<29>ϡ<EFBFBD><CFA1><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>̿<EFBFBD><CCBF><EFBFBD>ͭ<EFBFBD><CDAD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ġ<EFBFBD><C4A1><EFBFBD><EFBFBD><EFBFBD><EFBFBD>ܤΥ<DCA4><CEA5>ץ<EFBFBD><D7A5>ʤɡ<CAA4><C9A1><EFBFBD><EFBFBD>ޤ<EFBFBD><DEA4>ޤʥ<DEA4><CAA5><EFBFBD><EFBFBD>ӥ<EFBFBD><D3A5><EFBFBD>ͧ<EFBFBD>͡<EFBFBD><CDA1>οͤȤΥ<C8A4><CEA5>ߥ<EFBFBD><DFA5>˥<EFBFBD><CBA5><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>򤵤<EFBFBD><F2A4B5A4><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>˳ڤ<CBB3><DAA4><EFBFBD><EFBFBD><EFBFBD><EFBFBD>롢<EFBFBD><EBA1A2><EFBFBD>ܺ<EFBFBD><DCBA>絬<EFBFBD>ϤΥ<CFA4><CEA5><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>롦<EFBFBD>ͥåȥ<C8A5><EFA1BC><EFBFBD>󥰥<EFBFBD><F3A5B0A5><EFBFBD><EFBFBD>ӥ<EFBFBD><D3A5>Ǥ<EFBFBD><C7A4><EFBFBD>