Commit Graph

2106 Commits

Author SHA1 Message Date
Antonin Delpeuch
e8f132bf68 Update commons-fileupload. Closes #1922. 2018-12-31 15:40:43 +01:00
Antonin Delpeuch
ddd9bf9aa8
Merge pull request #1906 from OpenRefine/issue1893
Make clustering extensible
2018-12-31 14:13:46 +01:00
Antonin Delpeuch
4984837c9f Update XLS exporter to Apache POI 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
d0eff4c5a8 Update Apache POI to 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
79ec6988d6 Fix GetCLusteringFunctionANdDistancesCommandTest 2018-12-30 22:22:50 +01:00
Antonin Delpeuch
626c17c649 Disable keyers that are super-seeded by others. 2018-12-30 21:20:17 +01:00
Antonin Delpeuch
074765f816 Add test to ensure sort is stable. 2018-12-30 20:49:18 +01:00
Antonin Delpeuch
b03dbf2446 Reorder reconciliation results by decreasing score. Fixes #1913. 2018-12-30 20:47:12 +01:00
Hosted Weblate
434c14a50a
Merge branch 'origin/master' into Weblate. 2018-12-30 11:38:51 +01:00
Antonin Delpeuch
234ca8486a
Merge pull request #1889 from OpenRefine/issue1882
Update Butterfly to 1.0.2.
2018-12-30 11:38:36 +01:00
Isao Matsunami
e0a07d2480
Translated using Weblate (Japanese)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2018-12-16 03:09:16 +01:00
Luca Martinelli
0203a9b8ef
Translated using Weblate (Italian)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/it/
2018-12-16 03:09:15 +01:00
ssantos
074a80b297
Translated using Weblate (German)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
2018-12-16 03:09:14 +01:00
Antonin Delpeuch
9656ea3f8c
Merge pull request #1903 from ostephens/replace-smart-quotes
Add Common transform which replaces smart quotes with ascii equivalent
2018-12-12 12:09:49 +00:00
Jacky
150ee12058
Merge pull request #1902 from OpenRefine/cleanup
Tidy up various things
2018-12-11 20:59:50 -05:00
Antonin Delpeuch
22cf0517b9 Better fallback for non-localized keyers and distances 2018-12-11 12:16:58 +00:00
Antonin Delpeuch
8063ca63d9 Add license headers 2018-12-11 12:10:11 +00:00
Antonin Delpeuch
a57082ef3e Hook the new command to the UI to expose all clusterers 2018-12-11 11:59:37 +00:00
Antonin Delpeuch
7ae71470ef Add new command to expose known clustering functions and distances 2018-12-11 10:51:29 +00:00
Antonin Delpeuch
d9af48a49a Expose own interface for similarity distances, isolating from Vicino 2018-12-11 09:57:26 +00:00
Antonin Delpeuch
72d76ee22a Separate distance and keyer registration in dedicated factories 2018-12-11 09:27:04 +00:00
Jacky
7f7b71459c
Merge pull request #1901 from OpenRefine/issue1840
Fix zip slip vulnerability
2018-12-09 12:05:16 -05:00
Hosted Weblate
20c86cdd5c
Merge branch 'origin/master' into Weblate. 2018-12-09 14:47:43 +01:00
Antonin Delpeuch
d4222c05ef
Merge pull request #1877 from OpenRefine/issue1876
Fix reconciliation result deserialization
2018-12-09 22:47:40 +09:00
Hosted Weblate
84f3b0e793
Merge branch 'origin/master' into Weblate. 2018-12-09 14:47:26 +01:00
Owen Stephens
700850a5f7 Add Common transform which replaces smart quotes with ascii equivalent 2018-12-09 11:03:11 +00:00
Antonin Delpeuch
caf2b4d915 Add missing license headers 2018-12-09 12:22:40 +09:00
Antonin Delpeuch
98bd03e5f4 Reorganize Java imports 2018-12-09 11:19:39 +09:00
Antonin Delpeuch
79994e86da Create dedicated temporary dir for zip slip test 2018-12-09 11:01:58 +09:00
jackyq2015
a8cf844f9c fix issue #1900 2018-12-08 20:57:16 -05:00
Antonin Delpeuch
e243e73e40 Fix zip slip vulnerability. Closes #1840. 2018-12-09 10:41:33 +09:00
jackyq2015
d1ed842f02 support both jdk 8 and 9 2018-12-08 15:31:01 -05:00
Antonin Delpeuch
db3a878c78 Remove spurious println 2018-12-08 18:17:03 +09:00
Allan Nordhøy
833198e3cd
Translated using Weblate (Norwegian Bokmål)
Currently translated at 47.7% (339 of 710 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nb_NO/
2018-12-07 17:54:31 +01:00
Antonin Delpeuch
5421a23fba
Merge pull request #1880 from OpenRefine/issue1874
Avoid localizing time for dates with unspecified time.
2018-12-06 23:01:46 +09:00
Antonin Delpeuch
be137fc53c Add serialization tests in different timezone 2018-12-06 15:46:20 +09:00
Hosted Weblate
9dcf1d9ed1
Merge branch 'origin/master' into Weblate 2018-12-06 05:19:36 +01:00
Isao Matsunami
3b4c66f788
Translated using Weblate (Japanese)
Currently translated at 99.9% (709 of 710 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2018-12-06 05:19:35 +01:00
Dan Gillean
bc80c3f534
Translated using Weblate (French)
Currently translated at 99.6% (707 of 710 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2018-12-06 05:19:34 +01:00
Owen Stephens
3ad4cca83a
Translated using Weblate (English)
Currently translated at 100.0% (710 of 710 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/en/
2018-12-06 05:19:34 +01:00
Antonin Delpeuch
a7c68f06ec Update Butterfly to 1.0.2. Closes #1882. 2018-12-06 12:24:32 +09:00
Owen Stephens
8e247b83e0 Fix Reconcile facets affected by change to list facet boolean handling 2018-12-05 15:22:28 +00:00
J. Evan Ottinger
5ea6a2a5fe
Translated using Weblate (Arabic)
Currently translated at 4.5% (32 of 710 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ar/
2018-12-03 17:25:16 +01:00
Antonin Delpeuch
cf58092f2d Fix stringToLocalDate for non-GMT timezones 2018-12-02 17:09:03 +09:00
Antonin Delpeuch
44c43253a1 Avoid localizing time for dates with unspecified time. Closes #1874. 2018-12-02 12:58:05 +09:00
Antonin Delpeuch
82598ae1d5 Fix reconciliation result deserialization. Closes #1876. 2018-12-02 11:59:47 +09:00
Antonin Delpeuch
5639f1b2f1
Merge pull request #1755 from OpenRefine/jackson-serialization
Jackson serialization
2018-12-01 23:56:50 +00:00
Antonin Delpeuch
1939af343d Update to Jackson 2.9.7 2018-12-01 22:30:30 +00:00
Antonin Delpeuch
2e81c9ff2e Remove uses of org.json after merge 2018-12-01 05:11:21 +09:00
Myoung Seok Lee
26f3673d89
Translated using Weblate (Korean)
Currently translated at 7.2% (51 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ko/
2018-11-30 20:38:20 +01:00
ssantos
aca8d7a684
Translated using Weblate (German)
Currently translated at 99.9% (710 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
2018-11-30 20:38:16 +01:00
Myoung Seok Lee
99ea5cf5c2
Translated using Weblate (English)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/en/
2018-11-30 20:38:15 +01:00
Myoung Seok Lee
f62900da0a
Added translation using Weblate (Korean) 2018-11-30 17:33:22 +01:00
Flavio Pompermaier
3e47ca8010
Translated using Weblate (Italian)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/it/
2018-11-30 17:08:47 +01:00
Antonin Delpeuch
292700c6f4 Fix import error 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
70d0e9b283 Support UI json format for ColumnDetail 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
1e578384e2 Avoid double serialization of json mode in recon config 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
a4117b470c Remove leftover merge conflicts 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
f667a78657 Migrate recent PRs to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
5f86798377 Remove org.json dependency in Maven configuration 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
121661e8eb Let OverlayModels access the Project at deserialization time 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
99e98a2e78 Remove all references to org.json in core 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
d6ca879558 Migrate ColumnRenameOperation to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
7ea346d08e Migrate ReconciledDataExtensionJob to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
6ba3969d98 Remove spurious references to org.json 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
f08f488006 Migrate ColumnSplitChange to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
fa8e7d0e50 Remove temporary wrapping in PreferenceStore 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
0a6b28eb2b Remove spurious JSONException in TemplatingExporter 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c0d1a39991 Migrate CustomizableTabularExporterUtilities to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
256a0bd83c Remove unused JSObject 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c98ae0dcf6 Migrate PreviewExtendDataCommand to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c80001a642 Migrate SplitColumnCommand to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
83331da8e1 Make ReconResult static 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
b0e9e21a6b Remove spurious references to org.json 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
a76d88122a Migrate ApplyOperationsCommand 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
377b051bac Migrate language commands to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
e0caf3f723 Migrate GetVersionCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
59175daf38 Migrate GuessTypesOfColumnCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
772ee1ee59 Migrate StandardReconConfig to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
ba8e406a97 Clustering config Jackson deserialization 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
d26d7b4a42 Migrate GetScatterPlotCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
b88fd2b895 Migrate SplitMultiValueCellsCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
d311810c2c Migrate SortingConfig to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
25aa076836 Remove more spurious JSONException uses 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
472dc7f2ac Migrate PreviewExpressionCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f48cdb0c13 Remove spurious JSONExceptions 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
0d14df1427 Jackson deserialization for HistoryEntry 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
86d1159926 Migrate Engine to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f02b3edd0b Remove unnecessary reference to JSONException in TextSearchFacet 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
c9786d0f9a Fix bug in join() GREL function 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f3f6a2846b Migrate RowFilters to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
2c5607b9fa Add missing dependencies after removal of datapackage libs 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
b569490eef Migrate ProjectMetadata to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
55dc752144 Remove datapackage libs from Maven config 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
6d05631a07 Migrate GREL functions and controls to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
5a4a79028f Revert "data package metadata (#1398)"
This reverts commit c4b0ff6bea.
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
ac444b8b50 Add project metadata serialization test 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
62190d36c0 Start to migrate ProjectMetadata to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
4a067cb110 Migrate FileProjectManager to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
ccb1ac84c1 Migrate GREL AST to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
bca832ed03 Enable legacy JSON parsing for compatibility with tests 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
cb2bbbf801 Cleanup 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
e4e73d0b92 Migrate importers to use Jackson classes 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
9cab735dfc Add common interface for preference values 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
fc7da40055 Jackson deserialization for PreferenceStore 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5cf58d874b Fix deserialization of MassEditOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2873035ee2 Migrate TabularExporter to use JsonNode 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
52426b98a3 Jackson deserialization for CsvExporter 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
59f322d607 Remove AbstractOperation.reconstruct 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d012ea7f8d Remove reconstruct method on operations 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
ebcc7b51b5 Add OperationResolver 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2ef955f24b Jackson deserialization for AbstractOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
8f9004f7ee Jackson deserialization for TransposeRowsIntoColumnsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
6358a4aeb5 Jackson deserialization for TransposeColumnsIntoRowsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
8647e3d586 Jackson deserialization for TextTransformOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
6ad6b45048 Jackson deserialization for MultiValuedCellSplitOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d493bf0720 Jackson deserialization for MassEditOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
50ee6ecc61 Jackson deserialization for KeyValueColumnizeOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0cf8c2dd04 Jackson deserialization for MultiValuedCellJoinOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
379a12d349 Jackson deserialization for FillDownOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3aa4e1a544 Jackson deserialization for BlankDownOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
eb49db31e2 Jackson deserialization for ColumnSplitOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
332132d720 Jackson deserialization for ColumnReorderOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
a05b1bcad3 Jackson deserialization for ColumnRemovalOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
9af5b0a877 Jackson deserialization for ColumnMoveOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
99852a193c Jackson deserialization for ColumnAdditionOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
a07f825aad Jackson deserialization for ColumnAdditionByFetchingURLsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0c87687e92 Jackson deserialization for RowStarOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c4429cbdff Jackson deserialization for RowReorderOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5f671e5e81 Jackson deserialization for sorting Criterion and subclasses 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
242a3abb7d Jackson deserialization for RowRemovalOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5f19628618 Jackson deserialization for RowFlagOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3b9fd23b9c Jackson deserialization for DenormalizeOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c58854d947 Jackson deserialization for ReconUseValuesAsIdsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0a5ea4e3dd Jackson deserialization for ReconOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
08c2b8fb2b Jackson deserialization for ReconMatchSpecificTopicOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
fb584e0b5f Jackson deserialization for ReconMatchBestCandidatesOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d908635c1f Jackson deserialization for ReconMarkNewTopicsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3271e53ecf Jackson deserialization for ReconJudgeSimilarCellsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
408703f13c Jackson deserialization for ReconDiscardJudgmentsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
e40d68afaf Jackson deserialization for ReconCopyAcrossColumnsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
f573f37a97 Jackson deserialization for ReconClearSimilarCellsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
eb66619840 Jackson deserialization for ExtendDataOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
393eec1586 Jackson deserialization for EngineConfig 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
ae61368796 Jackson deserialization for TextSearchFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
c4caf1eba7 Jackson deserialization for TimeRangeFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
e11145ce0d Jackson deserialization for ScatterplotFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
d8bc841dae Jackson deserialization for RangeFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
39498233fb Jackson deserialization for ListFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
121dd76fa1 Jackson deserialization for DecoratedValue 2018-11-30 19:21:22 +09:00