Commit Graph

1039 Commits

Author SHA1 Message Date
Antonin Delpeuch
057e59aa41
Merge pull request #2011 from ostephens/poi-update
Fix XLSX import and export
2019-04-14 20:52:28 +01:00
Owen Stephens
30019338f1 Return format, not MIME type from FormatGuesser 2019-04-10 11:25:33 +01:00
Owen Stephens
e2aa929908 Ensure workbooks are closed after reading/writing 2019-04-09 15:02:10 +01:00
Owen Stephens
0217595275 FileMagic requires a stream that supports mark 2019-04-09 13:47:08 +01:00
Owen Stephens
6e26162619 Update to using latest version of POI 2019-04-09 12:55:23 +01:00
Owen Stephens
a881dc80aa Don't write Booleans and Numbers as strings in Cell serialisation 2019-04-04 11:42:01 +01:00
Owen Stephens
7425418011 Add RandomNumber GREL function 2019-03-24 20:16:43 +00:00
Owen Stephens
fe6abedc52 Add inArray function to GREL 2019-03-24 19:50:25 +00:00
Antonin Delpeuch
5c44acc0b3
Merge pull request #1985 from ostephens/cross-error-reporting
Cross error reporting
2019-03-24 08:16:58 +00:00
Owen Stephens
3e01c15c37 Throw JoinException if attempt to join with non-existent column 2019-03-23 14:15:00 +00:00
Owen Stephens
ae5f72a8df Refactor cross function to be more robust & improve diagnostics on fail 2019-03-17 13:14:58 +00:00
Owen Stephens
ff888d239b Added new exception class 2019-03-17 13:11:26 +00:00
Antonin Delpeuch
465b025ace Fix ReconStats computation data extension operation 2019-03-05 09:32:36 +00:00
Antonin Delpeuch
2a92726294 Set version to 3.2-beta 2019-03-01 10:55:42 +00:00
Antonin Delpeuch
7f6831523e
Merge pull request #1969 from OpenRefine/revert-1888-fix-reconcile-facets
Revert "Fix Reconcile facets affected by change to list facet boolean handling"
2019-02-27 10:33:21 +00:00
Antonin Delpeuch
7144798aac
Merge pull request #1967 from OpenRefine/compute_recon_features_bug
Fix Recon features computation for empty recons
2019-02-23 19:08:11 +00:00
Antonin Delpeuch
2bfc268e69 Revert "Merge pull request #1666 from ostephens/list-facet-changes"
This reverts commit 29a818f7b4, reversing
changes made to 1189cdb4f9.
2019-02-22 18:38:45 +00:00
Antonin Delpeuch
deb7335848 Fix Recon features computation for empty recons 2019-02-22 09:15:42 +00:00
Antonin Delpeuch
a072328637 Accept URIs in 'Use values as ids' operation.
Closes #1953.
2019-02-19 22:06:35 +00:00
Antonin Delpeuch
fcc6aa05d7 Provide default identifierSpace and schemaSpace for reconciliation services. Closes #1936. 2019-01-22 19:04:25 +01:00
Antonin Delpeuch
6dd9f41639
Merge pull request #1925 from OpenRefine/issue1887
Compute reconciliation features when creating new items
2019-01-10 04:44:45 +01:00
Antonin Delpeuch
1ed2da338c
Merge pull request #1921 from OpenRefine/phonetic_clustering
Sample extension to add some clustering methods
2019-01-10 04:44:24 +01:00
Antonin Delpeuch
eb16784f01
Merge pull request #1924 from OpenRefine/issue1907
Disable DTDs in XML importer.
2019-01-07 14:07:30 +01:00
Antonin Delpeuch
e5da39fa4a
Merge pull request #1920 from OpenRefine/issue1913
Reorder reconciliation results by decreasing score
2019-01-06 15:55:51 +01:00
Antonin Delpeuch
b1a84da1da Recompute features when creating new items. Closes #1887. 2018-12-31 17:38:19 +01:00
Antonin Delpeuch
4b3e5c02a1 Refactor feature computation in StandardReconConfig 2018-12-31 16:19:28 +01:00
Antonin Delpeuch
6a0d7d56e4 Disable DTDs in XML importer. Closes #1907. 2018-12-31 16:02:34 +01:00
Antonin Delpeuch
ddd9bf9aa8
Merge pull request #1906 from OpenRefine/issue1893
Make clustering extensible
2018-12-31 14:13:46 +01:00
Antonin Delpeuch
4984837c9f Update XLS exporter to Apache POI 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
d0eff4c5a8 Update Apache POI to 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
626c17c649 Disable keyers that are super-seeded by others. 2018-12-30 21:20:17 +01:00
Antonin Delpeuch
b03dbf2446 Reorder reconciliation results by decreasing score. Fixes #1913. 2018-12-30 20:47:12 +01:00
Jacky
150ee12058
Merge pull request #1902 from OpenRefine/cleanup
Tidy up various things
2018-12-11 20:59:50 -05:00
Antonin Delpeuch
8063ca63d9 Add license headers 2018-12-11 12:10:11 +00:00
Antonin Delpeuch
a57082ef3e Hook the new command to the UI to expose all clusterers 2018-12-11 11:59:37 +00:00
Antonin Delpeuch
7ae71470ef Add new command to expose known clustering functions and distances 2018-12-11 10:51:29 +00:00
Antonin Delpeuch
d9af48a49a Expose own interface for similarity distances, isolating from Vicino 2018-12-11 09:57:26 +00:00
Antonin Delpeuch
72d76ee22a Separate distance and keyer registration in dedicated factories 2018-12-11 09:27:04 +00:00
Jacky
7f7b71459c
Merge pull request #1901 from OpenRefine/issue1840
Fix zip slip vulnerability
2018-12-09 12:05:16 -05:00
Antonin Delpeuch
d4222c05ef
Merge pull request #1877 from OpenRefine/issue1876
Fix reconciliation result deserialization
2018-12-09 22:47:40 +09:00
Antonin Delpeuch
caf2b4d915 Add missing license headers 2018-12-09 12:22:40 +09:00
Antonin Delpeuch
98bd03e5f4 Reorganize Java imports 2018-12-09 11:19:39 +09:00
Antonin Delpeuch
e243e73e40 Fix zip slip vulnerability. Closes #1840. 2018-12-09 10:41:33 +09:00
Antonin Delpeuch
db3a878c78 Remove spurious println 2018-12-08 18:17:03 +09:00
Antonin Delpeuch
cf58092f2d Fix stringToLocalDate for non-GMT timezones 2018-12-02 17:09:03 +09:00
Antonin Delpeuch
44c43253a1 Avoid localizing time for dates with unspecified time. Closes #1874. 2018-12-02 12:58:05 +09:00
Antonin Delpeuch
82598ae1d5 Fix reconciliation result deserialization. Closes #1876. 2018-12-02 11:59:47 +09:00
Antonin Delpeuch
2e81c9ff2e Remove uses of org.json after merge 2018-12-01 05:11:21 +09:00
Antonin Delpeuch
292700c6f4 Fix import error 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
70d0e9b283 Support UI json format for ColumnDetail 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
1e578384e2 Avoid double serialization of json mode in recon config 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
121661e8eb Let OverlayModels access the Project at deserialization time 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
99e98a2e78 Remove all references to org.json in core 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
d6ca879558 Migrate ColumnRenameOperation to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
7ea346d08e Migrate ReconciledDataExtensionJob to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
6ba3969d98 Remove spurious references to org.json 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
f08f488006 Migrate ColumnSplitChange to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
fa8e7d0e50 Remove temporary wrapping in PreferenceStore 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
0a6b28eb2b Remove spurious JSONException in TemplatingExporter 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c0d1a39991 Migrate CustomizableTabularExporterUtilities to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
256a0bd83c Remove unused JSObject 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c98ae0dcf6 Migrate PreviewExtendDataCommand to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c80001a642 Migrate SplitColumnCommand to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
83331da8e1 Make ReconResult static 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
b0e9e21a6b Remove spurious references to org.json 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
a76d88122a Migrate ApplyOperationsCommand 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
377b051bac Migrate language commands to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
e0caf3f723 Migrate GetVersionCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
59175daf38 Migrate GuessTypesOfColumnCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
772ee1ee59 Migrate StandardReconConfig to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
ba8e406a97 Clustering config Jackson deserialization 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
d26d7b4a42 Migrate GetScatterPlotCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
b88fd2b895 Migrate SplitMultiValueCellsCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
d311810c2c Migrate SortingConfig to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
25aa076836 Remove more spurious JSONException uses 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
472dc7f2ac Migrate PreviewExpressionCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f48cdb0c13 Remove spurious JSONExceptions 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
0d14df1427 Jackson deserialization for HistoryEntry 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
86d1159926 Migrate Engine to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f02b3edd0b Remove unnecessary reference to JSONException in TextSearchFacet 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
c9786d0f9a Fix bug in join() GREL function 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f3f6a2846b Migrate RowFilters to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
b569490eef Migrate ProjectMetadata to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
6d05631a07 Migrate GREL functions and controls to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
5a4a79028f Revert "data package metadata (#1398)"
This reverts commit c4b0ff6bea.
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
62190d36c0 Start to migrate ProjectMetadata to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
4a067cb110 Migrate FileProjectManager to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
ccb1ac84c1 Migrate GREL AST to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
bca832ed03 Enable legacy JSON parsing for compatibility with tests 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
cb2bbbf801 Cleanup 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
e4e73d0b92 Migrate importers to use Jackson classes 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
9cab735dfc Add common interface for preference values 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
fc7da40055 Jackson deserialization for PreferenceStore 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5cf58d874b Fix deserialization of MassEditOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2873035ee2 Migrate TabularExporter to use JsonNode 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
52426b98a3 Jackson deserialization for CsvExporter 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
59f322d607 Remove AbstractOperation.reconstruct 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d012ea7f8d Remove reconstruct method on operations 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
ebcc7b51b5 Add OperationResolver 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2ef955f24b Jackson deserialization for AbstractOperation 2018-11-30 19:22:21 +09:00