Commit Graph

1108 Commits

Author SHA1 Message Date
Antonin Delpeuch
bbb5766a33
Merge pull request #2155 from OpenRefine/issue-2152-lonely-clusters
Fix clusters with single candidates.
2019-09-18 19:08:18 +01:00
Antonin Delpeuch
36150a874d Fix scatterplot facet filtering 2019-09-12 11:52:28 +01:00
Antonin Delpeuch
573ba18e6d Fix scatterplot drawing command, closes #2117 2019-09-12 10:43:12 +01:00
Antonin Delpeuch
95b063162d Fix clusters with single candidates. Closes #2152. 2019-09-11 12:12:32 +01:00
Antonin Delpeuch
8ab7653e0b Set version to 3.3-SNAPSHOT 2019-07-26 15:52:00 +01:00
Antonin Delpeuch
e3417bff49 Set version to 3.2 2019-07-26 15:29:57 +01:00
Owen Stephens
ac7b5a0a19 Update Find and Tests 2019-07-21 13:34:18 +01:00
Owen Stephens
d6999de0da Match only accepts regular expressions 2019-07-21 13:19:34 +01:00
Antonin Delpeuch
33ff7be18a Fix NPE in StandardReconConfig. Closes #2076. 2019-07-03 10:21:45 +02:00
Antonin Delpeuch
cde59a0dca
Merge pull request #2070 from OpenRefine/issue-2068-duplicate-json-key
Remove duplicate JSON keys.
2019-07-02 10:19:16 +02:00
Antonin Delpeuch
8390d234b1
Merge pull request #2058 from OpenRefine/issue-1994-customMetadata
Fix parsing and display of custom metadata
2019-06-14 14:53:19 +01:00
Antonin Delpeuch
9d76b04a1c Remove duplicate JSON keys. Closes #2068. 2019-06-14 11:38:24 +01:00
Antonin Delpeuch
ad9566502f
Merge pull request #2059 from OpenRefine/issue-1989-filenotfound
Disable error message when workspace.json does not exist.
2019-06-06 20:57:31 +01:00
Antonin Delpeuch
afb787c845 Disable error message when workspace.json does not exist. Fixes #1989 2019-06-06 17:33:04 +01:00
Krzysztof 'impune-pl' Prorok
ae2f44f9d5 Fixed: issue 1998 2019-06-04 17:01:25 +02:00
Antonin Delpeuch
b9573d83e0 Add customMetadata to project metadata parsing test 2019-06-04 12:02:49 +01:00
s_tanaka
b8b9feac0c Fix column removal in reorder leaves undeleted hidden cells. 2019-05-15 19:37:40 +09:00
Antonin Delpeuch
edfa7d8445 Skip unknown operations in ApplyOperationsCommand 2019-04-19 11:25:01 +01:00
Antonin Delpeuch
0332be312f Fix JSON history corruption.
Also adds new logic to preserve the JSON representation of unknown operations,
to protect from version downgrading or removal of extensions.

Closes #1990.
2019-04-18 20:31:41 +01:00
Antonin Delpeuch
057e59aa41
Merge pull request #2011 from ostephens/poi-update
Fix XLSX import and export
2019-04-14 20:52:28 +01:00
Owen Stephens
30019338f1 Return format, not MIME type from FormatGuesser 2019-04-10 11:25:33 +01:00
Owen Stephens
e2aa929908 Ensure workbooks are closed after reading/writing 2019-04-09 15:02:10 +01:00
Owen Stephens
0217595275 FileMagic requires a stream that supports mark 2019-04-09 13:47:08 +01:00
Owen Stephens
6e26162619 Update to using latest version of POI 2019-04-09 12:55:23 +01:00
Owen Stephens
a881dc80aa Don't write Booleans and Numbers as strings in Cell serialisation 2019-04-04 11:42:01 +01:00
Owen Stephens
7425418011 Add RandomNumber GREL function 2019-03-24 20:16:43 +00:00
Owen Stephens
fe6abedc52 Add inArray function to GREL 2019-03-24 19:50:25 +00:00
Antonin Delpeuch
5c44acc0b3
Merge pull request #1985 from ostephens/cross-error-reporting
Cross error reporting
2019-03-24 08:16:58 +00:00
Owen Stephens
3e01c15c37 Throw JoinException if attempt to join with non-existent column 2019-03-23 14:15:00 +00:00
Owen Stephens
ae5f72a8df Refactor cross function to be more robust & improve diagnostics on fail 2019-03-17 13:14:58 +00:00
Owen Stephens
ff888d239b Added new exception class 2019-03-17 13:11:26 +00:00
Antonin Delpeuch
465b025ace Fix ReconStats computation data extension operation 2019-03-05 09:32:36 +00:00
Antonin Delpeuch
2a92726294 Set version to 3.2-beta 2019-03-01 10:55:42 +00:00
Antonin Delpeuch
7f6831523e
Merge pull request #1969 from OpenRefine/revert-1888-fix-reconcile-facets
Revert "Fix Reconcile facets affected by change to list facet boolean handling"
2019-02-27 10:33:21 +00:00
Antonin Delpeuch
7144798aac
Merge pull request #1967 from OpenRefine/compute_recon_features_bug
Fix Recon features computation for empty recons
2019-02-23 19:08:11 +00:00
Antonin Delpeuch
2bfc268e69 Revert "Merge pull request #1666 from ostephens/list-facet-changes"
This reverts commit 29a818f7b4, reversing
changes made to 1189cdb4f9.
2019-02-22 18:38:45 +00:00
Antonin Delpeuch
deb7335848 Fix Recon features computation for empty recons 2019-02-22 09:15:42 +00:00
Antonin Delpeuch
a072328637 Accept URIs in 'Use values as ids' operation.
Closes #1953.
2019-02-19 22:06:35 +00:00
Antonin Delpeuch
fcc6aa05d7 Provide default identifierSpace and schemaSpace for reconciliation services. Closes #1936. 2019-01-22 19:04:25 +01:00
Antonin Delpeuch
6dd9f41639
Merge pull request #1925 from OpenRefine/issue1887
Compute reconciliation features when creating new items
2019-01-10 04:44:45 +01:00
Antonin Delpeuch
1ed2da338c
Merge pull request #1921 from OpenRefine/phonetic_clustering
Sample extension to add some clustering methods
2019-01-10 04:44:24 +01:00
Antonin Delpeuch
eb16784f01
Merge pull request #1924 from OpenRefine/issue1907
Disable DTDs in XML importer.
2019-01-07 14:07:30 +01:00
Antonin Delpeuch
e5da39fa4a
Merge pull request #1920 from OpenRefine/issue1913
Reorder reconciliation results by decreasing score
2019-01-06 15:55:51 +01:00
Antonin Delpeuch
b1a84da1da Recompute features when creating new items. Closes #1887. 2018-12-31 17:38:19 +01:00
Antonin Delpeuch
4b3e5c02a1 Refactor feature computation in StandardReconConfig 2018-12-31 16:19:28 +01:00
Antonin Delpeuch
6a0d7d56e4 Disable DTDs in XML importer. Closes #1907. 2018-12-31 16:02:34 +01:00
Antonin Delpeuch
ddd9bf9aa8
Merge pull request #1906 from OpenRefine/issue1893
Make clustering extensible
2018-12-31 14:13:46 +01:00
Antonin Delpeuch
4984837c9f Update XLS exporter to Apache POI 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
d0eff4c5a8 Update Apache POI to 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
626c17c649 Disable keyers that are super-seeded by others. 2018-12-30 21:20:17 +01:00
Antonin Delpeuch
b03dbf2446 Reorder reconciliation results by decreasing score. Fixes #1913. 2018-12-30 20:47:12 +01:00
Jacky
150ee12058
Merge pull request #1902 from OpenRefine/cleanup
Tidy up various things
2018-12-11 20:59:50 -05:00
Antonin Delpeuch
8063ca63d9 Add license headers 2018-12-11 12:10:11 +00:00
Antonin Delpeuch
a57082ef3e Hook the new command to the UI to expose all clusterers 2018-12-11 11:59:37 +00:00
Antonin Delpeuch
7ae71470ef Add new command to expose known clustering functions and distances 2018-12-11 10:51:29 +00:00
Antonin Delpeuch
d9af48a49a Expose own interface for similarity distances, isolating from Vicino 2018-12-11 09:57:26 +00:00
Antonin Delpeuch
72d76ee22a Separate distance and keyer registration in dedicated factories 2018-12-11 09:27:04 +00:00
Jacky
7f7b71459c
Merge pull request #1901 from OpenRefine/issue1840
Fix zip slip vulnerability
2018-12-09 12:05:16 -05:00
Antonin Delpeuch
d4222c05ef
Merge pull request #1877 from OpenRefine/issue1876
Fix reconciliation result deserialization
2018-12-09 22:47:40 +09:00
Antonin Delpeuch
caf2b4d915 Add missing license headers 2018-12-09 12:22:40 +09:00
Antonin Delpeuch
98bd03e5f4 Reorganize Java imports 2018-12-09 11:19:39 +09:00
Antonin Delpeuch
e243e73e40 Fix zip slip vulnerability. Closes #1840. 2018-12-09 10:41:33 +09:00
Antonin Delpeuch
db3a878c78 Remove spurious println 2018-12-08 18:17:03 +09:00
Antonin Delpeuch
cf58092f2d Fix stringToLocalDate for non-GMT timezones 2018-12-02 17:09:03 +09:00
Antonin Delpeuch
44c43253a1 Avoid localizing time for dates with unspecified time. Closes #1874. 2018-12-02 12:58:05 +09:00
Antonin Delpeuch
82598ae1d5 Fix reconciliation result deserialization. Closes #1876. 2018-12-02 11:59:47 +09:00
Antonin Delpeuch
2e81c9ff2e Remove uses of org.json after merge 2018-12-01 05:11:21 +09:00
Antonin Delpeuch
292700c6f4 Fix import error 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
70d0e9b283 Support UI json format for ColumnDetail 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
1e578384e2 Avoid double serialization of json mode in recon config 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
121661e8eb Let OverlayModels access the Project at deserialization time 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
99e98a2e78 Remove all references to org.json in core 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
d6ca879558 Migrate ColumnRenameOperation to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
7ea346d08e Migrate ReconciledDataExtensionJob to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
6ba3969d98 Remove spurious references to org.json 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
f08f488006 Migrate ColumnSplitChange to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
fa8e7d0e50 Remove temporary wrapping in PreferenceStore 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
0a6b28eb2b Remove spurious JSONException in TemplatingExporter 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c0d1a39991 Migrate CustomizableTabularExporterUtilities to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
256a0bd83c Remove unused JSObject 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c98ae0dcf6 Migrate PreviewExtendDataCommand to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
c80001a642 Migrate SplitColumnCommand to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
83331da8e1 Make ReconResult static 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
b0e9e21a6b Remove spurious references to org.json 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
a76d88122a Migrate ApplyOperationsCommand 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
377b051bac Migrate language commands to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
e0caf3f723 Migrate GetVersionCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
59175daf38 Migrate GuessTypesOfColumnCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
772ee1ee59 Migrate StandardReconConfig to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
ba8e406a97 Clustering config Jackson deserialization 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
d26d7b4a42 Migrate GetScatterPlotCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
b88fd2b895 Migrate SplitMultiValueCellsCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
d311810c2c Migrate SortingConfig to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
25aa076836 Remove more spurious JSONException uses 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
472dc7f2ac Migrate PreviewExpressionCommand to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f48cdb0c13 Remove spurious JSONExceptions 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
0d14df1427 Jackson deserialization for HistoryEntry 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
86d1159926 Migrate Engine to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f02b3edd0b Remove unnecessary reference to JSONException in TextSearchFacet 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
c9786d0f9a Fix bug in join() GREL function 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
f3f6a2846b Migrate RowFilters to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
b569490eef Migrate ProjectMetadata to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
6d05631a07 Migrate GREL functions and controls to Jackson 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
5a4a79028f Revert "data package metadata (#1398)"
This reverts commit c4b0ff6bea.
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
62190d36c0 Start to migrate ProjectMetadata to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
4a067cb110 Migrate FileProjectManager to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
ccb1ac84c1 Migrate GREL AST to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
bca832ed03 Enable legacy JSON parsing for compatibility with tests 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
cb2bbbf801 Cleanup 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
e4e73d0b92 Migrate importers to use Jackson classes 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
9cab735dfc Add common interface for preference values 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
fc7da40055 Jackson deserialization for PreferenceStore 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5cf58d874b Fix deserialization of MassEditOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2873035ee2 Migrate TabularExporter to use JsonNode 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
52426b98a3 Jackson deserialization for CsvExporter 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
59f322d607 Remove AbstractOperation.reconstruct 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d012ea7f8d Remove reconstruct method on operations 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
ebcc7b51b5 Add OperationResolver 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2ef955f24b Jackson deserialization for AbstractOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
8f9004f7ee Jackson deserialization for TransposeRowsIntoColumnsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
6358a4aeb5 Jackson deserialization for TransposeColumnsIntoRowsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
8647e3d586 Jackson deserialization for TextTransformOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
6ad6b45048 Jackson deserialization for MultiValuedCellSplitOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d493bf0720 Jackson deserialization for MassEditOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
50ee6ecc61 Jackson deserialization for KeyValueColumnizeOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0cf8c2dd04 Jackson deserialization for MultiValuedCellJoinOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
379a12d349 Jackson deserialization for FillDownOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3aa4e1a544 Jackson deserialization for BlankDownOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
eb49db31e2 Jackson deserialization for ColumnSplitOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
332132d720 Jackson deserialization for ColumnReorderOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
a05b1bcad3 Jackson deserialization for ColumnRemovalOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
9af5b0a877 Jackson deserialization for ColumnMoveOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
99852a193c Jackson deserialization for ColumnAdditionOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
a07f825aad Jackson deserialization for ColumnAdditionByFetchingURLsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0c87687e92 Jackson deserialization for RowStarOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c4429cbdff Jackson deserialization for RowReorderOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5f671e5e81 Jackson deserialization for sorting Criterion and subclasses 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
242a3abb7d Jackson deserialization for RowRemovalOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5f19628618 Jackson deserialization for RowFlagOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3b9fd23b9c Jackson deserialization for DenormalizeOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c58854d947 Jackson deserialization for ReconUseValuesAsIdsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0a5ea4e3dd Jackson deserialization for ReconOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
08c2b8fb2b Jackson deserialization for ReconMatchSpecificTopicOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
fb584e0b5f Jackson deserialization for ReconMatchBestCandidatesOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d908635c1f Jackson deserialization for ReconMarkNewTopicsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3271e53ecf Jackson deserialization for ReconJudgeSimilarCellsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
408703f13c Jackson deserialization for ReconDiscardJudgmentsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
e40d68afaf Jackson deserialization for ReconCopyAcrossColumnsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
f573f37a97 Jackson deserialization for ReconClearSimilarCellsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
eb66619840 Jackson deserialization for ExtendDataOperation 2018-11-30 19:22:21 +09:00