Commit Graph

121 Commits

Author SHA1 Message Date
Tom Morris
1849e62234
Better error handling for reconciliation process - fixes #2590 (#2671)
* Harden reconciliation - Fixes #2590

- check for non-JSON / unparseable JSON returns
- handle malformed results response with no name for candidates
- catch any Exception, not just IOExceptions
- call processManager.onFailedProcess() for cleanup on error

* Add default constructor for Jackson

Jackson complains about needing a default constructor for the
NON_DEFAULT annotation, but I'm not sure why this worked before.

* Clean up indentation and unused variable - no functional changes

Make indentation consistent throughout the module, changing recently
added lines to use the standard all spaces convention.

Remove unused count variable

* Simplify control flow

* Update limit parameter comment. No functional change.

* Replace ternary expression which is causing NPE

* Add reconciliation tests using mock HTTP server
2020-06-23 21:54:54 +02:00
Tom Morris
749704518c
Use Apache HTTP Commons for Fetch URL (#2692)
* Use mockwebserver instead of live network for tests

Fixes #2680. Fixes #1904.

* Remove use of deprecated methods

* Convert to use Apache HTTP Components client library

Fixes #1410 by virtue of redirect following being a built-in
capability of the library, along with retries with binary backoff,
built-in decompression, etc.

* Address review comments
2020-06-16 09:38:06 +02:00
Lisa Chandra
947356ddad
[FEAT]Adds new options for split (#2471)
* added options ui

* added definition for both separators

* added tests

* removed definitions from backend and added them to frontend

* added reverse order and handling for accented characters

* added tests for accented characters and reverse split

* fixed build errors

* unicode character ranges instead

* added examples
2020-06-15 19:30:18 +02:00
chuhao zeng
70b4c6a6d0
Enable gzip compression (#2475)
* Enable gzip compression

* Add test for gzip parser
2020-03-26 08:42:55 +01:00
viniciusbds
496f1fd2d0 Fix bug when accessing empty list 2019-10-02 08:56:22 -03:00
Antonin Delpeuch
0332be312f Fix JSON history corruption.
Also adds new logic to preserve the JSON representation of unknown operations,
to protect from version downgrading or removal of extensions.

Closes #1990.
2019-04-18 20:31:41 +01:00
Antonin Delpeuch
a072328637 Accept URIs in 'Use values as ids' operation.
Closes #1953.
2019-02-19 22:06:35 +00:00
Antonin Delpeuch
caf2b4d915 Add missing license headers 2018-12-09 12:22:40 +09:00
Antonin Delpeuch
98bd03e5f4 Reorganize Java imports 2018-12-09 11:19:39 +09:00
Antonin Delpeuch
d6ca879558 Migrate ColumnRenameOperation to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
f48cdb0c13 Remove spurious JSONExceptions 2018-11-30 19:35:31 +09:00
Antonin Delpeuch
5a4a79028f Revert "data package metadata (#1398)"
This reverts commit c4b0ff6bea.
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
e4e73d0b92 Migrate importers to use Jackson classes 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
5cf58d874b Fix deserialization of MassEditOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
59f322d607 Remove AbstractOperation.reconstruct 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d012ea7f8d Remove reconstruct method on operations 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2ef955f24b Jackson deserialization for AbstractOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
8f9004f7ee Jackson deserialization for TransposeRowsIntoColumnsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
6358a4aeb5 Jackson deserialization for TransposeColumnsIntoRowsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
8647e3d586 Jackson deserialization for TextTransformOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
6ad6b45048 Jackson deserialization for MultiValuedCellSplitOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d493bf0720 Jackson deserialization for MassEditOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
50ee6ecc61 Jackson deserialization for KeyValueColumnizeOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0cf8c2dd04 Jackson deserialization for MultiValuedCellJoinOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
379a12d349 Jackson deserialization for FillDownOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3aa4e1a544 Jackson deserialization for BlankDownOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
eb49db31e2 Jackson deserialization for ColumnSplitOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
332132d720 Jackson deserialization for ColumnReorderOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
a05b1bcad3 Jackson deserialization for ColumnRemovalOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
9af5b0a877 Jackson deserialization for ColumnMoveOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
99852a193c Jackson deserialization for ColumnAdditionOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
a07f825aad Jackson deserialization for ColumnAdditionByFetchingURLsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0c87687e92 Jackson deserialization for RowStarOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c4429cbdff Jackson deserialization for RowReorderOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
242a3abb7d Jackson deserialization for RowRemovalOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5f19628618 Jackson deserialization for RowFlagOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3b9fd23b9c Jackson deserialization for DenormalizeOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c58854d947 Jackson deserialization for ReconUseValuesAsIdsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0a5ea4e3dd Jackson deserialization for ReconOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
08c2b8fb2b Jackson deserialization for ReconMatchSpecificTopicOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
fb584e0b5f Jackson deserialization for ReconMatchBestCandidatesOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d908635c1f Jackson deserialization for ReconMarkNewTopicsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3271e53ecf Jackson deserialization for ReconJudgeSimilarCellsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
408703f13c Jackson deserialization for ReconDiscardJudgmentsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
e40d68afaf Jackson deserialization for ReconCopyAcrossColumnsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
f573f37a97 Jackson deserialization for ReconClearSimilarCellsOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
eb66619840 Jackson deserialization for ExtendDataOperation 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
0dae0811b0 Jackson deserialization for ReconConfig 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
8b41c4e08a Merge Jsonizable removal with master 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
fec28b99bc Various serialization fixes 2018-11-30 19:21:21 +09:00