Owen Stephens
722db56071
Add tests for new Cross errors
2019-03-23 14:15:23 +00:00
Antonin Delpeuch
7f6831523e
Merge pull request #1969 from OpenRefine/revert-1888-fix-reconcile-facets
...
Revert "Fix Reconcile facets affected by change to list facet boolean handling"
2019-02-27 10:33:21 +00:00
Antonin Delpeuch
7144798aac
Merge pull request #1967 from OpenRefine/compute_recon_features_bug
...
Fix Recon features computation for empty recons
2019-02-23 19:08:11 +00:00
Antonin Delpeuch
2bfc268e69
Revert "Merge pull request #1666 from ostephens/list-facet-changes"
...
This reverts commit 29a818f7b41189cdb4f9
2019-02-22 18:38:45 +00:00
Antonin Delpeuch
deb7335848
Fix Recon features computation for empty recons
2019-02-22 09:15:42 +00:00
Antonin Delpeuch
a072328637
Accept URIs in 'Use values as ids' operation.
...
Closes #1953 .
2019-02-19 22:06:35 +00:00
Antonin Delpeuch
3a213b482c
Fix failing test
2019-02-19 12:39:50 +00:00
Antonin Delpeuch
fcc6aa05d7
Provide default identifierSpace and schemaSpace for reconciliation services. Closes #1936 .
2019-01-22 19:04:25 +01:00
Antonin Delpeuch
eb16784f01
Merge pull request #1924 from OpenRefine/issue1907
...
Disable DTDs in XML importer.
2019-01-07 14:07:30 +01:00
Antonin Delpeuch
e5da39fa4a
Merge pull request #1920 from OpenRefine/issue1913
...
Reorder reconciliation results by decreasing score
2019-01-06 15:55:51 +01:00
Antonin Delpeuch
6a0d7d56e4
Disable DTDs in XML importer. Closes #1907 .
2018-12-31 16:02:34 +01:00
Antonin Delpeuch
ddd9bf9aa8
Merge pull request #1906 from OpenRefine/issue1893
...
Make clustering extensible
2018-12-31 14:13:46 +01:00
Antonin Delpeuch
79ec6988d6
Fix GetCLusteringFunctionANdDistancesCommandTest
2018-12-30 22:22:50 +01:00
Antonin Delpeuch
074765f816
Add test to ensure sort is stable.
2018-12-30 20:49:18 +01:00
Antonin Delpeuch
b03dbf2446
Reorder reconciliation results by decreasing score. Fixes #1913 .
2018-12-30 20:47:12 +01:00
Jacky
150ee12058
Merge pull request #1902 from OpenRefine/cleanup
...
Tidy up various things
2018-12-11 20:59:50 -05:00
Antonin Delpeuch
8063ca63d9
Add license headers
2018-12-11 12:10:11 +00:00
Antonin Delpeuch
7ae71470ef
Add new command to expose known clustering functions and distances
2018-12-11 10:51:29 +00:00
Jacky
7f7b71459c
Merge pull request #1901 from OpenRefine/issue1840
...
Fix zip slip vulnerability
2018-12-09 12:05:16 -05:00
Antonin Delpeuch
d4222c05ef
Merge pull request #1877 from OpenRefine/issue1876
...
Fix reconciliation result deserialization
2018-12-09 22:47:40 +09:00
Antonin Delpeuch
caf2b4d915
Add missing license headers
2018-12-09 12:22:40 +09:00
Antonin Delpeuch
79994e86da
Create dedicated temporary dir for zip slip test
2018-12-09 11:01:58 +09:00
Antonin Delpeuch
e243e73e40
Fix zip slip vulnerability. Closes #1840 .
2018-12-09 10:41:33 +09:00
jackyq2015
d1ed842f02
support both jdk 8 and 9
2018-12-08 15:31:01 -05:00
Antonin Delpeuch
be137fc53c
Add serialization tests in different timezone
2018-12-06 15:46:20 +09:00
Antonin Delpeuch
44c43253a1
Avoid localizing time for dates with unspecified time. Closes #1874 .
2018-12-02 12:58:05 +09:00
Antonin Delpeuch
82598ae1d5
Fix reconciliation result deserialization. Closes #1876 .
2018-12-02 11:59:47 +09:00
Antonin Delpeuch
2e81c9ff2e
Remove uses of org.json after merge
2018-12-01 05:11:21 +09:00
Antonin Delpeuch
70d0e9b283
Support UI json format for ColumnDetail
2018-11-30 19:39:42 +09:00
Antonin Delpeuch
1e578384e2
Avoid double serialization of json mode in recon config
2018-11-30 19:39:42 +09:00
Antonin Delpeuch
a4117b470c
Remove leftover merge conflicts
2018-11-30 19:39:42 +09:00
Antonin Delpeuch
f667a78657
Migrate recent PRs to Jackson
2018-11-30 19:38:52 +09:00
Antonin Delpeuch
99e98a2e78
Remove all references to org.json in core
2018-11-30 19:38:52 +09:00
Antonin Delpeuch
d6ca879558
Migrate ColumnRenameOperation to Jackson
2018-11-30 19:38:52 +09:00
Antonin Delpeuch
b0e9e21a6b
Remove spurious references to org.json
2018-11-30 19:38:52 +09:00
Antonin Delpeuch
59175daf38
Migrate GuessTypesOfColumnCommand to Jackson
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
ba8e406a97
Clustering config Jackson deserialization
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
d311810c2c
Migrate SortingConfig to Jackson
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
86d1159926
Migrate Engine to Jackson
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
c9786d0f9a
Fix bug in join() GREL function
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
b569490eef
Migrate ProjectMetadata to Jackson
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
6d05631a07
Migrate GREL functions and controls to Jackson
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
5a4a79028f
Revert "data package metadata ( #1398 )"
...
This reverts commit c4b0ff6bea
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
ac444b8b50
Add project metadata serialization test
2018-11-30 19:23:08 +09:00
Antonin Delpeuch
ccb1ac84c1
Migrate GREL AST to Jackson
2018-11-30 19:23:08 +09:00
Antonin Delpeuch
e4e73d0b92
Migrate importers to use Jackson classes
2018-11-30 19:23:08 +09:00
Antonin Delpeuch
fc7da40055
Jackson deserialization for PreferenceStore
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5cf58d874b
Fix deserialization of MassEditOperation
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
2873035ee2
Migrate TabularExporter to use JsonNode
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
52426b98a3
Jackson deserialization for CsvExporter
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d012ea7f8d
Remove reconstruct method on operations
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
6358a4aeb5
Jackson deserialization for TransposeColumnsIntoRowsOperation
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
d493bf0720
Jackson deserialization for MassEditOperation
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
5f671e5e81
Jackson deserialization for sorting Criterion and subclasses
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
242a3abb7d
Jackson deserialization for RowRemovalOperation
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c58854d947
Jackson deserialization for ReconUseValuesAsIdsOperation
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
3271e53ecf
Jackson deserialization for ReconJudgeSimilarCellsOperation
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
eb66619840
Jackson deserialization for ExtendDataOperation
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
393eec1586
Jackson deserialization for EngineConfig
2018-11-30 19:22:21 +09:00
Antonin Delpeuch
ae61368796
Jackson deserialization for TextSearchFacetConfig
2018-11-30 19:21:22 +09:00
Antonin Delpeuch
c4caf1eba7
Jackson deserialization for TimeRangeFacetConfig
2018-11-30 19:21:22 +09:00
Antonin Delpeuch
d8bc841dae
Jackson deserialization for RangeFacetConfig
2018-11-30 19:21:22 +09:00
Antonin Delpeuch
39498233fb
Jackson deserialization for ListFacetConfig
2018-11-30 19:21:22 +09:00
Antonin Delpeuch
d4bdd37bda
Jackson deserialization for Recon
2018-11-30 19:21:22 +09:00
Antonin Delpeuch
487f6bc131
Jackson deserialization for Row
2018-11-30 19:21:21 +09:00
Antonin Delpeuch
0dae0811b0
Jackson deserialization for ReconConfig
2018-11-30 19:21:21 +09:00
Antonin Delpeuch
bc6f1b0146
Fix failing tests after JSONWriter replacement
2018-11-30 19:21:21 +09:00
Antonin Delpeuch
c9620a5d9a
Add missing .flush(); .close() on JsonGenerator
2018-11-30 19:21:21 +09:00
Antonin Delpeuch
fec28b99bc
Various serialization fixes
2018-11-30 19:21:21 +09:00
Antonin Delpeuch
1790799bfe
Remove Jsonizable interface and write methods
2018-11-30 19:21:21 +09:00
Antonin Delpeuch
fd69e4b980
Serialization tests for expression commands
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
65231e2140
Refactor GetRowsCommand for Jackson migration
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
0583ae659d
Make FileProjectManagerTests independent from RefineTest
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
987c2d1c80
Jackson serialization for project managers
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
49b84574da
Move EvalErrorTests
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
7d3af420ce
Jackson serialization for long running processes
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
18c2183cbc
Jackson serialization for preferences
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
418b21dda2
Jackson serialization for history classes
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
aba8cd8430
Jackson serialization for processes
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
cf45f23e1d
Jackson serialization for reconciliation operations
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
8f1c7cc2ab
Jackson serialization for facets
2018-11-30 19:20:34 +09:00
Antonin Delpeuch
1fa101c334
Jackson serialization for the model classes
2018-11-30 19:19:01 +09:00
Antonin Delpeuch
1f40393028
Move SortingConfig to its own file; tests for sorting criteria
2018-11-30 19:19:01 +09:00
Antonin Delpeuch
6daa1b4f5c
Jackson serialization for RowReorderOperation
2018-11-30 19:19:01 +09:00
Antonin Delpeuch
a3bba83c63
Jackson serialization for column operations
2018-11-30 19:19:01 +09:00
Antonin Delpeuch
539585fc5e
Jackson serialization for cell operations
2018-11-30 19:19:01 +09:00
Antonin Delpeuch
e661a647f3
Change isSerializedTo to check for Jackson serialization
2018-11-30 19:14:03 +09:00
jackyq2015
02871e1b6f
fix issue #1802 -- escape single quote in SQL export
2018-11-26 19:40:22 -05:00
Antonin Delpeuch
95d0cf546d
Merge pull request #1845 from ostephens/parseXml
...
Parse xml
2018-11-25 18:44:38 +00:00
Antonin Delpeuch
0d3c7c7af4
Merge pull request #1852 from ostephens/fix-cross
...
Enable Cross to work with non-string wrapped cells
2018-11-24 15:28:05 +00:00
Owen Stephens
04d2e04b4c
Tidy up Cross tests
2018-11-23 13:50:34 +00:00
Owen Stephens
72be6e14a4
Update Cross tests to include tests for Wrapped cells/non-strings
2018-11-22 17:54:14 +00:00
Owen Stephens
2ad0e76aca
Updating tests for List Facets
2018-11-22 13:43:02 +00:00
Owen Stephens
fb8697ef9c
Minor code tidy
2018-11-22 12:36:37 +00:00
Owen Stephens
acea8e5671
Update cache test to ensure correct facet created
2018-11-22 12:36:37 +00:00
Owen Stephens
55e3914c8d
Add test for new List/Text facet behaviour
2018-11-22 12:33:39 +00:00
Owen Stephens
22072c498b
Add tests for grouper for list facet
2018-11-22 12:33:39 +00:00
Owen Stephens
78360f5e0c
Add tests for htmlText and xmlText
2018-11-22 00:38:08 +00:00
Owen Stephens
58352e4e56
Update tests for XML and HTML functions
2018-11-21 15:59:15 +00:00
Owen Stephens
1f023b53af
Remove deprecated HTML functions and tests
2018-11-20 20:21:30 +00:00
Owen Stephens
c4f2ccd353
Extend parseHtml tests
2018-11-20 20:19:46 +00:00
Owen Stephens
e38dcdf7a7
Add intial tests for XML parsing
2018-11-20 20:18:58 +00:00
Owen Stephens
b5355b3c12
Correct typo
2018-11-18 13:12:41 +00:00
Antonin Delpeuch
3431a9ee1e
Merge pull request #1829 from OpenRefine/issue1827
...
Fix issue of empty list facet choices disappearing.
2018-11-17 08:56:41 +00:00
Antonin Delpeuch
0e0dcbafef
Fix issue of empty list facet choices disappearing. Closes #1827 .
2018-11-16 12:52:07 +00:00
Antonin Delpeuch
b85d4d0cb8
Merge pull request #1826 from ostephens/fix-todate
...
Fix toDate
2018-11-16 10:30:56 +00:00
Owen Stephens
8f135eddb8
Add test for parsing a string with a two digit year
2018-11-15 23:47:22 +00:00
Owen Stephens
1627a51075
Reorganises ToDate function, adds tests and fixes #1759
2018-11-15 18:20:55 +00:00
Owen Stephens
cc12098828
Initial attempt to fix toDate function
2018-11-08 09:11:49 +00:00
Antonin Delpeuch
1eb9ef78ef
Fix cell index computation in filldown/blankdown
2018-11-03 17:10:23 +00:00
Owen Stephens
c3e49e79ab
Add support for N-triples and Turtle
2018-10-27 19:04:07 +01:00
Owen Stephens
42e8c86a78
Add support for JSON-LD import
2018-10-27 06:34:33 +01:00
Antonin Delpeuch
47323a9e75
Merge pull request #1736 from OpenRefine/maven2
...
Migrate to Maven, take 2
2018-10-22 14:41:48 +01:00
omkar
f4be9f5fe1
Misc refactoring and made all the tests in the SmartSplitTests class independent by replacing BeforeSuite with BeforeTest
2018-10-15 22:28:30 +05:30
omkar
ca572a6a2d
Added unit tests for smartSplit() function
2018-10-15 20:55:10 +05:30
Antonin Delpeuch
d2edffcef4
Merge pull request #1754 from OpenRefine/issue1596
...
Directly use column as reconciliation results
2018-10-12 11:05:12 +01:00
Antonin Delpeuch
5f551370b3
Tests for UseValuesAsIdentifiers operation
2018-10-02 12:32:30 +01:00
Antonin Delpeuch
22be1ec323
Merge pull request #1731 from xseris/master
...
Custom column names for separator based importer
2018-09-24 08:29:46 +01:00
Antonin Delpeuch
ec3e9ab1e9
Merge pull request #1730 from OpenRefine/json-clustering
...
Refactor clustering serialization in JSON
2018-09-16 18:52:11 +01:00
Antonin Delpeuch
d421fd7fbf
Merge pull request #1729 from OpenRefine/json-engineconfig
...
Store engine configuration in dedicated class
2018-09-16 18:51:41 +01:00
Antonin Delpeuch
782ae4e788
Revert "Revert "Migrate to Maven""
...
This reverts commit c20918b73d
2018-09-16 15:34:47 +01:00
Jacky
c20918b73d
Revert "Migrate to Maven"
2018-09-16 10:16:50 -04:00
Jacky
e3813d9820
Merge pull request #1725 from OpenRefine/maven
...
Migrate to Maven
2018-09-15 21:45:12 -04:00
xseris
31c70be20a
Fixed importing test
2018-09-13 15:12:52 +02:00
xseris
f288bc653e
Added test, changed visualization
2018-09-13 14:45:38 +02:00
Antonin Delpeuch
c9436f563d
Refactor kNNClusterer for serialization
2018-09-10 15:49:59 +01:00
Antonin Delpeuch
31954862e8
Refactor BinningClusterer for JSON serialization
2018-09-10 15:49:52 +01:00
Antonin Delpeuch
5a0304f363
Merge pull request #1722 from OpenRefine/json-testing
...
Add serialization tests for most Jsonizable classes
2018-09-10 15:35:25 +01:00
Antonin Delpeuch
9b54ac2bd2
Remove jars of dependencies
2018-09-10 15:11:21 +01:00
Antonin Delpeuch
07ab7da872
Merge pull request #1697 from OpenRefine/issue1696
...
Clickable URLs in HTML exporter
2018-09-05 14:58:44 +01:00
Antonin Delpeuch
fbc9b27640
Store engine configuration as EngineConfig rather than JSONObject
2018-09-05 14:49:39 +01:00
Antonin Delpeuch
f6256aae62
Fix engineConfig JSON in fetch URLs tests
2018-09-05 12:07:50 +01:00
Antonin Delpeuch
f327b09a59
Reorganize facet parsing and discontinue initializeFromJSON on Facet
2018-09-05 12:03:54 +01:00
Antonin Delpeuch
5b4cab947e
Introduce EngineConfig class to avoid manipulating JSON objects directly
2018-09-05 11:00:20 +01:00
Antonin Delpeuch
7a3d13ef47
Refactor TextSearchFacet for JSON serialization
2018-09-05 10:51:31 +01:00
Antonin Delpeuch
daeb7ab6df
Refactor ScatterplotFacet for JSON serialization
2018-09-05 10:08:53 +01:00
Antonin Delpeuch
1186776235
Refactor TimeRangeFacet for JSON serialization
2018-09-04 18:19:18 +01:00
Antonin Delpeuch
8e8b3c18c5
Refactor RangeFacetTests for serialization
2018-09-04 11:49:48 +01:00
Antonin Delpeuch
497eee5a75
Add serialization tests for ListFacet
2018-09-04 10:09:38 +01:00
Antonin Delpeuch
f6bbb64c98
Fix import errors
2018-09-01 14:55:37 +02:00
Antonin Delpeuch
851d24c39b
Add serialization tests for GREL functions
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
eb0a37a22a
Fix PreferenceStore serialization test
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
802ad77ec5
Add serialization tests for GREL controls
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
326fda7999
Add JSON serialization tests for NominalFacetChoice
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
953a7380fe
Cleanup imports
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
da9978b365
Add serialization tests for preference classes
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
580fd92c10
Add JSON serialization tests for processes
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
debe9bde37
Serialization test for EvalError
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
2dde302a90
Add JSON serialization tests for refine.history and refine.browsing
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
14233b8ea8
Serialization tests for operations.row
2018-09-01 12:42:05 +02:00
Antonin Delpeuch
6ccd8ea9ee
Deserialization test for Denormalize operation
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
73171755f3
More JSON tests for operations
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
4013c0b8c5
Add (de)serialization tests to existing operation test classes
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
dbff74650d
Cleanup imports
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
8896636017
Add deserialization tests for operations
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
2edf83bdf7
Start serialization tests for operations
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
fac8936411
Serialization tests for model classes
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
c6d2b003b1
Start serialization tests
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
d9bff34411
Add testing utilites for JSON serialization
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
2b57350adf
Cleanup StandardReconConfigTests
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
b12b29b393
Rename ReconTests
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
3ea1822773
Remove duplicate test class introduced by Jacky
2018-09-01 12:40:23 +02:00
Antonin Delpeuch
f41678e087
Move tests to their relevant package.
2018-09-01 12:40:22 +02:00
Antonin Delpeuch
94b6b1f945
Merge pull request #1692 from OpenRefine/issue1689
...
Fix exception when sorting the empty string numerically
2018-08-30 08:09:20 +02:00
Jacky
21712db6e0
Merge pull request #1698 from OpenRefine/issue1681
...
Fix unescape GREL function in javascript mode.
2018-08-29 21:24:52 -04:00
Antonin Delpeuch
d01f916101
Remove test assertion that can fail depending on the locale
2018-08-08 11:51:10 +01:00
TonyO
c1af2f1179
fixed issue 1684 with decimal values
2018-08-07 11:25:49 +01:00
Antonin Delpeuch
09bb2903f2
Add test for sorting exception, issue #1689
2018-08-07 11:24:22 +01:00
Antonin Delpeuch
18c489855b
Test for clickable URLs in HTML exporter
2018-08-07 11:23:49 +01:00
Antonin Delpeuch
87b6aadbad
Fix unescape GREL function in javascript mode. Closes #1681 .
2018-08-07 11:23:14 +01:00
Owen Stephens
64ed24e082
Small amount of tidying up code
2018-06-23 00:28:45 +01:00
Owen Stephens
420c9bd1a5
Add tests for grouping of values in text facets
2018-06-23 00:18:00 +01:00
Owen Stephens
d309af7f1a
Update string conversion tests to reflect new behaviour of stringUtils
2018-06-23 00:18:00 +01:00
Owen Stephens
a159e76a62
Added test for reconstructing mass edits on dates
2018-06-23 00:18:00 +01:00
Antonin Delpeuch
9f7d5b8786
Merge pull request #1638 from OpenRefine/issue1637
...
Do not discard the recon space when marking cells as new items.
2018-06-22 12:23:15 +02:00
Jacky
f3dbc18214
Merge pull request #1642 from ostephens/mass-edit-fix
...
Mass edit fix for blanks, numbers and booleans
2018-06-20 22:00:34 -04:00
Antonin Delpeuch
448a969cb1
Merge pull request #1656 from OpenRefine/issue/1648
...
fix the template load issue and package typo
2018-06-17 09:23:52 +01:00
Jacky
5a6c9d72f0
fix the template load issue and package typo
2018-06-16 15:43:29 -04:00
Owen Stephens
5ecb1afe13
Updated toString test to new behaviour for null.toString()
2018-06-14 12:36:01 +01:00
Owen Stephens
92e456d2ff
More tidying of tests
2018-06-08 20:09:29 +01:00
Owen Stephens
2e9708c16d
Tidying up test file
2018-06-08 20:03:38 +01:00
Thad Guidry
057b64fcc2
Increasing to 10 second sleep because of Travis
...
In Travis these tests are occasionally failing https://travis-ci.org/OpenRefine/OpenRefine/jobs/3896227 which is probably due to the CPU demand spike placed with createProcess.
2018-06-08 06:26:08 -05:00
Owen Stephens
97ea151134
Removed date tests
2018-06-08 09:40:50 +01:00
Owen Stephens
256a81e308
Initial MassOperationTests
...
Corrected and expanded tests for ReconstructEdit
Improve tests
2018-06-08 09:40:35 +01:00
Antonin Delpeuch
a63151bbcc
Do not discard the recon space when marking cells as new items.
...
Fixes #1637
2018-06-04 12:16:33 +01:00
Jacky
345be88de8
fix UT testHttpHeaders
2018-05-29 22:43:17 -04:00
Jacky
476ece5a67
Merge pull request #1617 from OpenRefine/issue1600
...
Remove DataExtensions from change serialization
2018-05-24 15:00:34 -04:00
Antonin Delpeuch
d8f081b977
Remove DataExtensions from change serialization
2018-05-22 23:09:51 +02:00
Antonin Delpeuch
b01177c0d9
Merge pull request #1597 from OpenRefine/issue/1588-2
...
unify the internal date type
2018-05-18 22:03:14 +02:00
Owen Stephens
19a134d4ae
Corrected spelling of Calender to Calendar
2018-05-17 10:01:04 +01:00
Jacky
52a2ec05e1
Merge pull request #1598 from ostephens/no-field-null
...
No field null
2018-05-16 16:01:05 -04:00
Jacky
a103e1fb90
merge the translation
2018-05-16 15:40:05 -04:00
Jacky
147616f41c
add more UT for tostring
2018-05-14 22:01:06 -04:00
Jacky
5adb3e455c
fix the date format bug
2018-05-14 21:25:47 -04:00
Jacky
8fe27eff58
use yyyy-mm-dd formatter when converting date to string
2018-05-12 20:19:55 -04:00
Owen Stephens
1e2c0c0a04
Added tests for getting non-existent fields and changed test for parser eval error
2018-05-10 16:37:11 -04:00
Jacky
cf5c884ca0
fix minor issues
2018-05-09 23:15:51 -04:00
Jacky
c1132aa58a
add nano support
2018-05-09 22:57:10 -04:00
Jacky
a53d0970ea
clean up the UT
2018-05-08 22:13:47 -04:00
Jacky
f58d963dbd
Merge branch 'issue/1588' of https://github.com/OpenRefine/OpenRefine into issue/1588-2
2018-05-07 17:26:02 -04:00
Antonin Delpeuch
8c2c4546d4
Merge pull request #1568 from OpenRefine/fix-mark-new-items
...
Fix identifier space for cells reconciled to New
2018-05-06 08:45:25 +02:00
Antonin Delpeuch
b8472cf6b8
Merge pull request #1573 from OpenRefine/issue472
...
Fix FillDown and BlankDown operations on records.
2018-05-06 08:45:01 +02:00
Jacky
19f98b7ea2
java 8 time API migrate
2018-05-05 11:41:40 -04:00
Jacky
6787ab881e
implement nano date part UT
2018-05-02 22:02:57 -04:00
Jacky
34c46111ea
undo the incidently push to master
2018-05-02 21:40:23 -04:00
Jacky
47d6f79e35
implement nano data part
2018-05-02 21:23:17 -04:00
TonyO
0eb7b4082f
added null and default value options
2018-04-26 20:50:46 -05:00
Antonin Delpeuch
1daa4d1312
Fix date parsing.
...
Closes #1564 .
2018-04-22 10:49:22 +02:00
Antonin Delpeuch
53c12ca2df
Fix FillDown and BlankDown operations on records.
...
Closes #472 .
2018-04-21 22:11:54 +02:00
Antonin Delpeuch
716a1606b4
Merge pull request #1558 from gobertm/master
...
Contains function supports now regex as second argument
2018-04-19 10:46:15 +02:00
Maxime Gobert
304f65045b
Contains function tests
2018-04-18 12:17:26 +02:00
Antonin Delpeuch
2b237433f9
Fix identifier space for cells reconciled to New
2018-04-15 01:20:25 +02:00
Jacky
de42f4d85a
migrate from JRDF to JENA library
2018-04-08 22:38:23 -04:00
TonyO
3834c27c8f
SQL Export Code Commit
2018-03-24 22:41:07 -05:00
Antonin Delpeuch
c536584991
Merge pull request #1536 from ostephens/coalesce
...
Add coalesce function
2018-03-18 13:06:52 +00:00
Owen Stephens
6e02baaa8a
Coalesce must have at least two arguments
2018-03-17 16:21:05 +00:00
Owen Stephens
998eefc869
Make codacy happier
2018-03-14 23:59:13 +00:00
Owen Stephens
74a6782ca0
Merge pull request #1524 from OpenRefine/issue/1508
...
support project backward compatibility to old version of OpenRefine
2018-03-07 09:36:13 +00:00
Owen Stephens
01b96a0155
Add coalesce function
2018-03-07 09:10:11 +00:00
Jacky
23ec54b78f
support project backward compatibility to old version of OpenRefine
2018-02-28 20:16:29 -05:00
Jacky
54553da733
Merge pull request #1518 from OpenRefine/issue/1509
...
Fix issue #1509
2018-02-28 19:42:07 -05:00
Jacky
ab26bf4a27
fix issue #1517 , limit is writen as int and should have been read as int
2018-02-25 17:22:34 -05:00
Jacky
73c5c640cc
tidy up import
2018-02-25 15:43:37 -05:00
Jacky
036866837a
add UT for issue #1509
2018-02-25 15:31:59 -05:00
Antonin Delpeuch
3dcb3f1faf
Merge pull request #1515 from ostephens/conversions
...
Conversions
2018-02-22 09:49:49 +00:00
Owen Stephens
2758633f32
Update toDate and toNumber tests to handle null and empty strings correctly
2018-02-21 23:10:38 +00:00
Owen Stephens
731e1310c6
Stripping stuff we don't need out of the tests
2018-02-19 13:42:45 +00:00
Owen Stephens
d2687cc58a
Treat null and empty string as different values when doing transforms
2018-02-18 23:19:28 +00:00
Joanne
e0d87c3d94
Update tests to match updated range function
2018-02-16 15:13:37 +00:00
Joanne
01d8e458f4
Update tests to match updated range function
2018-02-16 15:13:37 +00:00
Joanne
e2793daf54
Update tests for improved range function
2018-02-16 15:13:37 +00:00
Joanne
d95f5985b9
Add tests for range function
2018-02-16 15:13:37 +00:00
Owen Stephens
0d04a25cf1
Merge pull request #1450 from OpenRefine/issue1448
...
Make Wikitext importer more robust
2018-02-07 17:41:23 +00:00
Antonin Delpeuch
f5ff5565ff
Cleanup for Codacy and better parsing of quote character
2018-02-03 16:37:15 +00:00
Antonin Delpeuch
a89bbcbbe2
Add missing method removed during merge
2018-02-03 14:29:24 +00:00
Thad Guidry
c83dbe3b23
Merge branch 'master' into stundzig-develop/1086-quotecharacter
2018-02-03 07:20:45 -06:00
Antonin Delpeuch
c9395d564c
Merge branch 'develop/1086-quotecharacter' of https://github.com/stundzig/OpenRefine into stundzig-develop/1086-quotecharacter
2018-02-03 07:56:30 +00:00
Jacky
c4b0ff6bea
data package metadata ( #1398 )
...
* fix the appbundle issue #1209
* fix #1162
allow the JRE 9
* fix the package declarations
* remove the _ from the method name
* use the explicit scoping
* remote extra ;
* fix issued from codacy
* fix issued from codacy
* add preferences link to the index page
* handle the empty user metadata
* fix 'last modified' sorting issue #1307
* prevent overflow of the table. issue #1306
* add isoDateParser to sort the date
* prevent overflow of the project index
* remove sorter arrow for action columns
* disable editing the internal metadata
* adjust the width of the table
* change MetaData to Metadata
* change the filed name from rowNumber to rowCount
* put back the incidently deleted gitignore
* add double quote to prevent word splitting
* UI improvement on metadata view and project list view
* remove the date field in metadata
* message notification of the free RAM. Issue #1295
* UI tuning for metadata view
* shorten the ISO date to locale date format
* Added translation using Weblate (Portuguese (Brazil))
* remove the rename link
* Ignore empty language files introduced by Weblate
* Add UI for Invert text filter
* Backend support for Inverting Text search facets
* Fix reset on text search facet
* More succinct return statements
* add tests for SetProjectMetadataCommand
* Tidying up for Codacy
* Added Tests for TextSearchFilter
* Corrections for Codacy
* More code tidy up
* let the browser auto fit the table cell when resizing/zooming
* fix import multiple excel with mulitple sheets issue #1328
* check if the project has the userMetadata
* fix the unit test
support multi files with multi tables for open office
* prevent the same key for user metadata
* replace _ with variable for exception
* fix the no-undef issue
* to adjust the width of transform dialog. issue #1332
* fix the row count refresh issue
* extract method
* move the log message
* cosmatic changes for codacy
* fix typo
* bump to version 2.8
* .gitignore is now working
* preview stage won't have the metadata populated, so protect NPE
* Update README.md
No more direct link to the last version tag, which will avoid having to think of updating the readme
* refacotring the ProjectMetadata class
* introduce the IMetadata interface
* create submodule of dataschema
* add back
* setup lib for dataschema; upgrade the apache lang to lang3
* replace escape* functions from apache lang3
* replace the ProjectMetadata with IMetadata interface
* add missing jars
* set the IMetadata a field of Project
* remove PreferenceStore out of Project model
* fix test SetProjectMetadataCommandTests by casting
* introdcue the AbstractMetadata
* introdcue the AbstractMetadata
* reorganize the metadata package
* allow have mulitiple metadata for a project
* support for mulitple metadata format
* remove jdk7 since 'table schema' java implmentation only support jdk8+
* set execute permission for script
* fix the Unit Test after Metadata refactoring
* restore the apache lang2.5 since jetty 6.1.22 depend on it
* add commons lang 2.5 jar
* git submodule add https://github.com/frictionlessdata/datapackage-java
* remove the metadata parameter from the ProjectManager.registerProject method
* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager
* init the Project.metadataMap
* fix Unit Test
* restore the ProjectMetaData map to ProjectManager
* put the ProjectMetaDta in place for ProjectManager and Project object
* check null of singleton instead of create a constructor just for test
* load the data package metadata
* importing data package
* importing data package
* encapsulate the Package class into DataPackageMetadata
* user _ to indicate the class fields
* introduce base URL in order to download the data files
* import data package UI and draft backend
* import data package UI
* fix typo
* download the data set pointed from metadata resource
* save and load the data package metadata
* avoid magic string
* package cleanup
* set the java_version to 1.8
* set the min jdk to 1.8
* add the 3rd party src in the build.xml
* skip the file selection page if only 1 DATA file
* add files structure for json editor
* seperate out the metadata file from the retrival file list
* rename the OKF_METADATA to DATAPACKAGE_METADATA
* clean up
* implement GetMetadateCommand class
* display the metadata in json format
* git submodule update --remote --merge
* adjust the setting after pulling from datapackage origin
* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.
* clean up the weird loop array syntax get complained
* remove the unused constant
* export in data package format
* interface cleanup
* fix UT
* edit the metadata
* add UT for SetMetadataCommand
* fix UT for SetMetadataCommand
* display the data package metadata link on the project index page
* update submodule
* log the exceptions
* Ajv does not work properly, use the back end validation instead
* enable the validation for jsoneditor
* first draft of the data validation
* create a map to hold the constraint and its handler
* rename
* support for minLength and maxLength from spec
* add validate command
* test the opeation instead of validate command
* rename the UT
* format the error message and push to the report
* fix row number
* add resource bundle for validator
* inject the code of the constrains
* make the StrSubstitutor works
* extract the type and format information
* add the customizedFormat to interface to allow format properly
* get rid of magic string
* take care of missing parts of the data package
* implement RequiredConstraint
* patch for number type
* add max/min constraints
* get the constrains directly from field
* implement the PatternConstraint
* suppress warning
* fix the broken UT when expecting 2 digits fraction
* handle the cast and type properly
* fix the missing resource files for data package when run from command line
* use the copy instead of copydir
* add script for appveyor
* update script for appveyor
* do recursive clone
* correct the git url
* fix clone path
* clone folder option does not work
* will put another PR for this. delete for now
* revert the interface method name
* lazy loading the project data
* disable the validate menu for now
* add UT
* assert UTs
* add UT
* fix #1386
* remove import
* test the thread
* Revert "test the thread"
This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.
* fix the URLCachingTest UT
* define the template data package
* tidy up the metadata interface
* check the http response code
* fix the package
* display user friendly message when URL path is not reachable
* populate the data package schema
* Delete hs_err_pid15194.log
* populate data package info
* add username preference and it will be pulled as the creator of the metadata
* undo the project.updateColumnChange() and start to introduce the fields into the existing core model
* tightly integrate the data package metadata
* tightly integrate the data package metadata for project level
* remove the submodule
* move the edit botton
* clean up build
* load the new property
* load the project metadata
* fix issues from codacy
* remove unused fields and annotation
* check the http response code firstly
* import zipped data package
* allow without keywords
* process the zip data package from url
* merge the tags
* check store firstly
* remove the table schema src
* move the json schema files to schema dir
* add comment
* add comment
* remove git moduels
* add incidently deleted file
* fix typo
* remove SetMetadataCommand
* revert change
* merge from master
2018-02-02 13:24:19 +00:00
Antonin Delpeuch
47f44b06c4
Make Codacy happy
2018-02-02 11:57:20 +00:00
Antonin Delpeuch
1f87a26f4c
Include image file names like templates in Wikitable importer
2018-02-02 11:22:15 +00:00
Antonin Delpeuch
843641ca74
Parse headers just like other cells in Wikitable importer
...
This makes the column names a bit less meaningful,
but this is necessary to handle cases where headers
are inserted anywhere in the table.
2018-02-02 10:48:31 +00:00
Antonin Delpeuch
0426704938
Add helper createProjectWithColumns
2018-01-27 13:58:06 +00:00
Antonin Delpeuch
feae25a5ff
Migrate more tests to the createCSVProject helper
2018-01-27 13:45:44 +00:00
Antonin Delpeuch
8f9fc61046
Migrate TextSearchFacetTests.java to use the helpers
2018-01-27 13:45:44 +00:00
Antonin Delpeuch
5278e929a2
Refactor CrossFunctionTests' project creating logic into RefineTest
2018-01-27 13:45:44 +00:00
Owen Stephens
4320ef8c10
Resolved merge conflict
2018-01-16 17:41:56 +00:00
Owen Stephens
5acdb1429c
Fix tests - Include new httpHeaders JSON array when creating new ColumnAdditionByFetchingURLsOperation
2018-01-16 17:22:48 +00:00
Jacky
3c25647f05
add find function. issue 1296
2018-01-14 22:04:26 -05:00
Olle Jonsson
76fa942490
Nobel prize winners CSV data typos
2018-01-07 21:28:07 +01:00
Antonin Delpeuch
45ccd0e1c0
Change HTTP error detection in URL fetching test
2018-01-03 22:44:32 +01:00
Antonin Delpeuch
dae4ac1ce4
Simpler way to pass the test when there are 503 errors
2018-01-03 19:03:26 +01:00
Antonin Delpeuch
32b7d2fa74
Looser check for 403 and 503 errors in URL caching test
2018-01-03 18:57:34 +01:00
Antonin Delpeuch
f14543bfca
Fix URL caching test on Appveyor
2018-01-03 18:52:12 +01:00
Antonin Delpeuch
94b9d57528
Merge pull request #1397 from tiagofernandez/save-import-options
...
Revert 278f24c10001d9f7#1387 )
2017-12-27 09:44:19 +01:00
Tiago Fernandez
00faf2a179
Revert 278f24c1 and adapt 0001d9f7 (ref. PR #1387 )
2017-12-24 12:48:23 +01:00
Jacky
e5709efd46
fix issue #1341
2017-12-24 00:04:16 -05:00
Jacky
fb3620b3d9
Merge pull request #1388 from jackyq2015/issue/1386
...
Fix Issue #1386
2017-12-21 08:26:29 -05:00
Jacky
6c06424183
Merge pull request #1390 from jackyq2015/issue/1389
...
fix Issue #1389
2017-12-21 08:26:09 -05:00
Jacky
9107a0eb91
remove commented code
2017-12-21 08:24:29 -05:00
Jacky
e1a494aabd
remove the print
2017-12-21 08:22:44 -05:00
Jacky
cd770aed25
revert unecessary changes
2017-12-20 18:52:53 -05:00
Jacky
2f050322b5
use join not sleep
2017-12-20 08:35:31 -05:00
Tiago Fernandez
0001d9f7b2
Test ImportingUtilities.createProjectMetadata()
2017-12-20 11:07:36 +01:00
Jacky
834b6c493c
check isDone
2017-12-19 22:20:11 -05:00
Jacky
3fa994739a
check isDone
2017-12-19 22:09:52 -05:00
Jacky
cce3ab6240
fix issue #1389
2017-12-19 21:00:03 -05:00
jackyq2015
136eba52df
add missing import
2017-12-19 15:28:34 -05:00
jackyq2015
cb55b68449
add missing import
2017-12-19 15:23:39 -05:00
jackyq2015
81043e58e2
fix #1386
2017-12-19 12:54:26 -05:00
Jacky
d207c74f62
merge from master
2017-12-15 22:06:30 -05:00
Antonin Delpeuch
3c5a9b0754
Merge pull request #1357 from xseris/master
...
Tag system
2017-12-16 01:55:46 +00:00
Jacky
2afdcbf546
fix issue https://github.com/jackyq2015/OpenRefine/issues/2
2017-12-15 16:37:38 -05:00
Jacky
0258dc1787
fix issue #1383 . use the localDateTime for project info
2017-12-15 15:24:09 -05:00
xseris
ee8ed8f563
Refresh tag cell
2017-12-08 00:46:59 +01:00
xseris
b16941777e
Modified tags in metadata dialog and moved column right to name
2017-12-07 23:45:36 +01:00
xseris
f21230804b
Fixed Mockito tests
2017-12-01 17:00:45 +01:00
Owen Stephens
93431daecf
Remove unused variable
2017-11-29 09:47:03 +00:00
Owen Stephens
0b433fc5ec
Updated copyright statement
2017-11-29 00:59:49 +00:00
Owen Stephens
d64dee71dd
Extended tests and code for user friendly regular expression syntax errors
2017-11-28 16:20:24 +00:00
Owen Stephens
441d9f7f10
Initial tests and code for user friendly regular expression syntax errors
2017-11-24 18:24:16 +00:00
Thad Guidry
34f38ccaf8
Merge pull request #1336 from ostephens/multi-cell-join-tests
...
Add tests for JoinMultiValuedCells
2017-11-16 22:49:03 -06:00
Jacky
8d2c8b521b
Merge pull request #1334 from jackyq2015/issue/1328
...
fix import multiple excel with mulitple sheets issue #1328
2017-11-16 21:30:24 -05:00
Jacky
1d2998f374
fix the unit test
...
support multi files with multi tables for open office
2017-11-16 10:29:16 -05:00
Owen Stephens
df920777ac
Moved variable to local scope
2017-11-16 12:47:05 +00:00
Antonin Delpeuch
78b7f01be5
Merge pull request #1327 from ostephens/invert-filter
...
Invert text search facet/text filter
2017-11-16 08:05:31 +00:00
Owen Stephens
742b42ade1
More code tidy up
2017-11-15 19:01:52 +00:00
Owen Stephens
2d0f48e93f
Corrections for Codacy
2017-11-15 18:51:58 +00:00
Owen Stephens
3a31e69c2b
Added Tests for TextSearchFilter
2017-11-15 18:31:55 +00:00
Qi Cui
6bdba6948e
add tests for SetProjectMetadataCommand
2017-11-14 15:54:22 -05:00
Jacky
75b82106b4
fix the package declarations
2017-11-03 17:11:31 -04:00
Thad Guidry
d72a2de348
Revert "Extend cross() function to support multiple-value-cell-input"
2017-10-26 17:37:10 -05:00
Thad Guidry
3d0e96a0ce
Merge pull request #1290 from claussni/cross-func-split
...
Extend cross() function to support multiple-value-cell-input
2017-10-26 14:23:23 -05:00
Ralf Claussnitzer
0b107ec5e9
Add optional 4th parameter to cross() function
...
The cross function now accepts a 4th parameter defining a regular
expression separator for splitting multi-value field values when joining
projects.
See https://github.com/OpenRefine/OpenRefine/issues/1204#issuecomment-326320954
2017-10-26 19:50:02 +02:00
Owen Stephens
c10f72437f
Add tests for JoinMultiValuedCells
2017-10-25 11:15:59 +01:00
Antonin Delpeuch
88b10a2917
Merge pull request #1278 from ostephens/cell-split-regex
...
Cell split regex
2017-10-25 11:04:33 +01:00
Owen Stephens
300edcca74
Minor fix to comment in code
2017-10-24 08:58:32 +01:00
Owen Stephens
219e747147
Removed unused dependency
2017-10-24 08:54:58 +01:00
Owen Stephens
209500bf3a
Add tests for SplitMulitValuedCells
2017-10-24 08:29:00 +01:00
Owen Stephens
bb6b3d6c29
Re-locate operations tests in correct folder
2017-10-23 18:54:59 +01:00
Antonin Delpeuch
e2a22a6994
Forbid pipe characters in URL references to ease parsing.
...
This is a temporary fix before we do full Wikitext parsing inside references
(this needs a change upstream). See https://github.com/sweble/sweble-wikitext/issues/67 .
2017-10-20 15:32:58 +01:00
