s434730/RandomSec
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
5,671 Commits 6 Branches 0 Tags 1.3 GiB
c5f3d700a3
Commit Graph

632 Commits

Author SHA1 Message Date
Antonin Delpeuch
8f1c7cc2ab Jackson serialization for facets 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
1fa101c334 Jackson serialization for the model classes 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
1f40393028 Move SortingConfig to its own file; tests for sorting criteria 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
6daa1b4f5c Jackson serialization for RowReorderOperation 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
a3bba83c63 Jackson serialization for column operations 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
539585fc5e Jackson serialization for cell operations 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
e661a647f3 Change isSerializedTo to check for Jackson serialization 2018-11-30 19:14:03 +09:00
jackyq2015
02871e1b6f fix issue #1802 -- escape single quote in SQL export 2018-11-26 19:40:22 -05:00
Antonin Delpeuch
95d0cf546d
Merge pull request #1845 from ostephens/parseXml 
Parse xml
 2018-11-25 18:44:38 +00:00
Antonin Delpeuch
0d3c7c7af4
Merge pull request #1852 from ostephens/fix-cross 
Enable Cross to work with non-string wrapped cells
 2018-11-24 15:28:05 +00:00
Owen Stephens
04d2e04b4c Tidy up Cross tests 2018-11-23 13:50:34 +00:00
Owen Stephens
72be6e14a4 Update Cross tests to include tests for Wrapped cells/non-strings 2018-11-22 17:54:14 +00:00
Owen Stephens
2ad0e76aca Updating tests for List Facets 2018-11-22 13:43:02 +00:00
Owen Stephens
fb8697ef9c Minor code tidy 2018-11-22 12:36:37 +00:00
Owen Stephens
acea8e5671 Update cache test to ensure correct facet created 2018-11-22 12:36:37 +00:00
Owen Stephens
55e3914c8d Add test for new List/Text facet behaviour 2018-11-22 12:33:39 +00:00
Owen Stephens
22072c498b Add tests for grouper for list facet 2018-11-22 12:33:39 +00:00
Owen Stephens
78360f5e0c Add tests for htmlText and xmlText 2018-11-22 00:38:08 +00:00
Owen Stephens
58352e4e56 Update tests for XML and HTML functions 2018-11-21 15:59:15 +00:00
Owen Stephens
1f023b53af Remove deprecated HTML functions and tests 2018-11-20 20:21:30 +00:00
Owen Stephens
c4f2ccd353 Extend parseHtml tests 2018-11-20 20:19:46 +00:00
Owen Stephens
e38dcdf7a7 Add intial tests for XML parsing 2018-11-20 20:18:58 +00:00
Owen Stephens
b5355b3c12 Correct typo 2018-11-18 13:12:41 +00:00
Antonin Delpeuch
3431a9ee1e
Merge pull request #1829 from OpenRefine/issue1827 
Fix issue of empty list facet choices disappearing.
 2018-11-17 08:56:41 +00:00
Antonin Delpeuch
0e0dcbafef Fix issue of empty list facet choices disappearing. Closes #1827. 2018-11-16 12:52:07 +00:00
Antonin Delpeuch
b85d4d0cb8
Merge pull request #1826 from ostephens/fix-todate 
Fix toDate
 2018-11-16 10:30:56 +00:00
Owen Stephens
8f135eddb8 Add test for parsing a string with a two digit year 2018-11-15 23:47:22 +00:00
Owen Stephens
1627a51075 Reorganises ToDate function, adds tests and fixes #1759 2018-11-15 18:20:55 +00:00
Owen Stephens
cc12098828 Initial attempt to fix toDate function 2018-11-08 09:11:49 +00:00
Antonin Delpeuch
1eb9ef78ef Fix cell index computation in filldown/blankdown 2018-11-03 17:10:23 +00:00
Owen Stephens
c3e49e79ab Add support for N-triples and Turtle 2018-10-27 19:04:07 +01:00
Owen Stephens
42e8c86a78 Add support for JSON-LD import 2018-10-27 06:34:33 +01:00
Antonin Delpeuch
47323a9e75
Merge pull request #1736 from OpenRefine/maven2 
Migrate to Maven, take 2
 2018-10-22 14:41:48 +01:00
omkar
f4be9f5fe1 Misc refactoring and made all the tests in the SmartSplitTests class independent by replacing BeforeSuite with BeforeTest 2018-10-15 22:28:30 +05:30
omkar
ca572a6a2d Added unit tests for smartSplit() function 2018-10-15 20:55:10 +05:30
Antonin Delpeuch
d2edffcef4
Merge pull request #1754 from OpenRefine/issue1596 
Directly use column as reconciliation results
 2018-10-12 11:05:12 +01:00
Antonin Delpeuch
5f551370b3 Tests for UseValuesAsIdentifiers operation 2018-10-02 12:32:30 +01:00
Antonin Delpeuch
22be1ec323
Merge pull request #1731 from xseris/master 
Custom column names for separator based importer
 2018-09-24 08:29:46 +01:00
Antonin Delpeuch
ec3e9ab1e9
Merge pull request #1730 from OpenRefine/json-clustering 
Refactor clustering serialization in JSON
 2018-09-16 18:52:11 +01:00
Antonin Delpeuch
d421fd7fbf
Merge pull request #1729 from OpenRefine/json-engineconfig 
Store engine configuration in dedicated class
 2018-09-16 18:51:41 +01:00
Antonin Delpeuch
782ae4e788 Revert "Revert "Migrate to Maven"" 
This reverts commit c20918b73d.
 2018-09-16 15:34:47 +01:00
Jacky
c20918b73d
Revert "Migrate to Maven" 2018-09-16 10:16:50 -04:00
Jacky
e3813d9820
Merge pull request #1725 from OpenRefine/maven 
Migrate to Maven
 2018-09-15 21:45:12 -04:00
xseris
31c70be20a Fixed importing test 2018-09-13 15:12:52 +02:00
xseris
f288bc653e Added test, changed visualization 2018-09-13 14:45:38 +02:00
Antonin Delpeuch
c9436f563d Refactor kNNClusterer for serialization 2018-09-10 15:49:59 +01:00
Antonin Delpeuch
31954862e8 Refactor BinningClusterer for JSON serialization 2018-09-10 15:49:52 +01:00
Antonin Delpeuch
5a0304f363
Merge pull request #1722 from OpenRefine/json-testing 
Add serialization tests for most Jsonizable classes
 2018-09-10 15:35:25 +01:00
Antonin Delpeuch
9b54ac2bd2 Remove jars of dependencies 2018-09-10 15:11:21 +01:00
Antonin Delpeuch
07ab7da872
Merge pull request #1697 from OpenRefine/issue1696 
Clickable URLs in HTML exporter
 2018-09-05 14:58:44 +01:00
Antonin Delpeuch
fbc9b27640 Store engine configuration as EngineConfig rather than JSONObject 2018-09-05 14:49:39 +01:00
Antonin Delpeuch
f6256aae62 Fix engineConfig JSON in fetch URLs tests 2018-09-05 12:07:50 +01:00
Antonin Delpeuch
f327b09a59 Reorganize facet parsing and discontinue initializeFromJSON on Facet 2018-09-05 12:03:54 +01:00
Antonin Delpeuch
5b4cab947e Introduce EngineConfig class to avoid manipulating JSON objects directly 2018-09-05 11:00:20 +01:00
Antonin Delpeuch
7a3d13ef47 Refactor TextSearchFacet for JSON serialization 2018-09-05 10:51:31 +01:00
Antonin Delpeuch
daeb7ab6df Refactor ScatterplotFacet for JSON serialization 2018-09-05 10:08:53 +01:00
Antonin Delpeuch
1186776235 Refactor TimeRangeFacet for JSON serialization 2018-09-04 18:19:18 +01:00
Antonin Delpeuch
8e8b3c18c5 Refactor RangeFacetTests for serialization 2018-09-04 11:49:48 +01:00
Antonin Delpeuch
497eee5a75 Add serialization tests for ListFacet 2018-09-04 10:09:38 +01:00
Antonin Delpeuch
f6bbb64c98 Fix import errors 2018-09-01 14:55:37 +02:00
Antonin Delpeuch
851d24c39b Add serialization tests for GREL functions 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
eb0a37a22a Fix PreferenceStore serialization test 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
802ad77ec5 Add serialization tests for GREL controls 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
326fda7999 Add JSON serialization tests for NominalFacetChoice 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
953a7380fe Cleanup imports 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
da9978b365 Add serialization tests for preference classes 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
580fd92c10 Add JSON serialization tests for processes 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
debe9bde37 Serialization test for EvalError 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
2dde302a90 Add JSON serialization tests for refine.history and refine.browsing 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
14233b8ea8 Serialization tests for operations.row 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
6ccd8ea9ee Deserialization test for Denormalize operation 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
73171755f3 More JSON tests for operations 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
4013c0b8c5 Add (de)serialization tests to existing operation test classes 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
dbff74650d Cleanup imports 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
8896636017 Add deserialization tests for operations 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
2edf83bdf7 Start serialization tests for operations 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
fac8936411 Serialization tests for model classes 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
c6d2b003b1 Start serialization tests 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
d9bff34411 Add testing utilites for JSON serialization 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
2b57350adf Cleanup StandardReconConfigTests 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
b12b29b393 Rename ReconTests 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
3ea1822773 Remove duplicate test class introduced by Jacky 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
f41678e087 Move tests to their relevant package. 2018-09-01 12:40:22 +02:00
Antonin Delpeuch
94b6b1f945
Merge pull request #1692 from OpenRefine/issue1689 
Fix exception when sorting the empty string numerically
 2018-08-30 08:09:20 +02:00
Jacky
21712db6e0
Merge pull request #1698 from OpenRefine/issue1681 
Fix unescape GREL function in javascript mode.
 2018-08-29 21:24:52 -04:00
Antonin Delpeuch
d01f916101 Remove test assertion that can fail depending on the locale 2018-08-08 11:51:10 +01:00
TonyO
c1af2f1179 fixed issue 1684 with decimal values 2018-08-07 11:25:49 +01:00
Antonin Delpeuch
09bb2903f2 Add test for sorting exception, issue #1689 2018-08-07 11:24:22 +01:00
Antonin Delpeuch
18c489855b Test for clickable URLs in HTML exporter 2018-08-07 11:23:49 +01:00
Antonin Delpeuch
87b6aadbad Fix unescape GREL function in javascript mode. Closes #1681. 2018-08-07 11:23:14 +01:00
Owen Stephens
64ed24e082 Small amount of tidying up code 2018-06-23 00:28:45 +01:00
Owen Stephens
420c9bd1a5 Add tests for grouping of values in text facets 2018-06-23 00:18:00 +01:00
Owen Stephens
d309af7f1a Update string conversion tests to reflect new behaviour of stringUtils 2018-06-23 00:18:00 +01:00
Owen Stephens
a159e76a62 Added test for reconstructing mass edits on dates 2018-06-23 00:18:00 +01:00
Antonin Delpeuch
9f7d5b8786
Merge pull request #1638 from OpenRefine/issue1637 
Do not discard the recon space when marking cells as new items.
 2018-06-22 12:23:15 +02:00
Jacky
f3dbc18214
Merge pull request #1642 from ostephens/mass-edit-fix 
Mass edit fix for blanks, numbers and booleans
 2018-06-20 22:00:34 -04:00
Antonin Delpeuch
448a969cb1
Merge pull request #1656 from OpenRefine/issue/1648 
fix the template load issue and package typo
 2018-06-17 09:23:52 +01:00
Jacky
5a6c9d72f0 fix the template load issue and package typo 2018-06-16 15:43:29 -04:00
Owen Stephens
5ecb1afe13 Updated toString test to new behaviour for null.toString() 2018-06-14 12:36:01 +01:00
Owen Stephens
92e456d2ff More tidying of tests 2018-06-08 20:09:29 +01:00
Owen Stephens
2e9708c16d Tidying up test file 2018-06-08 20:03:38 +01:00
Thad Guidry
057b64fcc2
Increasing to 10 second sleep because of Travis 
In Travis these tests are occasionally failing https://travis-ci.org/OpenRefine/OpenRefine/jobs/3896227 which is probably due to the CPU demand spike placed with createProcess.
 2018-06-08 06:26:08 -05:00
Owen Stephens
97ea151134 Removed date tests 2018-06-08 09:40:50 +01:00
Owen Stephens
256a81e308 Initial MassOperationTests 
Corrected and expanded tests for ReconstructEdit

Improve tests
 2018-06-08 09:40:35 +01:00
Antonin Delpeuch
a63151bbcc Do not discard the recon space when marking cells as new items. 
Fixes #1637
 2018-06-04 12:16:33 +01:00
Jacky
345be88de8 fix UT testHttpHeaders 2018-05-29 22:43:17 -04:00
Jacky
476ece5a67
Merge pull request #1617 from OpenRefine/issue1600 
Remove DataExtensions from change serialization
 2018-05-24 15:00:34 -04:00
Antonin Delpeuch
d8f081b977 Remove DataExtensions from change serialization 2018-05-22 23:09:51 +02:00
Antonin Delpeuch
b01177c0d9
Merge pull request #1597 from OpenRefine/issue/1588-2 
unify the internal date type
 2018-05-18 22:03:14 +02:00
Owen Stephens
19a134d4ae Corrected spelling of Calender to Calendar 2018-05-17 10:01:04 +01:00
Jacky
52a2ec05e1
Merge pull request #1598 from ostephens/no-field-null 
No field null
 2018-05-16 16:01:05 -04:00
Jacky
a103e1fb90 merge the translation 2018-05-16 15:40:05 -04:00
Jacky
147616f41c add more UT for tostring 2018-05-14 22:01:06 -04:00
Jacky
5adb3e455c fix the date format bug 2018-05-14 21:25:47 -04:00
Jacky
8fe27eff58 use yyyy-mm-dd formatter when converting date to string 2018-05-12 20:19:55 -04:00
Owen Stephens
1e2c0c0a04 Added tests for getting non-existent fields and changed test for parser eval error 2018-05-10 16:37:11 -04:00
Jacky
cf5c884ca0 fix minor issues 2018-05-09 23:15:51 -04:00
Jacky
c1132aa58a add nano support 2018-05-09 22:57:10 -04:00
Jacky
a53d0970ea clean up the UT 2018-05-08 22:13:47 -04:00
Jacky
f58d963dbd Merge branch 'issue/1588' of https://github.com/OpenRefine/OpenRefine into issue/1588-2 2018-05-07 17:26:02 -04:00
Antonin Delpeuch
8c2c4546d4
Merge pull request #1568 from OpenRefine/fix-mark-new-items 
Fix identifier space for cells reconciled to New
 2018-05-06 08:45:25 +02:00
Antonin Delpeuch
b8472cf6b8
Merge pull request #1573 from OpenRefine/issue472 
Fix FillDown and BlankDown operations on records.
 2018-05-06 08:45:01 +02:00
Jacky
19f98b7ea2 java 8 time API migrate 2018-05-05 11:41:40 -04:00
Jacky
6787ab881e implement nano date part UT 2018-05-02 22:02:57 -04:00
Jacky
34c46111ea undo the incidently push to master 2018-05-02 21:40:23 -04:00
Jacky
47d6f79e35 implement nano data part 2018-05-02 21:23:17 -04:00
TonyO
0eb7b4082f added null and default value options 2018-04-26 20:50:46 -05:00
Antonin Delpeuch
1daa4d1312 Fix date parsing. 
Closes #1564.
 2018-04-22 10:49:22 +02:00
Antonin Delpeuch
53c12ca2df Fix FillDown and BlankDown operations on records. 
Closes #472.
 2018-04-21 22:11:54 +02:00
Antonin Delpeuch
716a1606b4
Merge pull request #1558 from gobertm/master 
Contains function supports now regex as second argument
 2018-04-19 10:46:15 +02:00
Maxime Gobert
304f65045b Contains function tests 2018-04-18 12:17:26 +02:00
Antonin Delpeuch
2b237433f9 Fix identifier space for cells reconciled to New 2018-04-15 01:20:25 +02:00
Jacky
de42f4d85a migrate from JRDF to JENA library 2018-04-08 22:38:23 -04:00
TonyO
3834c27c8f SQL Export Code Commit 2018-03-24 22:41:07 -05:00
Antonin Delpeuch
c536584991
Merge pull request #1536 from ostephens/coalesce 
Add coalesce function
 2018-03-18 13:06:52 +00:00
Owen Stephens
6e02baaa8a Coalesce must have at least two arguments 2018-03-17 16:21:05 +00:00
Owen Stephens
998eefc869 Make codacy happier 2018-03-14 23:59:13 +00:00
Owen Stephens
74a6782ca0
Merge pull request #1524 from OpenRefine/issue/1508 
support project backward compatibility to old version of OpenRefine
 2018-03-07 09:36:13 +00:00
Owen Stephens
01b96a0155 Add coalesce function 2018-03-07 09:10:11 +00:00
Jacky
23ec54b78f support project backward compatibility to old version of OpenRefine 2018-02-28 20:16:29 -05:00
Jacky
54553da733
Merge pull request #1518 from OpenRefine/issue/1509 
Fix issue #1509
 2018-02-28 19:42:07 -05:00
Jacky
ab26bf4a27 fix issue #1517, limit is writen as int and should have been read as int 2018-02-25 17:22:34 -05:00
Jacky
73c5c640cc tidy up import 2018-02-25 15:43:37 -05:00
Jacky
036866837a add UT for issue #1509 2018-02-25 15:31:59 -05:00
Antonin Delpeuch
3dcb3f1faf
Merge pull request #1515 from ostephens/conversions 
Conversions
 2018-02-22 09:49:49 +00:00
Owen Stephens
2758633f32 Update toDate and toNumber tests to handle null and empty strings correctly 2018-02-21 23:10:38 +00:00
Owen Stephens
731e1310c6 Stripping stuff we don't need out of the tests 2018-02-19 13:42:45 +00:00
Owen Stephens
d2687cc58a Treat null and empty string as different values when doing transforms 2018-02-18 23:19:28 +00:00
Joanne
e0d87c3d94 Update tests to match updated range function 2018-02-16 15:13:37 +00:00
Joanne
01d8e458f4 Update tests to match updated range function 2018-02-16 15:13:37 +00:00
Joanne
e2793daf54 Update tests for improved range function 2018-02-16 15:13:37 +00:00
Joanne
d95f5985b9 Add tests for range function 2018-02-16 15:13:37 +00:00
Owen Stephens
0d04a25cf1
Merge pull request #1450 from OpenRefine/issue1448 
Make Wikitext importer more robust
 2018-02-07 17:41:23 +00:00
Antonin Delpeuch
f5ff5565ff Cleanup for Codacy and better parsing of quote character 2018-02-03 16:37:15 +00:00
Antonin Delpeuch
a89bbcbbe2 Add missing method removed during merge 2018-02-03 14:29:24 +00:00
Thad Guidry
c83dbe3b23
Merge branch 'master' into stundzig-develop/1086-quotecharacter 2018-02-03 07:20:45 -06:00
Antonin Delpeuch
c9395d564c Merge branch 'develop/1086-quotecharacter' of https://github.com/stundzig/OpenRefine into stundzig-develop/1086-quotecharacter 2018-02-03 07:56:30 +00:00
Jacky
c4b0ff6bea data package metadata (#1398) 
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
 2018-02-02 13:24:19 +00:00
Antonin Delpeuch
47f44b06c4 Make Codacy happy 2018-02-02 11:57:20 +00:00
Antonin Delpeuch
1f87a26f4c Include image file names like templates in Wikitable importer 2018-02-02 11:22:15 +00:00
Antonin Delpeuch
843641ca74 Parse headers just like other cells in Wikitable importer 
This makes the column names a bit less meaningful,
but this is necessary to handle cases where headers
are inserted anywhere in the table.
 2018-02-02 10:48:31 +00:00
Antonin Delpeuch
0426704938 Add helper createProjectWithColumns 2018-01-27 13:58:06 +00:00
Antonin Delpeuch
feae25a5ff Migrate more tests to the createCSVProject helper 2018-01-27 13:45:44 +00:00
Antonin Delpeuch
8f9fc61046 Migrate TextSearchFacetTests.java to use the helpers 2018-01-27 13:45:44 +00:00
Antonin Delpeuch
5278e929a2 Refactor CrossFunctionTests' project creating logic into RefineTest 2018-01-27 13:45:44 +00:00
Owen Stephens
4320ef8c10 Resolved merge conflict 2018-01-16 17:41:56 +00:00
Owen Stephens
5acdb1429c Fix tests - Include new httpHeaders JSON array when creating new ColumnAdditionByFetchingURLsOperation 2018-01-16 17:22:48 +00:00
Jacky
3c25647f05 add find function. issue 1296 2018-01-14 22:04:26 -05:00
Olle Jonsson
76fa942490 Nobel prize winners CSV data typos 2018-01-07 21:28:07 +01:00
Antonin Delpeuch
45ccd0e1c0 Change HTTP error detection in URL fetching test 2018-01-03 22:44:32 +01:00
Antonin Delpeuch
dae4ac1ce4 Simpler way to pass the test when there are 503 errors 2018-01-03 19:03:26 +01:00
Antonin Delpeuch
32b7d2fa74 Looser check for 403 and 503 errors in URL caching test 2018-01-03 18:57:34 +01:00
Antonin Delpeuch
f14543bfca Fix URL caching test on Appveyor 2018-01-03 18:52:12 +01:00
Antonin Delpeuch
94b9d57528
Merge pull request #1397 from tiagofernandez/save-import-options 
Revert 278f24c1 and adapt 0001d9f7 (ref. PR #1387)
 2017-12-27 09:44:19 +01:00
Tiago Fernandez
00faf2a179 Revert 278f24c1 and adapt 0001d9f7 (ref. PR #1387) 2017-12-24 12:48:23 +01:00
Jacky
e5709efd46 fix issue #1341 2017-12-24 00:04:16 -05:00
Jacky
fb3620b3d9
Merge pull request #1388 from jackyq2015/issue/1386 
Fix Issue #1386
 2017-12-21 08:26:29 -05:00
Jacky
6c06424183
Merge pull request #1390 from jackyq2015/issue/1389 
fix Issue #1389
 2017-12-21 08:26:09 -05:00
Jacky
9107a0eb91 remove commented code 2017-12-21 08:24:29 -05:00
Jacky
e1a494aabd remove the print 2017-12-21 08:22:44 -05:00
Jacky
cd770aed25 revert unecessary changes 2017-12-20 18:52:53 -05:00
Jacky
2f050322b5 use join not sleep 2017-12-20 08:35:31 -05:00
Tiago Fernandez
0001d9f7b2 Test ImportingUtilities.createProjectMetadata() 2017-12-20 11:07:36 +01:00
Jacky
834b6c493c check isDone 2017-12-19 22:20:11 -05:00
Jacky
3fa994739a check isDone 2017-12-19 22:09:52 -05:00
Jacky
cce3ab6240 fix issue #1389 2017-12-19 21:00:03 -05:00
jackyq2015
136eba52df add missing import 2017-12-19 15:28:34 -05:00
jackyq2015
cb55b68449 add missing import 2017-12-19 15:23:39 -05:00
jackyq2015
81043e58e2 fix #1386 2017-12-19 12:54:26 -05:00
Jacky
d207c74f62 merge from master 2017-12-15 22:06:30 -05:00
Antonin Delpeuch
3c5a9b0754
Merge pull request #1357 from xseris/master 
Tag system
 2017-12-16 01:55:46 +00:00
Jacky
2afdcbf546 fix issue https://github.com/jackyq2015/OpenRefine/issues/2 2017-12-15 16:37:38 -05:00
Jacky
0258dc1787 fix issue #1383. use the localDateTime for project info 2017-12-15 15:24:09 -05:00
xseris
ee8ed8f563 Refresh tag cell 2017-12-08 00:46:59 +01:00
xseris
b16941777e Modified tags in metadata dialog and moved column right to name 2017-12-07 23:45:36 +01:00
xseris
f21230804b Fixed Mockito tests 2017-12-01 17:00:45 +01:00
Owen Stephens
93431daecf Remove unused variable 2017-11-29 09:47:03 +00:00
Owen Stephens
0b433fc5ec Updated copyright statement 2017-11-29 00:59:49 +00:00
Owen Stephens
d64dee71dd Extended tests and code for user friendly regular expression syntax errors 2017-11-28 16:20:24 +00:00
Owen Stephens
441d9f7f10 Initial tests and code for user friendly regular expression syntax errors 2017-11-24 18:24:16 +00:00
Thad Guidry
34f38ccaf8
Merge pull request #1336 from ostephens/multi-cell-join-tests 
Add tests for JoinMultiValuedCells
 2017-11-16 22:49:03 -06:00
Jacky
8d2c8b521b
Merge pull request #1334 from jackyq2015/issue/1328 
fix import multiple excel with mulitple sheets issue #1328
 2017-11-16 21:30:24 -05:00
Jacky
1d2998f374 fix the unit test 
support multi files with multi tables for open office
 2017-11-16 10:29:16 -05:00
Owen Stephens
df920777ac Moved variable to local scope 2017-11-16 12:47:05 +00:00
Antonin Delpeuch
78b7f01be5
Merge pull request #1327 from ostephens/invert-filter 
Invert text search facet/text filter
 2017-11-16 08:05:31 +00:00
Owen Stephens
742b42ade1 More code tidy up 2017-11-15 19:01:52 +00:00
Owen Stephens
2d0f48e93f Corrections for Codacy 2017-11-15 18:51:58 +00:00
Owen Stephens
3a31e69c2b Added Tests for TextSearchFilter 2017-11-15 18:31:55 +00:00
Qi Cui
6bdba6948e add tests for SetProjectMetadataCommand 2017-11-14 15:54:22 -05:00
Jacky
75b82106b4 fix the package declarations 2017-11-03 17:11:31 -04:00
Thad Guidry
d72a2de348 Revert "Extend cross() function to support multiple-value-cell-input" 2017-10-26 17:37:10 -05:00
Thad Guidry
3d0e96a0ce Merge pull request #1290 from claussni/cross-func-split 
Extend cross() function to support multiple-value-cell-input
 2017-10-26 14:23:23 -05:00
Ralf Claussnitzer
0b107ec5e9 Add optional 4th parameter to cross() function 
The cross function now accepts a 4th parameter defining a regular
expression separator for splitting multi-value field values when joining
projects.

See https://github.com/OpenRefine/OpenRefine/issues/1204#issuecomment-326320954
 2017-10-26 19:50:02 +02:00
Owen Stephens
c10f72437f Add tests for JoinMultiValuedCells 2017-10-25 11:15:59 +01:00
Antonin Delpeuch
88b10a2917 Merge pull request #1278 from ostephens/cell-split-regex 
Cell split regex
 2017-10-25 11:04:33 +01:00
Owen Stephens
300edcca74 Minor fix to comment in code 2017-10-24 08:58:32 +01:00
Owen Stephens
219e747147 Removed unused dependency 2017-10-24 08:54:58 +01:00
Owen Stephens
209500bf3a Add tests for SplitMulitValuedCells 2017-10-24 08:29:00 +01:00
Owen Stephens
bb6b3d6c29 Re-locate operations tests in correct folder 2017-10-23 18:54:59 +01:00
Antonin Delpeuch
e2a22a6994 Forbid pipe characters in URL references to ease parsing. 
This is a temporary fix before we do full Wikitext parsing inside references
(this needs a change upstream). See https://github.com/sweble/sweble-wikitext/issues/67 .
 2017-10-20 15:32:58 +01:00
Antonin Delpeuch
1da3c00cb1 Perform ASCII normalization earlier in FingerprintKeyer. 
This closes #1256.
 2017-09-27 09:23:40 +01:00
Antonin Delpeuch
a1b2c9b683 Add support for references in Wikitable importer. 
Closes #1243.
 2017-09-23 22:54:43 +01:00
Antonin Delpeuch
00f8e4fc6b Merge pull request #1237. 
Conflicts:
	.classpath
	main/webapp/modules/core/langs/translation-en.json
	main/webapp/modules/core/scripts/dialogs/extend-data-preview-dialog.js

Closes #363 and #56.
 2017-08-28 16:25:50 +01:00
Antonin Delpeuch
554b75fa7b Fix parsing of newlines in cells 2017-08-17 19:18:50 +01:00
Antonin Delpeuch
7989aacc58 Cleanup for Codacy 2017-08-17 12:40:56 +01:00
Antonin Delpeuch
637e69db9d Better error reporting and testing for Wikitext import 2017-08-16 10:30:51 +01:00
Antonin Delpeuch
3dcda5a42c Add reconciliation config in wikitext import. 2017-08-16 00:05:40 +01:00
Antonin Delpeuch
5390aa248c Fix DataExtensionTests (Tajikistan has only one currency, not two) 2017-08-15 22:11:00 +01:00
Antonin Delpeuch
d01de6ea85 Update tests 2017-08-15 22:09:45 +01:00
Antonin Delpeuch
aa4517ba58 Add support for colspan and rowspan in Wikitext 2017-08-15 11:28:43 +01:00
Antonin Delpeuch
e168c900e8 Add support for table headers 2017-08-13 20:14:48 +01:00
jackyq2015
45e3ea5e86 fix testng data path issue 2017-08-13 13:03:19 -05:00
jackyq2015
f3463c332e Unit test for issue #137 2017-08-13 12:37:20 -05:00
Antonin Delpeuch
b8a781d366 Add support for links (unreconciled for now) 2017-08-13 12:57:46 +01:00
Antonin Delpeuch
e6406f56ef Initial version of the wikitext importer 2017-08-13 11:26:59 +01:00
jackyq2015
588024f60d Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-08-06 22:06:58 -05:00
jackyq2015
fd58ac1e99 fix some xml issues 2017-08-06 22:05:17 -05:00
Antonin Delpeuch
3b30018cad Merge pull request #1216 from OpenRefine/issue1214 
Add test for KeyValueColumnize
 2017-08-03 19:31:35 +01:00
Antonin Delpeuch
135dd50413 Fix Codacy issues 2017-08-03 12:47:09 +01:00
Antonin Delpeuch
afed8eb28a Generate code coverage reports with Jacoco 2017-08-03 11:07:14 +01:00
Antonin Delpeuch
66eac0fae9 Ensure null values are not cached in URL fetching operation. Closes #1219. 2017-08-01 13:05:29 +01:00
Antonin Delpeuch
7de2a57c3a Add RefineServletStub initialization in KeyValueColumnizeTests 2017-07-26 18:39:08 +01:00
Antonin Delpeuch
d941320f5e Adapt test about #1214 to show how the function currently works. 
With this test, if someone tries to fix this "bug" in the future, they will realize this use case should be preserved.
 2017-07-26 18:07:52 +01:00
Antonin Delpeuch
453d35032b Add test for issue #1214 2017-07-26 00:41:06 +01:00
jackyq2015
64ab5a4409 unit test for backward compatibility for cross function 2017-07-23 19:31:25 -04:00
Thad Guidry
7f92251ed1 Merge pull request #1210 from wetneb/extend 
Add data extension capabilities to the reconciliation API
 2017-07-17 18:01:37 -05:00
Antonin Delpeuch
c04d9f3c33 Switch to public WMF endpoint for tests 2017-07-16 11:54:12 +01:00
Antonin Delpeuch
84c06821ee Data extension tests 2017-07-16 11:47:12 +01:00
jackyq2015
1ee339cbbd cross function test suite. #1204 2017-06-28 08:12:36 -04:00
jackyq2015
af731a3c1f add test case for cross function 2017-06-25 23:27:48 -04:00
Bob Harper
909df1b6a7 xor can also accept 2+ params, rewrite tests to be consistent 2017-04-27 11:20:48 +01:00
Bob Harper
4ea0f440e9 remove 3 param error test for 'and' and 'or' 2017-04-27 11:07:04 +01:00
Antonin Delpeuch
22124ac57e Add checkbox to disable caching 2017-03-09 00:21:34 +00:00
Antonin Delpeuch
32c232c2d6 Move to Guava's cache for ColumnAdditionByFetchingURLsOperation 2017-03-08 09:32:34 +00:00
Antonin Delpeuch
3297e6e7ee Add tests for the URL caching feature 2017-03-08 00:50:09 +00:00
Qi Cui
773151380e fix #1138. column transpose 2016-08-24 13:56:35 -04:00
Steffen Stundzig
7f5e58ef51 #1086 add support for quote character 2015-10-30 14:32:46 +01:00
jackyq2015
7a2a0eb52f fixed issue #796 Columnize by key/value columns creates empty lines 2015-09-29 20:12:05 -04:00
magdmartin
b635f4e067 Merge pull request #1055 from RefinePro/issue-512 
fix issue #512 to save the file location as a table column
 2015-09-20 09:31:16 -04:00
jackyq2015
4e6f584cde fix issue #512 to save the file location as a table column 2015-08-27 15:13:20 -04:00
jackyq2015
a89dc7c25a fix the junit issue 2015-08-06 22:27:20 -04:00
jackyq2015
dc7535c63e 1. take out of issue #1021 fix which was mistakenly put in 
2. fix the expected value for JUNIT
 2015-08-06 21:31:37 -04:00
QI CUI
495dcd7bd5 use the LinkedHashMap instead of HashMap to make sure the retrive order 2015-01-30 15:03:20 -05:00
Tom Morris
ddfaecb3e6 Merge pull request #914 from opendatatrentino/rev-masschange 
Fix wrong revert order in MassChange
 2014-12-22 23:50:31 -05:00
David Leoni
4d2b90ad60 added MassChangeTests 2014-12-22 12:23:49 +01:00
Tom Morris
09f55fb436 Merge pull request #920 from opendatatrentino/fixEclipseDeps 
Update deps in Eclipse projects and some jar sources
 2014-12-21 12:39:43 -05:00
David Leoni
d1d436c184 Fixes locale dependent calendar to string test 2014-12-01 18:48:15 +01:00
David Leoni
ffad78c542 updated deps in Eclipse project and some jar sources 2014-12-01 16:17:25 +01:00
Tom Morris
e3cdd160d0 Test for issue #796 (failing until fixed) 2014-05-30 01:47:20 -04:00
Pablo Moyano
f45ea488cd Correcting typo that was breaking one UI test 2013-12-17 01:40:45 -03:00
Tom Morris
84c20af185 Switching more big Ys to little ys for java 6 2013-09-19 01:38:09 -04:00
Tom Morris
891f7125d3 One more try at a passing Java 6 test 2013-09-19 01:29:17 -04:00
Tom Morris
a95a3a78d7 Make test Java 6 compatible for TravisCI (hopefully) 2013-09-19 01:16:26 -04:00
Tom Morris
952443c38c Create a HistoryManagerStub to go with ProjectManagerStub for testing 2013-09-18 18:45:45 -04:00
Tom Morris
bc801546cc Remove references to obsolete splitIntoColumns option 2013-09-18 18:44:58 -04:00
Tom Morris
1261734f15 Partial solution for #816 plus improved conversion test coverage 2013-09-18 11:14:48 -04:00
Tom Morris
fa072df85c Add locale support to toDate() - fixes #729 2013-08-15 15:19:01 -04:00
Tom Morris
7edc550618 Give a reasonable error message on Excel 95 import failure - fixes #564 2013-07-26 16:24:56 -04:00
Tom Morris
ff4eeb549a Fix typo 2013-07-26 15:35:18 -04:00
Tom Morris
6dd4b8ea23 Add tests for boolean functions and tighten up error handling 2013-07-25 13:45:04 -04:00
Tom Morris
8cb1dc05f8 Really restore Java 6 compatibilty 2013-06-23 14:42:05 -04:00
Tom Morris
3b835fabad Restore Java 6 compatibility 2013-06-23 14:11:30 -04:00
Tom Morris
a3b4b45e4e Support non-string types in facetCount() - fixes #591 2013-06-23 12:04:48 -04:00
Tom Morris
51c1bc4a2f Refactor default toString with date support into separate utility 2013-06-23 12:02:13 -04:00
Tom Morris
a42925f3c8 Remove unused code 2013-06-23 11:21:48 -04:00
Tom Morris
c961bb64de Flush all column caches on row removals/changes. Fixes issue 567. 2013-06-22 18:44:26 -04:00
Tom Morris
43b2d89703 Remove dead code 2013-06-22 16:23:14 -04:00
Tom Morris
e1bea25c72 Clean up server tests 
- move from shell script to Ant
- update TestNG and Mockito to latest versions
 2013-06-11 19:44:58 -04:00
Tom Morris
1907bcd8dc Disable tests for character decomposition 2013-05-31 17:04:09 -04:00
Tom Morris
567da6aa9f Normalize line endings 
Add .gitattributes & do one-time normalization of line endings
 2013-03-23 18:46:20 -04:00
Tom Morris
6a91b5d75b Use InputStream instead of Reader for JSON import - fixes #698 2013-03-23 18:36:05 -04:00
Tom Morris
0da4214f88 Add some tests before working on #640 and #409 2013-02-01 17:14:46 -05:00
Tom Morris
0bd2104a16 Issue 630: Change branding from Google Refine to OpenRefine 
** The first native Github commit (ie not one converted from SVN **
Change Google Refine to OpenRefine or just Refine.  
Change icon filenames and add some placeholder icons
 2012-10-18 19:40:31 -04:00
Tom Morris
b3f5fada95 FIXED - task 578 & 596: Clean up JSON importer 
http://code.google.com/p/google-refine/issues/detail?id=578
http://code.google.com/p/google-refine/issues/detail?id=596

Extend tree parser framework to allow any Serializable instead of just Strings. Use this in JSON importer to: Import keywords null, true, false; Import empty strings and don't trim whitespace from strings on import;  Import numbers directly instead of importing them as text and then parsing them ourselves. Add tests to verify all this stuff

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2543 7d457c2a-affb-35e4-300a-418c747d4874
 2012-09-08 01:20:25 +00:00
Tom Morris
7c7e10d9f5 Fix silly cut & paste test name. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2530 7d457c2a-affb-35e4-300a-418c747d4874
 2012-08-14 23:11:42 +00:00
Tom Morris
1e043dcc94 FIXED - task 604: The common transform “Trim leading and trailing whitespace” doesn’t trim non-breaking spaces 
http://code.google.com/p/google-refine/issues/detail?id=604

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2529 7d457c2a-affb-35e4-300a-418c747d4874
 2012-08-14 23:00:13 +00:00
Tom Morris
4bf212c03d FIXED - task 154: Can't import RDF/XML Data 
http://code.google.com/p/google-refine/issues/detail?id=154

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2526 7d457c2a-affb-35e4-300a-418c747d4874
 2012-08-05 16:31:41 +00:00
Tom Morris
b2ae74d23f FIXED - task 586: Only one parse date format is attempted from list in toDate(format1,format2) 
http://code.google.com/p/google-refine/issues/detail?id=586

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2520 7d457c2a-affb-35e4-300a-418c747d4874
 2012-08-03 18:01:01 +00:00
Tom Morris
4319314675 FIXED - task 594: Date diff function doesn't work for two Calendar objects 
http://code.google.com/p/google-refine/issues/detail?id=594

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2519 7d457c2a-affb-35e4-300a-418c747d4874
 2012-08-02 21:41:19 +00:00
Tom Morris
e97e7523b2 Issue 548 - Convert non-strings to strings before escaping 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2463 7d457c2a-affb-35e4-300a-418c747d4874
 2012-03-14 03:06:11 +00:00