s434730/RandomSec
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
5,422 Commits 6 Branches 0 Tags 1.3 GiB
6f75d07e1c
Commit Graph

1108 Commits

Author SHA1 Message Date
Antonin Delpeuch
393eec1586 Jackson deserialization for EngineConfig 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
c4caf1eba7 Jackson deserialization for TimeRangeFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
e11145ce0d Jackson deserialization for ScatterplotFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
d8bc841dae Jackson deserialization for RangeFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
39498233fb Jackson deserialization for ListFacetConfig 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
121dd76fa1 Jackson deserialization for DecoratedValue 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
9c58b8f51f Fix constraints initialization 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
d4bdd37bda Jackson deserialization for Recon 2018-11-30 19:21:22 +09:00
Antonin Delpeuch
ba7879621d Jackson deserialization for Project 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
bbf6dcd767 Jackson deserialization for ColumnGroup 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
487f6bc131 Jackson deserialization for Row 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
adb2e13874 Jackson deserialization for Cell 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
8758ed2cff Jackson deserialization for ReconCandidate 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
ccc8f6470e Jackson deserialization for Column 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
af866363ca Jackson deserialization for ReconStats 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
599edd374f Jackson deserialization for ReconType 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
0dae0811b0 Jackson deserialization for ReconConfig 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
8b41c4e08a Merge Jsonizable removal with master 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
0698b9c84e Unify JSON testing in Wikidata extension 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
75b642f9bf Fix serialization of local dates 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
9c788769af Restore JSON property autodetect 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
bc6f1b0146 Fix failing tests after JSONWriter replacement 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
c9620a5d9a Add missing .flush(); .close() on JsonGenerator 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
7156c49c4d Remove remaining uses of org.json.JSONWriter in the core backend 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
9219ef36aa Jackson serialization for the remaining commands 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
f263d8a129 Migrate commands out of JSONWriter 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
c7c5fd4120 Reorganize imports 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
f6fc47a8f9 Fix serialization of StandardReconConfig with no type 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
fec28b99bc Various serialization fixes 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
1790799bfe Remove Jsonizable interface and write methods 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
e99a491338 Refactor workspace commands for Jackson serialization 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
553a73ec40 Refactor expression commands for Jackson serialization 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
fd69e4b980 Serialization tests for expression commands 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
65231e2140 Refactor GetRowsCommand for Jackson migration 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
b6a724b429 Disable Jackson autodetect and annotate remaining classes 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
bb0b351cef Refactoring JSON production in commands to prepare for Jackson 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
987c2d1c80 Jackson serialization for project managers 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
7d3af420ce Jackson serialization for long running processes 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
18c2183cbc Jackson serialization for preferences 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
418b21dda2 Jackson serialization for history classes 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
aba8cd8430 Jackson serialization for processes 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
49f1367adc Jackson serialization for clustering classes 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
cf45f23e1d Jackson serialization for reconciliation operations 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
8f1c7cc2ab Jackson serialization for facets 2018-11-30 19:20:34 +09:00
Antonin Delpeuch
761b748faa Cleaner double serialization emulation, application wide. 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
1fa101c334 Jackson serialization for the model classes 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
1f40393028 Move SortingConfig to its own file; tests for sorting criteria 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
6daa1b4f5c Jackson serialization for RowReorderOperation 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
a3bba83c63 Jackson serialization for column operations 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
539585fc5e Jackson serialization for cell operations 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
c140f90db1 Jackson serialization for GREL controls 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
7648ca91ca Jackson serialization for GREL functions 2018-11-30 19:19:01 +09:00
Antonin Delpeuch
36765e7e62 Bump version to 3.2-SNAPSHOT 2018-11-29 11:59:30 +09:00
Antonin Delpeuch
b90e413b40 Set version to 3.1 2018-11-29 10:32:56 +09:00
jackyq2015
02871e1b6f fix issue #1802 -- escape single quote in SQL export 2018-11-26 19:40:22 -05:00
Antonin Delpeuch
95d0cf546d
Merge pull request #1845 from ostephens/parseXml 
Parse xml
 2018-11-25 18:44:38 +00:00
Antonin Delpeuch
a5ba16db66
Merge pull request #1764 from dtap-gmbh/issue1757 
Using the parsed form parameter 'options' instead of looking for an U…
 2018-11-25 18:44:07 +00:00
Antonin Delpeuch
0d3c7c7af4
Merge pull request #1852 from ostephens/fix-cross 
Enable Cross to work with non-string wrapped cells
 2018-11-24 15:28:05 +00:00
Antonin Delpeuch
998a5423db
Merge pull request #1856 from OpenRefine/issue1305 
Display git commit id instead of "TRUNK"
 2018-11-23 10:41:07 +00:00
Antonin Delpeuch
ed6900f180 Include git commit id in released versions 2018-11-22 20:08:31 +00:00
Antonin Delpeuch
8a72d359e0 Fix indentation 2018-11-22 19:48:11 +00:00
Antonin Delpeuch
1d2888ba01 Display git commit id instead of TRUNK. Closes #1305. 2018-11-22 19:46:30 +00:00
Owen Stephens
d1acd9336c Update Cross function to accept non-string wrapped cells 2018-11-22 17:54:29 +00:00
Owen Stephens
e8f454afc7 Fixing changes missed during rebase 2018-11-22 13:42:46 +00:00
Owen Stephens
fb8697ef9c Minor code tidy 2018-11-22 12:36:37 +00:00
Owen Stephens
2a034b65e9 Add number, date and boolean counts to List facet 2018-11-22 12:36:37 +00:00
Owen Stephens
22072c498b Add tests for grouper for list facet 2018-11-22 12:33:39 +00:00
Owen Stephens
281d757f1c Remove superfluous function 2018-11-22 00:37:43 +00:00
Remi Rampin
2356656b50 Load new message catalogs using jquery.i18n 2018-11-21 17:29:49 +00:00
Owen Stephens
d144a5dccf Stricter re number of arguments for parseXml/Html and clearer err msgs 2018-11-21 15:58:59 +00:00
Owen Stephens
1f023b53af Remove deprecated HTML functions and tests 2018-11-20 20:21:30 +00:00
Owen Stephens
bae3dbb812 Add XML parsing and update HTML parsing to use same classes 2018-11-20 20:20:51 +00:00
Owen Stephens
b5355b3c12 Correct typo 2018-11-18 13:12:41 +00:00
Antonin Delpeuch
3431a9ee1e
Merge pull request #1829 from OpenRefine/issue1827 
Fix issue of empty list facet choices disappearing.
 2018-11-17 08:56:41 +00:00
Antonin Delpeuch
0e0dcbafef Fix issue of empty list facet choices disappearing. Closes #1827. 2018-11-16 12:52:07 +00:00
Antonin Delpeuch
b85d4d0cb8
Merge pull request #1826 from ostephens/fix-todate 
Fix toDate
 2018-11-16 10:30:56 +00:00
Owen Stephens
1627a51075 Reorganises ToDate function, adds tests and fixes #1759 2018-11-15 18:20:55 +00:00
Owen Stephens
cc12098828 Initial attempt to fix toDate function 2018-11-08 09:11:49 +00:00
Antonin Delpeuch
3ad7d9e19d Set version to 3.1-beta 2018-11-07 12:46:15 +00:00
Antonin Delpeuch
1eb9ef78ef Fix cell index computation in filldown/blankdown 2018-11-03 17:10:23 +00:00
Owen Stephens
c3e49e79ab Add support for N-triples and Turtle 2018-10-27 19:04:07 +01:00
Owen Stephens
42e8c86a78 Add support for JSON-LD import 2018-10-27 06:34:33 +01:00
Andreas Cordsen
9aba9c2d48 Using the parsed form parameter 'options' instead of looking for an URL parameter. 2018-10-16 15:13:34 +02:00
omkar
e23fef8b66 Fix: Allow smartSplit() to handle String of chars not just a single char 2018-10-14 21:50:29 +05:30
Antonin Delpeuch
d2edffcef4
Merge pull request #1754 from OpenRefine/issue1596 
Directly use column as reconciliation results
 2018-10-12 11:05:12 +01:00
Antonin Delpeuch
2a68e761cb Implementation of UseValuesAsIdentifiers operation and command 2018-10-02 12:31:59 +01:00
Antonin Delpeuch
22be1ec323
Merge pull request #1731 from xseris/master 
Custom column names for separator based importer
 2018-09-24 08:29:46 +01:00
Antonin Delpeuch
ec3e9ab1e9
Merge pull request #1730 from OpenRefine/json-clustering 
Refactor clustering serialization in JSON
 2018-09-16 18:52:11 +01:00
Antonin Delpeuch
d421fd7fbf
Merge pull request #1729 from OpenRefine/json-engineconfig 
Store engine configuration in dedicated class
 2018-09-16 18:51:41 +01:00
Qi Cui
e056f13d63 bump the version 2018-09-16 11:59:44 -04:00
xseris
f288bc653e Added test, changed visualization 2018-09-13 14:45:38 +02:00
xseris
deab8ceeb0 custom column names for separator based importer 2018-09-12 15:45:52 +02:00
Antonin Delpeuch
9f964af7d4 Migrate ComputeClustersCommand to use new architecture 2018-09-10 15:49:59 +01:00
Antonin Delpeuch
c9436f563d Refactor kNNClusterer for serialization 2018-09-10 15:49:59 +01:00
Antonin Delpeuch
31954862e8 Refactor BinningClusterer for JSON serialization 2018-09-10 15:49:52 +01:00
Antonin Delpeuch
5a0304f363
Merge pull request #1722 from OpenRefine/json-testing 
Add serialization tests for most Jsonizable classes
 2018-09-10 15:35:25 +01:00
Antonin Delpeuch
07ab7da872
Merge pull request #1697 from OpenRefine/issue1696 
Clickable URLs in HTML exporter
 2018-09-05 14:58:44 +01:00
Antonin Delpeuch
2236420f3b Cleanup EngineDependentOperation, String caching is not needed 2018-09-05 14:56:56 +01:00
Antonin Delpeuch
fbc9b27640 Store engine configuration as EngineConfig rather than JSONObject 2018-09-05 14:49:39 +01:00
Antonin Delpeuch
f327b09a59 Reorganize facet parsing and discontinue initializeFromJSON on Facet 2018-09-05 12:03:54 +01:00
Antonin Delpeuch
5b4cab947e Introduce EngineConfig class to avoid manipulating JSON objects directly 2018-09-05 11:00:20 +01:00
Antonin Delpeuch
7a3d13ef47 Refactor TextSearchFacet for JSON serialization 2018-09-05 10:51:31 +01:00
Antonin Delpeuch
daeb7ab6df Refactor ScatterplotFacet for JSON serialization 2018-09-05 10:08:53 +01:00
Antonin Delpeuch
1186776235 Refactor TimeRangeFacet for JSON serialization 2018-09-04 18:19:18 +01:00
Antonin Delpeuch
8e8b3c18c5 Refactor RangeFacetTests for serialization 2018-09-04 11:49:48 +01:00
Antonin Delpeuch
5b8be7f1a3 Fix ListFacetConfig serialization 2018-09-04 10:26:03 +01:00
Antonin Delpeuch
497eee5a75 Add serialization tests for ListFacet 2018-09-04 10:09:38 +01:00
Antonin Delpeuch
bc81beb933 Introduce FacetConfig interface and refactor ListFacet accordingly 2018-09-04 09:33:30 +01:00
Antonin Delpeuch
6aa93bbc0c Use UrlValidator to detect urls in tabular exporter 2018-09-03 19:48:11 +01:00
Antonin Delpeuch
da9978b365 Add serialization tests for preference classes 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
b4bcf7a1b6 Fix inconsistency in serialization of ReconMatchSpecificTopicOperation 2018-09-01 12:40:23 +02:00
Antonin Delpeuch
94b6b1f945
Merge pull request #1692 from OpenRefine/issue1689 
Fix exception when sorting the empty string numerically
 2018-08-30 08:09:20 +02:00
Jacky
21712db6e0
Merge pull request #1698 from OpenRefine/issue1681 
Fix unescape GREL function in javascript mode.
 2018-08-29 21:24:52 -04:00
Thad Guidry
3742b6a092 improve log descriptions for stale import job removals (#1705) 
* improve log descriptions for stale import job removals

* Removed unnecessary log line and instead changed primary log line
 2018-08-12 08:53:57 +01:00
TonyO
76a995182e added comment to fix 1684 2018-08-07 11:25:49 +01:00
TonyO
c1af2f1179 fixed issue 1684 with decimal values 2018-08-07 11:25:49 +01:00
Antonin Delpeuch
5ee165d3b7 Fix sorting of blank values. Closes #1689. 2018-08-07 11:24:22 +01:00
Antonin Delpeuch
c7c3fab8e4 Clickable URLs in HTML exporter. Closes #1696. 2018-08-07 11:23:49 +01:00
Antonin Delpeuch
87b6aadbad Fix unescape GREL function in javascript mode. Closes #1681. 2018-08-07 11:23:14 +01:00
Jacky
1b099c0c9c
bump version 2018-07-15 16:53:00 -04:00
Owen Stephens
db13497744
Merge pull request #1670 from OpenRefine/issue1669 
Simplify parsing of HTTP headers in fetch-url operation
 2018-07-11 15:45:23 +01:00
Antonin Delpeuch
fd4ef66b75 Simplify parsing of HTTP headers in fetch-url operation 
Closes #1669 and makes it possible to specify other headers via the JSON representation of the operation.
 2018-07-02 16:03:40 +01:00
Owen Stephens
64ed24e082 Small amount of tidying up code 2018-06-23 00:28:45 +01:00
Owen Stephens
fe2e8bcbf7 Change behaviour of DecoratedValue to handle dates better 2018-06-23 00:18:00 +01:00
Owen Stephens
0e954bdb68 Use stringutils to create 'from' string for non-blank mass edits 2018-06-23 00:18:00 +01:00
Owen Stephens
db658024d6 Change behaviour of converting OffsetDateTime to string in StringUtils 2018-06-23 00:18:00 +01:00
Antonin Delpeuch
9f7d5b8786
Merge pull request #1638 from OpenRefine/issue1637 
Do not discard the recon space when marking cells as new items.
 2018-06-22 12:23:15 +02:00
Jacky
f3dbc18214
Merge pull request #1642 from ostephens/mass-edit-fix 
Mass edit fix for blanks, numbers and booleans
 2018-06-20 22:00:34 -04:00
Antonin Delpeuch
448a969cb1
Merge pull request #1656 from OpenRefine/issue/1648 
fix the template load issue and package typo
 2018-06-17 09:23:52 +01:00
Jacky
5a6c9d72f0 fix the template load issue and package typo 2018-06-16 15:43:29 -04:00
Owen Stephens
09c624a249 Updated null.toString() to return an empty string as per #1635 2018-06-14 12:36:01 +01:00
Owen Stephens
689442fff2 If only one value and that's zero length set fromBlank to true 
Added whitespace
 2018-06-08 09:40:48 +01:00
Antonin Delpeuch
a63151bbcc Do not discard the recon space when marking cells as new items. 
Fixes #1637
 2018-06-04 12:16:33 +01:00
Qi Cui
8dc8e294f7 bump the version 2018-05-27 02:02:16 -04:00
Jacky
476ece5a67
Merge pull request #1617 from OpenRefine/issue1600 
Remove DataExtensions from change serialization
 2018-05-24 15:00:34 -04:00
Antonin Delpeuch
52989b78ce Fix typo 2018-05-23 07:39:04 +02:00
Antonin Delpeuch
d8f081b977 Remove DataExtensions from change serialization 2018-05-22 23:09:51 +02:00
Antonin Delpeuch
b01177c0d9
Merge pull request #1597 from OpenRefine/issue/1588-2 
unify the internal date type
 2018-05-18 22:03:14 +02:00
Owen Stephens
19a134d4ae Corrected spelling of Calender to Calendar 2018-05-17 10:01:04 +01:00
Jacky
52a2ec05e1
Merge pull request #1598 from ostephens/no-field-null 
No field null
 2018-05-16 16:01:05 -04:00
Jacky
a103e1fb90 merge the translation 2018-05-16 15:40:05 -04:00
Jacky
5adb3e455c fix the date format bug 2018-05-14 21:25:47 -04:00
Jacky
8fe27eff58 use yyyy-mm-dd formatter when converting date to string 2018-05-12 20:19:55 -04:00
Owen Stephens
13f2ebe9fc Always return null on attempt to get non-existent field, even from null 2018-05-10 16:37:38 -04:00
Jacky
c1132aa58a add nano support 2018-05-09 22:57:10 -04:00
Jacky
f58d963dbd Merge branch 'issue/1588' of https://github.com/OpenRefine/OpenRefine into issue/1588-2 2018-05-07 17:26:02 -04:00
Antonin Delpeuch
c0e39f507a
Merge pull request #1530 from OpenRefine/wikidata-extension 
Wikidata extension
 2018-05-06 08:46:53 +02:00
Antonin Delpeuch
8c2c4546d4
Merge pull request #1568 from OpenRefine/fix-mark-new-items 
Fix identifier space for cells reconciled to New
 2018-05-06 08:45:25 +02:00
Antonin Delpeuch
b8472cf6b8
Merge pull request #1573 from OpenRefine/issue472 
Fix FillDown and BlankDown operations on records.
 2018-05-06 08:45:01 +02:00
Jacky
19f98b7ea2 java 8 time API migrate 2018-05-05 11:41:40 -04:00
Jacky
7b857a4b24 implement nano date part 2018-05-02 22:02:35 -04:00
Jacky
34c46111ea undo the incidently push to master 2018-05-02 21:40:23 -04:00
Jacky
47d6f79e35 implement nano data part 2018-05-02 21:23:17 -04:00
Antonin Delpeuch
75b1863c1c Testing for variables which generate wikibase values 2018-04-27 09:17:32 +02:00
TonyO
0eb7b4082f added null and default value options 2018-04-26 20:50:46 -05:00
Antonin Delpeuch
c9224b2e06 Fix unused import 2018-04-22 11:01:14 +02:00
Antonin Delpeuch
1daa4d1312 Fix date parsing. 
Closes #1564.
 2018-04-22 10:49:22 +02:00
TonyO
c7c0d8884a check empty cells 2018-04-22 00:39:11 -05:00
Antonin Delpeuch
53c12ca2df Fix FillDown and BlankDown operations on records. 
Closes #472.
 2018-04-21 22:11:54 +02:00
Antonin Delpeuch
716a1606b4
Merge pull request #1558 from gobertm/master 
Contains function supports now regex as second argument
 2018-04-19 10:46:15 +02:00
Antonin Delpeuch
2b237433f9 Fix identifier space for cells reconciled to New 2018-04-15 01:20:25 +02:00
Jacky
de42f4d85a migrate from JRDF to JENA library 2018-04-08 22:38:23 -04:00
Antonin Delpeuch
eeef6055a0
Merge pull request #1525 from OpenRefine/google-api 
Google api
 2018-04-07 20:28:44 +02:00
Antonin Delpeuch
8943ef9390 Merge branch 'facet-by-null-and-empty-string' of https://github.com/joanneong/OpenRefine into joanneong-facet-by-null-and-empty-string 2018-04-04 17:37:51 +02:00
Maxime Gobert
a410639627 Contains support now regex as second argument 2018-03-28 17:25:11 +02:00
TonyO
000be9a783 removed unused code from Java classes 2018-03-26 17:33:26 -05:00
TonyO
3ffbcc9db7 remove whitespaces between column names options 2018-03-25 23:23:11 -05:00
TonyO
223d16db39 added ignore facet and trim column name options 2018-03-25 21:01:53 -05:00
TonyO
3834c27c8f SQL Export Code Commit 2018-03-24 22:41:07 -05:00
Jacky
3b7fc7350d refactoring the code the show the error message if there is any 2018-03-24 20:52:15 -04:00
Antonin Delpeuch
c536584991
Merge pull request #1536 from ostephens/coalesce 
Add coalesce function
 2018-03-18 13:06:52 +00:00
Owen Stephens
6e02baaa8a Coalesce must have at least two arguments 2018-03-17 16:21:05 +00:00
Joanne
64b01a2319 Add logic for new customized facets 2018-03-16 23:05:00 +08:00
Owen Stephens
74a6782ca0
Merge pull request #1524 from OpenRefine/issue/1508 
support project backward compatibility to old version of OpenRefine
 2018-03-07 09:36:13 +00:00
Owen Stephens
01b96a0155 Add coalesce function 2018-03-07 09:10:11 +00:00
Jacky
460fa611f1 sync with master 2018-03-06 19:28:28 -05:00
Jacky
77aad7eb05 changes based on the code review 2018-03-01 22:45:14 -05:00
Jacky
23ec54b78f support project backward compatibility to old version of OpenRefine 2018-02-28 20:16:29 -05:00
Jacky
54553da733
Merge pull request #1518 from OpenRefine/issue/1509 
Fix issue #1509
 2018-02-28 19:42:07 -05:00
Jacky
ab26bf4a27 fix issue #1517, limit is writen as int and should have been read as int 2018-02-25 17:22:34 -05:00
Jacky
036866837a add UT for issue #1509 2018-02-25 15:31:59 -05:00
Jacky
c758a6b635 exclude test-out 2018-02-25 12:00:40 -05:00
Jacky
32c5838a8d
Fix issue #1509 2018-02-23 11:15:56 -05:00
Antonin Delpeuch
3dcb3f1faf
Merge pull request #1515 from ostephens/conversions 
Conversions
 2018-02-22 09:49:49 +00:00
Owen Stephens
fad40041ca Use look up for function name 2018-02-21 23:20:47 +00:00
Owen Stephens
24f1923ff4 Return errors not nulls when: wrong number of arguments supplied; first argument zero length/empty string 2018-02-21 23:20:15 +00:00
Owen Stephens
5aaf4362b0 Return errors not nulls when: wrong number of arguments supplied; first argument zero length/empty string 2018-02-21 23:19:54 +00:00
Owen Stephens
d2687cc58a Treat null and empty string as different values when doing transforms 2018-02-18 23:19:28 +00:00
Joanne
41e8c0beee Update range function to return Integer arrays 2018-02-16 15:13:37 +00:00
Joanne
35c991d9c2 Update range function to follow Python's range function 2018-02-16 15:13:37 +00:00
Joanne
03d80598aa Update range function to include step ability 2018-02-16 15:13:37 +00:00
Joanne
bd2c4348fe Implement main logic for range function 2018-02-16 15:13:37 +00:00
Joanne
41f2a27a66 Register range function 2018-02-16 15:13:37 +00:00
Joanne
6cc2a1d353 Implement main logic behind range function 2018-02-16 15:13:37 +00:00
Owen Stephens
0d04a25cf1
Merge pull request #1450 from OpenRefine/issue1448 
Make Wikitext importer more robust
 2018-02-07 17:41:23 +00:00
Antonin Delpeuch
f5ff5565ff Cleanup for Codacy and better parsing of quote character 2018-02-03 16:37:15 +00:00
Thad Guidry
a191d13b14
adding missing StringUtils import 2018-02-03 07:26:47 -06:00
Thad Guidry
c83dbe3b23
Merge branch 'master' into stundzig-develop/1086-quotecharacter 2018-02-03 07:20:45 -06:00
Antonin Delpeuch
dc4815ba7b Fix initial options for the quote character 2018-02-03 09:00:53 +00:00
Antonin Delpeuch
c9395d564c Merge branch 'develop/1086-quotecharacter' of https://github.com/stundzig/OpenRefine into stundzig-develop/1086-quotecharacter 2018-02-03 07:56:30 +00:00
Jacky
c4b0ff6bea data package metadata (#1398) 
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
 2018-02-02 13:24:19 +00:00
Antonin Delpeuch
47f44b06c4 Make Codacy happy 2018-02-02 11:57:20 +00:00
Antonin Delpeuch
1f87a26f4c Include image file names like templates in Wikitable importer 2018-02-02 11:22:15 +00:00
Antonin Delpeuch
843641ca74 Parse headers just like other cells in Wikitable importer 
This makes the column names a bit less meaningful,
but this is necessary to handle cases where headers
are inserted anywhere in the table.
 2018-02-02 10:48:31 +00:00
Antonin Delpeuch
0426704938 Add helper createProjectWithColumns 2018-01-27 13:58:06 +00:00
Owen Stephens
af3aa44e6c Tidy up for codacy 2018-01-16 18:27:13 +00:00
Owen Stephens
7464e83766 Get and set any http headers submitted when using Add Column by Fetching URLs 2018-01-16 16:54:11 +00:00
Owen Stephens
4fb1867980 Option to add http headers in Add column by fetching URLs - support adding list of headers in backend, and exposing these in UI for user to edit and use 2018-01-16 16:54:11 +00:00
Jacky
9ab897cb72 remove copyright and put more clear description 2018-01-15 20:27:25 -05:00
Jacky
3c25647f05 add find function. issue 1296 2018-01-14 22:04:26 -05:00
Antonin Delpeuch
94b9d57528
Merge pull request #1397 from tiagofernandez/save-import-options 
Revert 278f24c1 and adapt 0001d9f7 (ref. PR #1387)
 2017-12-27 09:44:19 +01:00
Tiago Fernandez
00faf2a179 Revert 278f24c1 and adapt 0001d9f7 (ref. PR #1387) 2017-12-24 12:48:23 +01:00
Jacky
fb3620b3d9
Merge pull request #1388 from jackyq2015/issue/1386 
Fix Issue #1386
 2017-12-21 08:26:29 -05:00
jackyq2015
8b203a094d add the braces 2017-12-20 13:30:38 -05:00
Tiago Fernandez
0001d9f7b2 Test ImportingUtilities.createProjectMetadata() 2017-12-20 11:07:36 +01:00
jackyq2015
ad293a1419 add missing import 2017-12-19 15:00:21 -05:00
jackyq2015
81043e58e2 fix #1386 2017-12-19 12:54:26 -05:00
Tiago Fernandez
278f24c147 Append options metadata while creating project 2017-12-18 11:38:07 +01:00
Jacky
a55e0dab1c resolve the conflict 2017-12-15 22:07:07 -05:00
Jacky
d207c74f62 merge from master 2017-12-15 22:06:30 -05:00
Jacky
659f7bc27a fix for codacy 2017-12-15 21:46:09 -05:00
Antonin Delpeuch
3c5a9b0754
Merge pull request #1357 from xseris/master 
Tag system
 2017-12-16 01:55:46 +00:00
Jacky
93f60c848b fix a typo 2017-12-15 19:50:27 -05:00
Jacky
31a613f914 Revert "don't refresh row number each time" 
This reverts commit 880620b538.
 2017-12-15 17:38:34 -05:00
Jacky
2afdcbf546 fix issue https://github.com/jackyq2015/OpenRefine/issues/2 2017-12-15 16:37:38 -05:00
Jacky
0258dc1787 fix issue #1383. use the localDateTime for project info 2017-12-15 15:24:09 -05:00
Jacky
880620b538 don't refresh row number each time 2017-12-14 22:17:51 -05:00
xseris
ee8ed8f563 Refresh tag cell 2017-12-08 00:46:59 +01:00
xseris
b16941777e Modified tags in metadata dialog and moved column right to name 2017-12-07 23:45:36 +01:00
Owen Stephens
cc71f7f64f Remove qaResult option from backend 2017-12-04 09:45:24 +00:00
xseris
f21230804b Fixed Mockito tests 2017-12-01 17:00:45 +01:00
Owen Stephens
02f864121d Removed unused variable 2017-11-29 11:01:43 +00:00
Owen Stephens
0c97ad1b69 Use string instead of string buffer 2017-11-29 09:47:31 +00:00
Owen Stephens
316da5e917 Removed comment no longer needed 2017-11-29 01:00:19 +00:00
Owen Stephens
0b433fc5ec Updated copyright statement 2017-11-29 00:59:49 +00:00
Owen Stephens
1d1f3e67cd Added break statement for default case 2017-11-29 00:58:51 +00:00
Owen Stephens
21741ad09e Pass user friendly error message to UI on invalid regular expression 2017-11-28 16:22:17 +00:00
Owen Stephens
d64dee71dd Extended tests and code for user friendly regular expression syntax errors 2017-11-28 16:20:24 +00:00
xseris
d2648d8db8 Fix tests 2017-11-28 00:16:08 +01:00
xseris
cecbfb486b Remove delete all projects option 2017-11-24 20:29:09 +01:00
xseris
a3132eeeb3 implemented tag system 2017-11-24 20:19:49 +01:00
Owen Stephens
441d9f7f10 Initial tests and code for user friendly regular expression syntax errors 2017-11-24 18:24:16 +00:00
xseris
4f67c632d0 delete all projects 2017-11-23 17:36:46 +01:00
Qi Cui
ffbc6879ce preview stage won't have the metadata populated, so protect NPE 2017-11-18 23:02:06 -05:00
Qi Cui
ae9e0af8b9 bump to version 2.8 2017-11-18 14:15:10 -05:00
Thad Guidry
daca1836e9
Merge pull request #1342 from jackyq2015/feature/metadata 
fix the row count refresh issue.  We'll work on adding a Delete Metadata option in the next milestone.
 2017-11-18 08:30:32 -06:00
Jacky
4e79c0d410 fix typo 2017-11-17 22:55:16 -05:00
Jacky
428d944e4d move the log message 2017-11-17 16:58:30 -05:00
Jacky
c32f6329d2 extract method 2017-11-17 16:52:26 -05:00
Jacky
8187799f85 fix the row count refresh issue 2017-11-17 14:38:02 -05:00
Thad Guidry
43b6cb8001
Merge pull request #1333 from jackyq2015/feature/metadata 
check if the project has the userMetadata
 2017-11-16 22:17:14 -06:00
Jacky
8d2c8b521b
Merge pull request #1334 from jackyq2015/issue/1328 
fix import multiple excel with mulitple sheets issue #1328
 2017-11-16 21:30:24 -05:00
Jacky
e07b1859db replace _ with variable for exception 2017-11-16 15:55:14 -05:00
Jacky
1d2998f374 fix the unit test 
support multi files with multi tables for open office
 2017-11-16 10:29:16 -05:00
Antonin Delpeuch
78b7f01be5
Merge pull request #1327 from ostephens/invert-filter 
Invert text search facet/text filter
 2017-11-16 08:05:31 +00:00
Jacky
6f42df95e2 fix import multiple excel with mulitple sheets issue #1328 2017-11-15 22:58:47 -05:00
Owen Stephens
7ba110e31a More succinct return statements 2017-11-14 17:40:07 +00:00
Owen Stephens
135052d033 Backend support for Inverting Text search facets 2017-11-14 14:24:50 +00:00
Antonin Delpeuch
690ba49f53 Ignore empty language files introduced by Weblate 2017-11-14 09:40:20 +00:00
Jacky
a53467f2cb remove the date field in metadata 2017-11-09 22:29:08 -05:00
Jacky
428f7dabf8 change the filed name from rowNumber to rowCount 2017-11-08 20:40:22 -05:00
Jacky
31943f6c9f change MetaData to Metadata 2017-11-08 20:30:01 -05:00
Jacky
fc2f81046f adjust the width of the table 2017-11-08 17:49:49 -05:00
Jacky
c08b0f589a add isoDateParser to sort the date 2017-11-05 09:49:58 -05:00
Jacky
51691fc06d handle the empty user metadata 2017-11-04 19:07:09 -04:00
Jacky
d9995ba259 fix issued from codacy 2017-11-03 20:12:57 -04:00
Jacky
a204809f3d fix issued from codacy 2017-11-03 19:46:07 -04:00
Jacky
acf6460ea2 remote extra ; 2017-11-03 17:48:28 -04:00
Jacky
12c5839600 use the explicit scoping 2017-11-03 17:47:18 -04:00
Jacky
986881b10f remove the _ from the method name 2017-11-03 17:39:49 -04:00
Jacky
3a3083a1de Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-11-03 17:04:48 -04:00
Jacky
edc3df1ad1 populate the row number.\n sort the project index 2017-11-03 16:59:03 -04:00
Jacky
1777a6ecf3 edit the user metadata 2017-10-29 13:46:37 -04:00
Jacky
7c83746ee7 deal with empty string properly 2017-10-27 16:59:55 -04:00
Thad Guidry
d72a2de348 Revert "Extend cross() function to support multiple-value-cell-input" 2017-10-26 17:37:10 -05:00
Jacky
6a47482ea4 support metadata edit 2017-10-26 15:47:24 -04:00
Jacky
249fa4d8d5 support metadata edit 2017-10-26 15:45:58 -04:00
Thad Guidry
3d0e96a0ce Merge pull request #1290 from claussni/cross-func-split 
Extend cross() function to support multiple-value-cell-input
 2017-10-26 14:23:23 -05:00
Ralf Claussnitzer
0b107ec5e9 Add optional 4th parameter to cross() function 
The cross function now accepts a 4th parameter defining a regular
expression separator for splitting multi-value field values when joining
projects.

See https://github.com/OpenRefine/OpenRefine/issues/1204#issuecomment-326320954
 2017-10-26 19:50:02 +02:00
Ralf Claussnitzer
9aa168633f Allow comma separated multi-value source in cross() function 
Implements support for comma separated multiple-value keys for joining
another project using the cross() function.

See https://github.com/OpenRefine/OpenRefine/issues/1204#issuecomment-326320954
 2017-10-26 19:50:02 +02:00
Antonin Delpeuch
88b10a2917 Merge pull request #1278 from ostephens/cell-split-regex 
Cell split regex
 2017-10-25 11:04:33 +01:00
Owen Stephens
224210625d Remove automatic trim of split values 2017-10-24 08:28:37 +01:00
Owen Stephens
46c3ec100e Remove unused local variables and imports 2017-10-23 08:36:08 +01:00
Antonin Delpeuch
23b643426a Fix Codacy warnings in MultiValuedCellSplitOperation 2017-10-23 08:41:14 +02:00
Owen Stephens
cccf1e55c9 Update split multi-valued cells to support split by regex and split by lengths 2017-10-22 23:54:18 +01:00
Jacky
63c1714d0a add fields for metadata 2017-10-22 00:37:59 -04:00
Jacky
f1ab6b8cd6 Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-10-21 23:49:58 -04:00
Jacky
818e139b43 add the import options to metadata 2017-10-21 23:41:11 -04:00
Antonin Delpeuch
21f4d62474 Merge pull request #1275 from OpenRefine/wikitext-url-fix 
Forbid pipe characters in URL references to ease parsing.
 2017-10-20 16:41:00 +02:00
Antonin Delpeuch
e2a22a6994 Forbid pipe characters in URL references to ease parsing. 
This is a temporary fix before we do full Wikitext parsing inside references
(this needs a change upstream). See https://github.com/sweble/sweble-wikitext/issues/67 .
 2017-10-20 15:32:58 +01:00
Antonin Delpeuch
54acf10edf Change "topic" to "item" in the UI 2017-10-18 12:39:40 +01:00
Antonin Delpeuch
473b1b135d Merge pull request #1264 from OpenRefine/issue1262 
Update Jackson to 2.9.1
 2017-10-09 20:09:49 +02:00
Antonin Delpeuch
c9cc4fb262 Update Jackson to 2.9.1 
Closes #1262
 2017-10-09 17:38:09 +01:00
Owen Stephens
bb6b8378d3 Ensure _max is never less than _min 2017-10-09 17:13:43 +01:00
Antonin Delpeuch
1da3c00cb1 Perform ASCII normalization earlier in FingerprintKeyer. 
This closes #1256.
 2017-09-27 09:23:40 +01:00
Antonin Delpeuch
cfc0b95cd1 Fix string comparison in Wikitext exporter 2017-09-23 23:13:18 +01:00
Antonin Delpeuch
a1b2c9b683 Add support for references in Wikitable importer. 
Closes #1243.
 2017-09-23 22:54:43 +01:00
Antonin Delpeuch
49564e8905 Fix bug when an extra column starts in the middle of the table 2017-09-19 13:54:27 +01:00
Antonin Delpeuch
00f8e4fc6b Merge pull request #1237. 
Conflicts:
	.classpath
	main/webapp/modules/core/langs/translation-en.json
	main/webapp/modules/core/scripts/dialogs/extend-data-preview-dialog.js

Closes #363 and #56.
 2017-08-28 16:25:50 +01:00
Antonin Delpeuch
c66e609b1d Cleanup wikitext PR for Codacy 2017-08-26 21:50:02 +01:00