Commit Graph

1172 Commits

Author SHA1 Message Date
Antonin Delpeuch
1da3c00cb1 Perform ASCII normalization earlier in FingerprintKeyer.
This closes #1256.
2017-09-27 09:23:40 +01:00
Antonin Delpeuch
8e9b224730 Translated using Weblate (French)
Currently translated at 100.0% (648 of 648 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-09-24 10:25:23 +02:00
Antonin Delpeuch
5d387b1df8 Small tweaks to the wiki importer 2017-09-24 09:14:13 +01:00
Antonin Delpeuch
cfc0b95cd1 Fix string comparison in Wikitext exporter 2017-09-23 23:13:18 +01:00
Antonin Delpeuch
a1b2c9b683 Add support for references in Wikitable importer.
Closes #1243.
2017-09-23 22:54:43 +01:00
Antonin Delpeuch
9f62905be4 Merge pull request #1251 from OpenRefine/issue1106
Fix overflow of history items outside the window.
2017-09-20 15:22:55 +02:00
Antonin Delpeuch
2058081ffb Fix overflow of history items outside the window. Closes #1106. 2017-09-20 10:08:03 +01:00
Antonin Delpeuch
49564e8905 Fix bug when an extra column starts in the middle of the table 2017-09-19 13:54:27 +01:00
Emelyanov Michael
94fc4caba6 Translated using Weblate (Russian)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-09-02 15:48:51 +02:00
Antonin Delpeuch
8bc73dc886 Translated using Weblate (English)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/en/
2017-09-01 19:06:11 +02:00
Emelyanov Michael
3188140700 Translated using Weblate (Russian)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-29 10:45:07 +02:00
Antonin Delpeuch
a72f5ab3fe Translated using Weblate (French)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-08-28 18:20:13 +02:00
Antonin Delpeuch
249d8f9fa5 Merge branch 'master' of ssh://github.com/OpenRefine/OpenRefine 2017-08-28 16:29:21 +01:00
Antonin Delpeuch
00f8e4fc6b Merge pull request #1237.
Conflicts:
	.classpath
	main/webapp/modules/core/langs/translation-en.json
	main/webapp/modules/core/scripts/dialogs/extend-data-preview-dialog.js

Closes #363 and #56.
2017-08-28 16:25:50 +01:00
Antonin Delpeuch
c66e609b1d Cleanup wikitext PR for Codacy 2017-08-26 21:50:02 +01:00
Emelyanov Michael
b69cfe84cd Translated using Weblate (Russian)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-26 11:25:45 +02:00
Antonin Delpeuch
0a00fd9318 Add option to include raw templates as cells 2017-08-25 14:28:30 +01:00
Emelyanov Michael
86ca5d2d71 Translated using Weblate (Russian)
Currently translated at 65.6% (422 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-24 15:19:00 +02:00
Antonin Delpeuch
554b75fa7b Fix parsing of newlines in cells 2017-08-17 19:18:50 +01:00
Antonin Delpeuch
2a3c158696 swc-parser-lazy: Add source JAR and mention the dependencies in LICENSE.txt 2017-08-17 16:37:04 +01:00
Antonin Delpeuch
7989aacc58 Cleanup for Codacy 2017-08-17 12:40:56 +01:00
Antonin Delpeuch
637e69db9d Better error reporting and testing for Wikitext import 2017-08-16 10:30:51 +01:00
Antonin Delpeuch
e47fb3f2a6 Preview table: display reconciled cells instead of blanking them 2017-08-16 09:01:16 +01:00
Antonin Delpeuch
3dcda5a42c Add reconciliation config in wikitext import. 2017-08-16 00:05:40 +01:00
Weblate
2ce71a2742 Merge remote-tracking branch 'origin/master' 2017-08-15 23:11:20 +02:00
alexey medvetsky
7fc17f1914 Translated using Weblate (Russian)
Currently translated at 15.5% (100 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-15 23:11:20 +02:00
Andrea
34b5d39192 Translated using Weblate (Italian)
Currently translated at 99.8% (642 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/it/
2017-08-15 23:11:17 +02:00
Thad Guidry
0347075120 Translated using Weblate (Chinese)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/zh/
2017-08-15 23:11:16 +02:00
Antonin Delpeuch
5390aa248c Fix DataExtensionTests (Tajikistan has only one currency, not two) 2017-08-15 22:11:00 +01:00
Antonin Delpeuch
d01de6ea85 Update tests 2017-08-15 22:09:45 +01:00
Antonin Delpeuch
86dc240335 Support reconciliation via sitelinks.
Wikilinks are automatically reconciled at import time.

Related to #56.
2017-08-15 20:17:34 +01:00
Antonin Delpeuch
aa4517ba58 Add support for colspan and rowspan in Wikitext 2017-08-15 11:28:43 +01:00
Antonin Delpeuch
73f7fdc036 Update TextFormatGuesser to support wikitext 2017-08-14 15:58:27 +01:00
Thad Guidry
d152f0792c Translated using Weblate (Chinese)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/zh/
2017-08-14 03:58:14 +02:00
Antonin Delpeuch
7b116c0388 Translated using Weblate (French)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-08-13 21:22:45 +02:00
Antonin Delpeuch
18b1942169 Merge branch 'extend-data-fixes'
Conflicts:
	main/webapp/modules/core/langs/translation-en.json
2017-08-13 20:17:18 +01:00
Antonin Delpeuch
e168c900e8 Add support for table headers 2017-08-13 20:14:48 +01:00
Antonin Delpeuch
88aa6f113d Switch to newer version of swc-parser-lazy 2017-08-13 20:14:29 +01:00
Weblate
0105afc07a Merge remote-tracking branch 'origin/master' 2017-08-13 20:10:31 +02:00
alexey medvetsky
e580096b31 Translated using Weblate (Russian)
Currently translated at 11.2% (72 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-13 20:10:31 +02:00
alexey medvetsky
bf349a2959 Translated using Weblate (English)
Currently translated at 100.0% (641 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/en/
2017-08-13 20:10:30 +02:00
Jacky
b304e4eea7 Translated using Weblate (Chinese)
Currently translated at 98.9% (634 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/zh/
2017-08-13 20:10:30 +02:00
Jacky
c3e04010b1 Merge branch 'master' into master 2017-08-13 14:09:56 -04:00
jackyq2015
45e3ea5e86 fix testng data path issue 2017-08-13 13:03:19 -05:00
jackyq2015
f3463c332e Unit test for issue #137 2017-08-13 12:37:20 -05:00
Antonin Delpeuch
f2612b0d12 Make codacy happy 2017-08-13 17:48:18 +01:00
Antonin Delpeuch
81fa6093f4 Better error reporting in data extension
- when trying to use the operation on a non-reconciled column
- when using it with a service that does not support the protocol
2017-08-13 17:41:18 +01:00
Antonin Delpeuch
b8a781d366 Add support for links (unreconciled for now) 2017-08-13 12:57:46 +01:00
Antonin Delpeuch
4033465cb4 Small fixes to the data extension interface
- removed mention to a missing .less file
- fixed the position of the Reset button in the preview dialog
- fixed the error for empty property selections
2017-08-13 11:42:41 +01:00
Antonin Delpeuch
e6406f56ef Initial version of the wikitext importer 2017-08-13 11:26:59 +01:00
alexey medvetsky
1276793e7f Added translation using Weblate (Russian) 2017-08-12 21:44:35 +02:00
Weblate
1fec3df0cb Merge remote-tracking branch 'origin/master' 2017-08-12 10:53:12 +02:00
Antonin Delpeuch
9eeba8efe2 Fix JSON errors in Hebrew translation 2017-08-12 09:53:01 +01:00
Weblate
803896f22c Merge remote-tracking branch 'origin/master' 2017-08-12 10:46:34 +02:00
Antonin Delpeuch
bcdd04d062 Merge branch 'master' of https://github.com/noamoss/OpenRefine into noamoss
Conflicts:
	extensions/freebase/module/langs/translation-he.json
	main/webapp/modules/core/langs/translation-en.json
2017-08-12 09:45:23 +01:00
Antonin Delpeuch
80bb63cc15 Translated using Weblate (German)
Currently translated at 1.8% (12 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
2017-08-11 19:18:35 +02:00
Antonin Delpeuch
651503c143 Added translation using Weblate (German) 2017-08-11 18:50:33 +02:00
Antonin Delpeuch
9f58032293 Translated using Weblate (French)
Currently translated at 100.0% (641 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-08-11 09:50:32 +02:00
Antonin Delpeuch
dbb071da30 Merge branch 'default-to-english' of https://github.com/RBGKew/OpenRefine into RBGKew-default-to-english 2017-08-09 14:07:22 +01:00
Jacky
275dac976e fix #137 2017-08-07 21:53:35 -04:00
jackyq2015
588024f60d Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-08-06 22:06:58 -05:00
jackyq2015
fd58ac1e99 fix some xml issues 2017-08-06 22:05:17 -05:00
Antonin Delpeuch
3b30018cad Merge pull request #1216 from OpenRefine/issue1214
Add test for KeyValueColumnize
2017-08-03 19:31:35 +01:00
Antonin Delpeuch
135dd50413 Fix Codacy issues 2017-08-03 12:47:09 +01:00
Antonin Delpeuch
afed8eb28a Generate code coverage reports with Jacoco 2017-08-03 11:07:14 +01:00
Antonin Delpeuch
66eac0fae9 Ensure null values are not cached in URL fetching operation. Closes #1219. 2017-08-01 13:05:29 +01:00
jackyq2015
53baa5a833 put the correct params description 2017-07-28 20:37:20 -04:00
Antonin Delpeuch
7de2a57c3a Add RefineServletStub initialization in KeyValueColumnizeTests 2017-07-26 18:39:08 +01:00
Antonin Delpeuch
d941320f5e Adapt test about #1214 to show how the function currently works.
With this test, if someone tries to fix this "bug" in the future, they will realize this use case should be preserved.
2017-07-26 18:07:52 +01:00
Antonin Delpeuch
453d35032b Add test for issue #1214 2017-07-26 00:41:06 +01:00
jackyq2015
64ab5a4409 unit test for backward compatibility for cross function 2017-07-23 19:31:25 -04:00
jackyq2015
4950d29074 add backward compatility for cross function 2017-07-23 19:19:58 -04:00
Fadi Maali
0e21c0e594 correct classpath references and java version
- updated classpath references to existing versions of the libraries.
- Java version upgraded to 7 as some Java 7 specific features are used.
- corrected references to old project name (grefine-all) in the launch script
2017-07-18 22:15:46 +01:00
Thad Guidry
7f92251ed1 Merge pull request #1210 from wetneb/extend
Add data extension capabilities to the reconciliation API
2017-07-17 18:01:37 -05:00
Antonin Delpeuch
c04d9f3c33 Switch to public WMF endpoint for tests 2017-07-16 11:54:12 +01:00
Antonin Delpeuch
84c06821ee Data extension tests 2017-07-16 11:47:12 +01:00
Antonin Delpeuch
8437a9d245 Cleaner HTML form generation 2017-07-15 14:17:27 +01:00
Antonin Delpeuch
9db113faa2 Localization 2017-07-15 10:23:31 +01:00
Antonin Delpeuch
05873f283d Integration of constraints with service-defined forms 2017-07-14 22:17:40 +01:00
Antonin Delpeuch
9e3b0f1599 Remove separate endpoint, not used anymore 2017-07-14 16:47:39 +01:00
Antonin Delpeuch
3eadefe613 Do not add reconciliation statistics on columns without types 2017-07-14 12:53:54 +01:00
Antonin Delpeuch
6501c235e8 Pass the identifier and schema spaces along to create better ReconCandidates 2017-07-14 12:30:39 +01:00
Antonin Delpeuch
cc991cab21 Add nicer spinning gif while preview is loading.
Fix bug of multiple ColumnInfo being generated.
2017-07-14 11:30:17 +01:00
Antonin Delpeuch
d99128c330 Retrieve types from the extend service 2017-07-06 21:15:37 +02:00
Antonin Delpeuch
ad3a174abd Starting to migrate data extension to standard reconciliation services 2017-07-04 23:14:19 +02:00
jackyq2015
1ee339cbbd cross function test suite. #1204 2017-06-28 08:12:36 -04:00
jackyq2015
af731a3c1f add test case for cross function 2017-06-25 23:27:48 -04:00
jackyq2015
f03be76475 Extend cross() function to take either a cell or a value #1204 2017-06-25 21:04:00 -04:00
Felix Lohmeier
2557cc5419 bugfix for new option autosave period 2017-06-24 22:42:49 +02:00
Felix Lohmeier
e54199a6f1 added options for initial java heap space and autosave period 2017-06-22 12:27:55 +02:00
jackyq2015
131dd5fcae include the column selector dialog file in controller 2017-06-02 18:17:08 -04:00
jackyq2015
20acc17c05 add "transform all" support to allow the operation to be applied to multiple columns 2017-05-31 22:37:07 -04:00
jackyq2015
4a0892eb98 add "transform all" support to allow the operation to be applied to multiple columns 2017-05-31 22:33:40 -04:00
Adi Eyal
09c00c6a19 Fixes #1181 2017-05-05 23:38:37 +02:00
Bob Harper
909df1b6a7 xor can also accept 2+ params, rewrite tests to be consistent 2017-04-27 11:20:48 +01:00
Bob Harper
4ea0f440e9 remove 3 param error test for 'and' and 'or' 2017-04-27 11:07:04 +01:00
Bob Harper
ef4e039998 allow more than 2 AND and OR conditions 2017-04-26 20:51:58 +01:00
Thad Guidry
7784d436a9 Added missing contributors and Special Thankers 2017-03-17 07:48:15 -05:00
wangwenxiang
660df900d4 Fix bug: load wrong new value for RowStarChange 2017-03-15 12:54:01 +08:00
wangwenxiang
0314f49f36 Fix bug: load wrong new value for RowFlagChange 2017-03-15 10:39:33 +08:00
Jacky
912600f0bd Merge pull request #1178 from wetneb/url_caching
Add caching in URL fetching
2017-03-09 17:28:38 -05:00
Antonin Delpeuch
22124ac57e Add checkbox to disable caching 2017-03-09 00:21:34 +00:00
Antonin Delpeuch
32c232c2d6 Move to Guava's cache for ColumnAdditionByFetchingURLsOperation 2017-03-08 09:32:34 +00:00
Antonin Delpeuch
a9c4b0af16 Cache String, not URL, in ColumnAdditionByFetchingURLsOperation 2017-03-08 07:45:11 +00:00
Antonin Delpeuch
3297e6e7ee Add tests for the URL caching feature 2017-03-08 00:50:09 +00:00
Antonin Delpeuch
782a2f5b48 Add caching in URL fetching 2017-03-07 20:24:50 +00:00
Thad Guidry
291d70c9d0 Merge pull request #1168 from amiaopensource/master
fix PR #1092 to work with Firefox
2017-02-10 15:02:05 -06:00
Jacky
5aede573dc bump version to 2.7 2017-02-10 15:55:58 -05:00
Cora Johnson-Roberson
d12dc36e27 add export cluster link to body (needed for Firefox) 2017-02-10 12:18:07 -05:00
Cora Johnson-Roberson
2eebfbf2f7 minor formatting 2017-02-10 09:22:31 -05:00
Cora Johnson-Roberson
d00919a26c add other translations 2017-02-10 09:10:23 -05:00
Cora Johnson-Roberson
fa030f7194 Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-02-10 08:40:44 -05:00
Thad Guidry
6dcd8be64c Merge pull request #1160 from tomokane/fix_not_working_cluster_functions_when_select_japanese_lang
fix not working clustering functions when it select japanese lang.
2017-02-09 21:33:11 -06:00
Antonin Delpeuch
197de90294 Remove the namespaced service dialog, as it only worked with Freebase. 2017-02-08 18:14:33 +00:00
Antonin Delpeuch
aaf8f93c04 Remove various references to Freebase, where I'm confident 2017-02-08 17:56:03 +00:00
Antonin Delpeuch
5d8d372244 Simpler version 2017-02-07 23:59:12 +00:00
Antonin Delpeuch
d967605816 Change default reconciliation service to Wikidata 2017-02-07 23:29:43 +00:00
Akihiko Tomokane
89f0752e5f fix not working cluster functions when it select japanese lang. 2016-11-15 16:34:19 +09:00
Jacky
b14dd56b80 Merge pull request #1146 from jackyq2015/bugfix/transpose
fix #1138. column transpose
2016-11-06 13:17:55 -05:00
Joe Wicentowski
af1cc19c6d Add labels for checkboxes in text facet, making them clickable
Checkboxes are small targets. Making the labels clickable for toggling checkboxes improves usability.
2016-09-19 09:03:30 -04:00
Qi Cui
773151380e fix #1138. column transpose 2016-08-24 13:56:35 -04:00
yamazakiryo
c8e9f6a7d0 fixed file format expression more friendly 2016-06-14 20:51:47 +09:00
yamazakiryo
bedb8c03bf translate language-package into Japanese 2016-06-08 21:43:21 +09:00
Tom Morris
aa65bc5c18 Throw exception on error instead of logging to console 2016-05-17 15:10:09 -04:00
Tom Morris
6df822e5a6 Set ContentType to application/json 2016-05-17 15:10:09 -04:00
Tom Morris
5d45566455 Protect against NPE when content type is missing 2016-05-17 15:10:09 -04:00
Cora Johnson-Roberson
c2c4d92ce7 add method and function to JSON 2015-11-18 11:27:33 -08:00
Cora Johnson-Roberson
0b0abf6801 add timestamp to json 2015-11-18 11:26:24 -08:00
Cora Johnson-Roberson
534d2bd6c1 add project name to json 2015-11-18 11:25:13 -08:00
Cora Johnson-Roberson
e1a8e44a02 export clusters button added 2015-11-18 11:17:29 -08:00
Vitor Baptista
2a33d1ed99 Fix typo on encodeURIComponent JS call 2015-11-17 13:55:19 +00:00
Scott Wiedemann
16b0453b74 Update ToDate.java
Updating SimpleDateFormat api doc url for ToDate function.
2015-11-13 12:27:16 -07:00
Tom Morris
be7f880cbe Revert addition of synchronized methods 2015-10-16 19:33:15 -04:00
Tom Morris
9fddf5014f Improved fix for #1056 & #1060
Remove conditional logic and make it harder for states to get out of
sync.
2015-10-16 18:53:21 -04:00
Tom Morris
e3858da843 Escape cell data for HTML - fixes #1049 2015-10-16 15:41:03 -04:00
Tom Morris
c74fce0180 Fix URL encoding - fixes #1059
Fixes both permalink & "browse this cluster".
Substitutes encodeURIComponent for escape
2015-10-16 15:41:03 -04:00
Tom Morris
4834deca5e Add TODO for _.escape cleanup 2015-10-16 15:41:03 -04:00
Martin Magdinier
8b4a1d577a Merge pull request #1079 from RefinePro/issue-796
fixed issue #796 Columnize by key/value columns creates empty lines
2015-10-08 14:01:07 -04:00
jackyq2015
7a2a0eb52f fixed issue #796 Columnize by key/value columns creates empty lines 2015-09-29 20:12:05 -04:00
Tom Morris
a2aa8dffb4 Merge pull request #1076 from nestorjal/master
ES translation updated - translation for throttle-delay
2015-09-29 11:13:06 -04:00
nestorjal
f78f09d658 Update translation-es.json 2015-09-28 10:30:13 -05:00
Tom Morris
1222acdc57 Update POI to 3.13 - replaces #1029 2015-09-25 20:06:21 -04:00
Tom Morris
48681e8877 Move assert where it belongs 2015-09-25 20:01:27 -04:00
Tom Morris
be936a86eb Clean up PR #1055 2015-09-25 19:01:16 -04:00
Tom Morris
de66afa512 Revert " Use new algorithm for levenshtein clustering" 2015-09-25 16:44:25 -04:00
magdmartin
f286785955 Merge pull request #1069 from nestorjal/master
Update translation-es.json
2015-09-24 17:24:34 -04:00
nestorjal
c1764df20a Line 516 fixed
Spanish translation of the term updated.
2015-09-21 21:38:09 -05:00
Thad Guidry
175f4a5319 Merge pull request #1047 from lemmingapex/master
Fixed #1046 Combine xls and xlsx formats by inspecting file header information in ExcelImporter
2015-09-21 20:33:05 -05:00
Thad Guidry
20220f7294 Merge pull request #1068 from RefinePro/issues-freebase-remove
Issues freebase remove
2015-09-21 20:24:06 -05:00
Thad Guidry
94e219042e Merge pull request #1007 from lispc/master
Use new algorithm for levenshtein clustering
2015-09-21 20:23:45 -05:00