Commit Graph

1202 Commits

Author SHA1 Message Date
Antonin Delpeuch
e5a831b18c Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-10-23 17:12:23 +02:00
Antonin Delpeuch
6a67f63c82 Remove empty translation (as it generates exceptions in OpenRefine) 2017-10-23 17:11:26 +02:00
Remi Rampin
6a9694d622 Fix some French translations 2017-10-23 10:51:07 -04:00
Owen Stephens
b378dea417 Minor syntax fix 2017-10-23 08:54:26 +01:00
Owen Stephens
47520d4a71 Minor fixes to syntax 2017-10-23 08:36:08 +01:00
Owen Stephens
46c3ec100e Remove unused local variables and imports 2017-10-23 08:36:08 +01:00
Antonin Delpeuch
23b643426a Fix Codacy warnings in MultiValuedCellSplitOperation 2017-10-23 08:41:14 +02:00
Owen Stephens
cccf1e55c9 Update split multi-valued cells to support split by regex and split by lengths 2017-10-22 23:54:18 +01:00
Owen Stephens
6fb7f1f476 Add UI for split multi-valued cells by sep/regex/length 2017-10-22 23:53:18 +01:00
Jacky
63c1714d0a add fields for metadata 2017-10-22 00:37:59 -04:00
Jacky
f1ab6b8cd6 Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-10-21 23:49:58 -04:00
Jacky
818e139b43 add the import options to metadata 2017-10-21 23:41:11 -04:00
Antonin Delpeuch
e5fdf48680 Fix french translation 2017-10-21 01:51:37 +01:00
Antonin Delpeuch
21f4d62474 Merge pull request #1275 from OpenRefine/wikitext-url-fix
Forbid pipe characters in URL references to ease parsing.
2017-10-20 16:41:00 +02:00
Antonin Delpeuch
686e635c93 Merge branch 'master' into topic-item 2017-10-20 15:38:47 +01:00
Antonin Delpeuch
e2a22a6994 Forbid pipe characters in URL references to ease parsing.
This is a temporary fix before we do full Wikitext parsing inside references
(this needs a change upstream). See https://github.com/sweble/sweble-wikitext/issues/67 .
2017-10-20 15:32:58 +01:00
Weblate
0cdb47a050 Merge remote-tracking branch 'origin/master' 2017-10-19 18:59:07 +02:00
Antonin Delpeuch
f36eb1558c Translated using Weblate (French)
Currently translated at 100.0% (648 of 648 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-10-19 18:59:07 +02:00
Antonin Delpeuch
4e2241de5b Fix duplicate item in Reconcile > Actions menu. Closes #1272. 2017-10-19 16:43:55 +01:00
Allan Nordhøy
641ff716a9 Added translation using Weblate (Norwegian Bokmål) 2017-10-19 12:15:15 +02:00
Antonin Delpeuch
54acf10edf Change "topic" to "item" in the UI 2017-10-18 12:39:40 +01:00
Mathieu Saby
c7b3a5ffe4 Translated using Weblate (French)
Currently translated at 100.0% (648 of 648 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-10-17 22:45:56 +02:00
Matthias Findeisen
724428aebf Translated using Weblate (German)
Currently translated at 14.0% (91 of 648 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
2017-10-15 18:46:53 +02:00
Antonin Delpeuch
473b1b135d Merge pull request #1264 from OpenRefine/issue1262
Update Jackson to 2.9.1
2017-10-09 20:09:49 +02:00
Antonin Delpeuch
c9cc4fb262 Update Jackson to 2.9.1
Closes #1262
2017-10-09 17:38:09 +01:00
Owen Stephens
bb6b8378d3 Ensure _max is never less than _min 2017-10-09 17:13:43 +01:00
Antonin Delpeuch
4036f3ff91 Merge pull request #1257 from OpenRefine/issue1256
Perform ASCII normalization earlier in FingerprintKeyer.
2017-09-27 17:54:43 +02:00
Owen Stephens
4f6284032f Code tidy + set link to new version to open in new browser tab 2017-09-27 12:22:59 +01:00
Owen Stephens
b88263bd74 Fixes as per PR comments 2017-09-27 11:47:07 +01:00
Owen Stephens
e482878596 Alert user if more recent version available from github 2017-09-27 11:00:47 +01:00
Antonin Delpeuch
1da3c00cb1 Perform ASCII normalization earlier in FingerprintKeyer.
This closes #1256.
2017-09-27 09:23:40 +01:00
Antonin Delpeuch
8e9b224730 Translated using Weblate (French)
Currently translated at 100.0% (648 of 648 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-09-24 10:25:23 +02:00
Antonin Delpeuch
5d387b1df8 Small tweaks to the wiki importer 2017-09-24 09:14:13 +01:00
Antonin Delpeuch
cfc0b95cd1 Fix string comparison in Wikitext exporter 2017-09-23 23:13:18 +01:00
Antonin Delpeuch
a1b2c9b683 Add support for references in Wikitable importer.
Closes #1243.
2017-09-23 22:54:43 +01:00
Antonin Delpeuch
9f62905be4 Merge pull request #1251 from OpenRefine/issue1106
Fix overflow of history items outside the window.
2017-09-20 15:22:55 +02:00
Antonin Delpeuch
2058081ffb Fix overflow of history items outside the window. Closes #1106. 2017-09-20 10:08:03 +01:00
Antonin Delpeuch
49564e8905 Fix bug when an extra column starts in the middle of the table 2017-09-19 13:54:27 +01:00
Emelyanov Michael
94fc4caba6 Translated using Weblate (Russian)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-09-02 15:48:51 +02:00
Antonin Delpeuch
8bc73dc886 Translated using Weblate (English)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/en/
2017-09-01 19:06:11 +02:00
Emelyanov Michael
3188140700 Translated using Weblate (Russian)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-29 10:45:07 +02:00
Antonin Delpeuch
a72f5ab3fe Translated using Weblate (French)
Currently translated at 100.0% (647 of 647 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-08-28 18:20:13 +02:00
Antonin Delpeuch
249d8f9fa5 Merge branch 'master' of ssh://github.com/OpenRefine/OpenRefine 2017-08-28 16:29:21 +01:00
Antonin Delpeuch
00f8e4fc6b Merge pull request #1237.
Conflicts:
	.classpath
	main/webapp/modules/core/langs/translation-en.json
	main/webapp/modules/core/scripts/dialogs/extend-data-preview-dialog.js

Closes #363 and #56.
2017-08-28 16:25:50 +01:00
Antonin Delpeuch
c66e609b1d Cleanup wikitext PR for Codacy 2017-08-26 21:50:02 +01:00
Emelyanov Michael
b69cfe84cd Translated using Weblate (Russian)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-26 11:25:45 +02:00
Antonin Delpeuch
0a00fd9318 Add option to include raw templates as cells 2017-08-25 14:28:30 +01:00
Emelyanov Michael
86ca5d2d71 Translated using Weblate (Russian)
Currently translated at 65.6% (422 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-24 15:19:00 +02:00
Antonin Delpeuch
554b75fa7b Fix parsing of newlines in cells 2017-08-17 19:18:50 +01:00
Antonin Delpeuch
2a3c158696 swc-parser-lazy: Add source JAR and mention the dependencies in LICENSE.txt 2017-08-17 16:37:04 +01:00
Antonin Delpeuch
7989aacc58 Cleanup for Codacy 2017-08-17 12:40:56 +01:00
Antonin Delpeuch
637e69db9d Better error reporting and testing for Wikitext import 2017-08-16 10:30:51 +01:00
Antonin Delpeuch
e47fb3f2a6 Preview table: display reconciled cells instead of blanking them 2017-08-16 09:01:16 +01:00
Antonin Delpeuch
3dcda5a42c Add reconciliation config in wikitext import. 2017-08-16 00:05:40 +01:00
Weblate
2ce71a2742 Merge remote-tracking branch 'origin/master' 2017-08-15 23:11:20 +02:00
alexey medvetsky
7fc17f1914 Translated using Weblate (Russian)
Currently translated at 15.5% (100 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-15 23:11:20 +02:00
Andrea
34b5d39192 Translated using Weblate (Italian)
Currently translated at 99.8% (642 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/it/
2017-08-15 23:11:17 +02:00
Thad Guidry
0347075120 Translated using Weblate (Chinese)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/zh/
2017-08-15 23:11:16 +02:00
Antonin Delpeuch
5390aa248c Fix DataExtensionTests (Tajikistan has only one currency, not two) 2017-08-15 22:11:00 +01:00
Antonin Delpeuch
d01de6ea85 Update tests 2017-08-15 22:09:45 +01:00
Antonin Delpeuch
86dc240335 Support reconciliation via sitelinks.
Wikilinks are automatically reconciled at import time.

Related to #56.
2017-08-15 20:17:34 +01:00
Antonin Delpeuch
aa4517ba58 Add support for colspan and rowspan in Wikitext 2017-08-15 11:28:43 +01:00
Antonin Delpeuch
73f7fdc036 Update TextFormatGuesser to support wikitext 2017-08-14 15:58:27 +01:00
Thad Guidry
d152f0792c Translated using Weblate (Chinese)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/zh/
2017-08-14 03:58:14 +02:00
Antonin Delpeuch
7b116c0388 Translated using Weblate (French)
Currently translated at 100.0% (643 of 643 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-08-13 21:22:45 +02:00
Antonin Delpeuch
18b1942169 Merge branch 'extend-data-fixes'
Conflicts:
	main/webapp/modules/core/langs/translation-en.json
2017-08-13 20:17:18 +01:00
Antonin Delpeuch
e168c900e8 Add support for table headers 2017-08-13 20:14:48 +01:00
Antonin Delpeuch
88aa6f113d Switch to newer version of swc-parser-lazy 2017-08-13 20:14:29 +01:00
Weblate
0105afc07a Merge remote-tracking branch 'origin/master' 2017-08-13 20:10:31 +02:00
alexey medvetsky
e580096b31 Translated using Weblate (Russian)
Currently translated at 11.2% (72 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/
2017-08-13 20:10:31 +02:00
alexey medvetsky
bf349a2959 Translated using Weblate (English)
Currently translated at 100.0% (641 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/en/
2017-08-13 20:10:30 +02:00
Jacky
b304e4eea7 Translated using Weblate (Chinese)
Currently translated at 98.9% (634 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/zh/
2017-08-13 20:10:30 +02:00
Jacky
c3e04010b1 Merge branch 'master' into master 2017-08-13 14:09:56 -04:00
jackyq2015
45e3ea5e86 fix testng data path issue 2017-08-13 13:03:19 -05:00
jackyq2015
f3463c332e Unit test for issue #137 2017-08-13 12:37:20 -05:00
Antonin Delpeuch
f2612b0d12 Make codacy happy 2017-08-13 17:48:18 +01:00
Antonin Delpeuch
81fa6093f4 Better error reporting in data extension
- when trying to use the operation on a non-reconciled column
- when using it with a service that does not support the protocol
2017-08-13 17:41:18 +01:00
Antonin Delpeuch
b8a781d366 Add support for links (unreconciled for now) 2017-08-13 12:57:46 +01:00
Antonin Delpeuch
4033465cb4 Small fixes to the data extension interface
- removed mention to a missing .less file
- fixed the position of the Reset button in the preview dialog
- fixed the error for empty property selections
2017-08-13 11:42:41 +01:00
Antonin Delpeuch
e6406f56ef Initial version of the wikitext importer 2017-08-13 11:26:59 +01:00
alexey medvetsky
1276793e7f Added translation using Weblate (Russian) 2017-08-12 21:44:35 +02:00
Weblate
1fec3df0cb Merge remote-tracking branch 'origin/master' 2017-08-12 10:53:12 +02:00
Antonin Delpeuch
9eeba8efe2 Fix JSON errors in Hebrew translation 2017-08-12 09:53:01 +01:00
Weblate
803896f22c Merge remote-tracking branch 'origin/master' 2017-08-12 10:46:34 +02:00
Antonin Delpeuch
bcdd04d062 Merge branch 'master' of https://github.com/noamoss/OpenRefine into noamoss
Conflicts:
	extensions/freebase/module/langs/translation-he.json
	main/webapp/modules/core/langs/translation-en.json
2017-08-12 09:45:23 +01:00
Antonin Delpeuch
80bb63cc15 Translated using Weblate (German)
Currently translated at 1.8% (12 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
2017-08-11 19:18:35 +02:00
Antonin Delpeuch
651503c143 Added translation using Weblate (German) 2017-08-11 18:50:33 +02:00
Antonin Delpeuch
9f58032293 Translated using Weblate (French)
Currently translated at 100.0% (641 of 641 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2017-08-11 09:50:32 +02:00
Antonin Delpeuch
dbb071da30 Merge branch 'default-to-english' of https://github.com/RBGKew/OpenRefine into RBGKew-default-to-english 2017-08-09 14:07:22 +01:00
Jacky
275dac976e fix #137 2017-08-07 21:53:35 -04:00
jackyq2015
588024f60d Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-08-06 22:06:58 -05:00
jackyq2015
fd58ac1e99 fix some xml issues 2017-08-06 22:05:17 -05:00
Antonin Delpeuch
3b30018cad Merge pull request #1216 from OpenRefine/issue1214
Add test for KeyValueColumnize
2017-08-03 19:31:35 +01:00
Antonin Delpeuch
135dd50413 Fix Codacy issues 2017-08-03 12:47:09 +01:00
Antonin Delpeuch
afed8eb28a Generate code coverage reports with Jacoco 2017-08-03 11:07:14 +01:00
Antonin Delpeuch
66eac0fae9 Ensure null values are not cached in URL fetching operation. Closes #1219. 2017-08-01 13:05:29 +01:00
jackyq2015
53baa5a833 put the correct params description 2017-07-28 20:37:20 -04:00
Antonin Delpeuch
7de2a57c3a Add RefineServletStub initialization in KeyValueColumnizeTests 2017-07-26 18:39:08 +01:00
Antonin Delpeuch
d941320f5e Adapt test about #1214 to show how the function currently works.
With this test, if someone tries to fix this "bug" in the future, they will realize this use case should be preserved.
2017-07-26 18:07:52 +01:00
Antonin Delpeuch
453d35032b Add test for issue #1214 2017-07-26 00:41:06 +01:00
jackyq2015
64ab5a4409 unit test for backward compatibility for cross function 2017-07-23 19:31:25 -04:00
jackyq2015
4950d29074 add backward compatility for cross function 2017-07-23 19:19:58 -04:00
Fadi Maali
0e21c0e594 correct classpath references and java version
- updated classpath references to existing versions of the libraries.
- Java version upgraded to 7 as some Java 7 specific features are used.
- corrected references to old project name (grefine-all) in the launch script
2017-07-18 22:15:46 +01:00
Thad Guidry
7f92251ed1 Merge pull request #1210 from wetneb/extend
Add data extension capabilities to the reconciliation API
2017-07-17 18:01:37 -05:00
Antonin Delpeuch
c04d9f3c33 Switch to public WMF endpoint for tests 2017-07-16 11:54:12 +01:00
Antonin Delpeuch
84c06821ee Data extension tests 2017-07-16 11:47:12 +01:00
Antonin Delpeuch
8437a9d245 Cleaner HTML form generation 2017-07-15 14:17:27 +01:00
Antonin Delpeuch
9db113faa2 Localization 2017-07-15 10:23:31 +01:00
Antonin Delpeuch
05873f283d Integration of constraints with service-defined forms 2017-07-14 22:17:40 +01:00
Antonin Delpeuch
9e3b0f1599 Remove separate endpoint, not used anymore 2017-07-14 16:47:39 +01:00
Antonin Delpeuch
3eadefe613 Do not add reconciliation statistics on columns without types 2017-07-14 12:53:54 +01:00
Antonin Delpeuch
6501c235e8 Pass the identifier and schema spaces along to create better ReconCandidates 2017-07-14 12:30:39 +01:00
Antonin Delpeuch
cc991cab21 Add nicer spinning gif while preview is loading.
Fix bug of multiple ColumnInfo being generated.
2017-07-14 11:30:17 +01:00
Antonin Delpeuch
d99128c330 Retrieve types from the extend service 2017-07-06 21:15:37 +02:00
Antonin Delpeuch
ad3a174abd Starting to migrate data extension to standard reconciliation services 2017-07-04 23:14:19 +02:00
jackyq2015
1ee339cbbd cross function test suite. #1204 2017-06-28 08:12:36 -04:00
jackyq2015
af731a3c1f add test case for cross function 2017-06-25 23:27:48 -04:00
jackyq2015
f03be76475 Extend cross() function to take either a cell or a value #1204 2017-06-25 21:04:00 -04:00
Felix Lohmeier
2557cc5419 bugfix for new option autosave period 2017-06-24 22:42:49 +02:00
Felix Lohmeier
e54199a6f1 added options for initial java heap space and autosave period 2017-06-22 12:27:55 +02:00
jackyq2015
131dd5fcae include the column selector dialog file in controller 2017-06-02 18:17:08 -04:00
jackyq2015
20acc17c05 add "transform all" support to allow the operation to be applied to multiple columns 2017-05-31 22:37:07 -04:00
jackyq2015
4a0892eb98 add "transform all" support to allow the operation to be applied to multiple columns 2017-05-31 22:33:40 -04:00
Adi Eyal
09c00c6a19 Fixes #1181 2017-05-05 23:38:37 +02:00
Bob Harper
909df1b6a7 xor can also accept 2+ params, rewrite tests to be consistent 2017-04-27 11:20:48 +01:00
Bob Harper
4ea0f440e9 remove 3 param error test for 'and' and 'or' 2017-04-27 11:07:04 +01:00
Bob Harper
ef4e039998 allow more than 2 AND and OR conditions 2017-04-26 20:51:58 +01:00
Thad Guidry
7784d436a9 Added missing contributors and Special Thankers 2017-03-17 07:48:15 -05:00
wangwenxiang
660df900d4 Fix bug: load wrong new value for RowStarChange 2017-03-15 12:54:01 +08:00
wangwenxiang
0314f49f36 Fix bug: load wrong new value for RowFlagChange 2017-03-15 10:39:33 +08:00
Jacky
912600f0bd Merge pull request #1178 from wetneb/url_caching
Add caching in URL fetching
2017-03-09 17:28:38 -05:00
Antonin Delpeuch
22124ac57e Add checkbox to disable caching 2017-03-09 00:21:34 +00:00
Antonin Delpeuch
32c232c2d6 Move to Guava's cache for ColumnAdditionByFetchingURLsOperation 2017-03-08 09:32:34 +00:00
Antonin Delpeuch
a9c4b0af16 Cache String, not URL, in ColumnAdditionByFetchingURLsOperation 2017-03-08 07:45:11 +00:00
Antonin Delpeuch
3297e6e7ee Add tests for the URL caching feature 2017-03-08 00:50:09 +00:00
Antonin Delpeuch
782a2f5b48 Add caching in URL fetching 2017-03-07 20:24:50 +00:00
Thad Guidry
291d70c9d0 Merge pull request #1168 from amiaopensource/master
fix PR #1092 to work with Firefox
2017-02-10 15:02:05 -06:00
Jacky
5aede573dc bump version to 2.7 2017-02-10 15:55:58 -05:00
Cora Johnson-Roberson
d12dc36e27 add export cluster link to body (needed for Firefox) 2017-02-10 12:18:07 -05:00
Cora Johnson-Roberson
2eebfbf2f7 minor formatting 2017-02-10 09:22:31 -05:00
Cora Johnson-Roberson
d00919a26c add other translations 2017-02-10 09:10:23 -05:00
Cora Johnson-Roberson
fa030f7194 Merge branch 'master' of https://github.com/OpenRefine/OpenRefine 2017-02-10 08:40:44 -05:00
Thad Guidry
6dcd8be64c Merge pull request #1160 from tomokane/fix_not_working_cluster_functions_when_select_japanese_lang
fix not working clustering functions when it select japanese lang.
2017-02-09 21:33:11 -06:00
Antonin Delpeuch
197de90294 Remove the namespaced service dialog, as it only worked with Freebase. 2017-02-08 18:14:33 +00:00
Antonin Delpeuch
aaf8f93c04 Remove various references to Freebase, where I'm confident 2017-02-08 17:56:03 +00:00
Antonin Delpeuch
5d8d372244 Simpler version 2017-02-07 23:59:12 +00:00
Antonin Delpeuch
d967605816 Change default reconciliation service to Wikidata 2017-02-07 23:29:43 +00:00
Akihiko Tomokane
89f0752e5f fix not working cluster functions when it select japanese lang. 2016-11-15 16:34:19 +09:00
Jacky
b14dd56b80 Merge pull request #1146 from jackyq2015/bugfix/transpose
fix #1138. column transpose
2016-11-06 13:17:55 -05:00
Joe Wicentowski
af1cc19c6d Add labels for checkboxes in text facet, making them clickable
Checkboxes are small targets. Making the labels clickable for toggling checkboxes improves usability.
2016-09-19 09:03:30 -04:00