Tom Morris
a3fab26cca
Fix the text format guesser so it doesn't inappropriately guess WikiText ( #2924 )
...
* Fix text guesser so it doesn't guess wikitext
Fixes #2850
- Add simple magic detector for zip & gzip files to keep
it from attempting to guess binary files
- Add a counter for C0 controls for the same reason
- Tighten wikitable counters to require marker at
beginning of the line, per the specification
- Refactor to use Apache Commons instead of private
counting methods
- Add tests for most TextGuesser formats
* Remove misplaced duplicate test data file
* Fix LGTM warning + minor cleanups
* Use BoundedInputStream to prevent runaway lines
2020-07-15 08:56:00 +02:00
Antonin Delpeuch
fb9c8e5fef
Merge pull request #2939 from weblate/weblate-openrefine-translations
...
Translations update from Weblate
2020-07-15 00:15:58 +02:00
Hosted Weblate
f9d6c2b93b
Merge branch 'origin/master' into Weblate.
2020-07-14 22:41:55 +02:00
Susanna Ånäs
f01ca800bf
Translated using Weblate (Finnish)
...
Currently translated at 49.2% (95 of 193 strings)
Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/fi/
2020-07-14 22:41:51 +02:00
Isao Matsunami
a2100f64f7
Translated using Weblate (Japanese)
...
Currently translated at 100.0% (753 of 753 strings)
Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-07-14 22:41:51 +02:00
Johan Richer
5ac4362c86
Fix FAQ URL ( #2938 )
2020-07-14 20:51:53 +02:00
Ekta Mishra
c7a8dfb329
Reuse Constraint IDs and Property IDs ( #2937 )
...
* Revert "Revert "Reused Constraint IDs and Parameter PIDs (#2893 )""
This reverts commit 4c739be843
.
* Reuse Constraint IDs and Parameter PIDs
After the cleanup of MockConstraintFetcher, using constraint IDs and property IDs defined in the corresponding scrtinizer for the test files.
2020-07-14 20:51:18 +02:00
Antonin Delpeuch
4c739be843
Revert "Reused Constraint IDs and Parameter PIDs ( #2893 )"
...
This introduces a build failure since other refactorings took place.
This reverts commit f41ce3a752
.
2020-07-14 20:15:59 +02:00
Ekta Mishra
f41ce3a752
Reused Constraint IDs and Parameter PIDs ( #2893 )
...
Reused the hardcodedd constraint & paramter IDs from the scrutinizer classes into the test classes repectively.
2020-07-14 20:12:46 +02:00
Tom Morris
561619399c
Fix order dependent NPE in LoadLanguage test ( #2922 )
...
* Ensure ProjectManager is initialized before test - fixes #2895
* Fix indentation (detabify)
2020-07-14 18:06:04 +02:00
Ekta Mishra
c5e6ac9f90
Remove unused scrutinizer specific methods ( #2935 )
...
After adding the code for fetching parameters for different scrutinizers in their corresponding classes, we should remove the redundant code from the ConstraintFetcher
2020-07-14 17:51:06 +02:00
Tom Morris
ed68541988
Remove informational logging from tests that are passing ( #2923 )
...
* Change logging from info to debug
* Make tests less chatty when they're passing
2020-07-14 17:47:36 +02:00
Urvashi Gupta
f00129b852
fixes service panel toggling ( #2915 )
2020-07-14 16:46:10 +02:00
Ekta Mishra
bf3d7234b9
Add ItemRequires Constraint ( #2901 )
...
* Add ItemRequires Constraint
Implemented Item requires constraint as part of #2354
* done with implementation of ItemRequiresScrutinizer Class
* Test class added with suitable test cases
2020-07-14 16:11:25 +02:00
Tom Morris
233cb95289
Ignore events which don't change text input - fixes #1134 ( #2846 )
...
* Ignore events which don't change text input - fixes #1134
* Fix bind
2020-07-14 08:35:46 +02:00
Tom Morris
0645c2a726
Merge pull request #2890 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-source-plugin-3.2.1
...
Bump maven-source-plugin from 2.2.1 to 3.2.1
2020-07-13 14:56:13 -04:00
Tom Morris
ff632fb04e
Merge pull request #2886 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-javadoc-plugin-3.2.0
...
Bump maven-javadoc-plugin from 2.9.1 to 3.2.0
2020-07-13 14:56:00 -04:00
dependabot-preview[bot]
58b1995341
Bump maven-source-plugin from 2.2.1 to 3.2.1
...
Bumps [maven-source-plugin](https://github.com/apache/maven-source-plugin ) from 2.2.1 to 3.2.1.
- [Release notes](https://github.com/apache/maven-source-plugin/releases )
- [Commits](https://github.com/apache/maven-source-plugin/compare/maven-source-plugin-2.2.1...maven-source-plugin-3.2.1 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 18:13:33 +00:00
dependabot-preview[bot]
01f2e0c4ca
Bump maven-javadoc-plugin from 2.9.1 to 3.2.0
...
Bumps [maven-javadoc-plugin](https://github.com/apache/maven-javadoc-plugin ) from 2.9.1 to 3.2.0.
- [Release notes](https://github.com/apache/maven-javadoc-plugin/releases )
- [Commits](https://github.com/apache/maven-javadoc-plugin/compare/maven-javadoc-plugin-2.9.1...maven-javadoc-plugin-3.2.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 18:12:51 +00:00
Tom Morris
3edfc334a2
Merge pull request #2931 from OpenRefine/dependabot/maven/packaging/com.thoughtworks.xstream-xstream-1.4.10-java7
...
Bump xstream from 1.4.9 to 1.4.12 in /packaging
2020-07-13 14:09:03 -04:00
Tom Morris
4e6e080d3e
Try xstream 1.4.12 instead
2020-07-13 13:53:54 -04:00
dependabot[bot]
bc92d96e2c
Bump xstream from 1.4.9 to 1.4.10-java7 in /packaging
...
Bumps [xstream](https://github.com/x-stream/xstream ) from 1.4.9 to 1.4.10-java7.
- [Release notes](https://github.com/x-stream/xstream/releases )
- [Commits](https://github.com/x-stream/xstream/commits )
Signed-off-by: dependabot[bot] <support@github.com>
2020-07-13 17:23:55 +00:00
Tom Morris
5c7177ca71
Revert "Merge pull request #2851 from OpenRefine/dependabot/maven/packaging/com.thoughtworks.xstream-xstream-1.4.10-java7"
...
This reverts commit 53152e97a5
, reversing
changes made to ce85a96ba6
.
xstream update is incompatible with packaging step
2020-07-13 13:22:38 -04:00
Tom Morris
53152e97a5
Merge pull request #2851 from OpenRefine/dependabot/maven/packaging/com.thoughtworks.xstream-xstream-1.4.10-java7
...
Bump xstream from 1.4.9 to 1.4.10-java7 in /packaging
2020-07-13 13:07:43 -04:00
Tom Morris
ce85a96ba6
Merge pull request #2887 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-deploy-plugin-2.8.2
...
Bump maven-deploy-plugin from 2.8.1 to 2.8.2
2020-07-13 13:05:55 -04:00
Tom Morris
aef1716d6a
Merge pull request #2926 from OpenRefine/dependabot/maven/com.google.apis-google-api-services-drive-v3-rev20200618-1.30.10
...
Bump google-api-services-drive from v3-rev20200618-1.30.9 to v3-rev20200618-1.30.10
2020-07-13 12:50:04 -04:00
Tom Morris
50bb76e53a
Merge pull request #2929 from OpenRefine/dependabot/maven/com.google.apis-google-api-services-sheets-v4-rev20200616-1.30.10
...
Bump google-api-services-sheets from v4-rev20200616-1.30.9 to v4-rev20200616-1.30.10
2020-07-13 12:49:36 -04:00
Tom Morris
3958c57a17
Merge pull request #2928 from OpenRefine/dependabot/maven/com.squareup.okhttp3-mockwebserver-4.8.0
...
Bump mockwebserver from 4.7.2 to 4.8.0
2020-07-13 12:38:21 -04:00
Tom Morris
74d959018f
Merge pull request #2927 from OpenRefine/dependabot/maven/mysql-mysql-connector-java-8.0.21
...
Bump mysql-connector-java from 8.0.20 to 8.0.21
2020-07-13 12:34:33 -04:00
dependabot-preview[bot]
498325ded9
Bump google-api-services-sheets
...
Bumps google-api-services-sheets from v4-rev20200616-1.30.9 to v4-rev20200616-1.30.10.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 08:39:42 +00:00
dependabot-preview[bot]
396efc0d1b
Bump mockwebserver from 4.7.2 to 4.8.0
...
Bumps [mockwebserver](https://github.com/square/okhttp ) from 4.7.2 to 4.8.0.
- [Release notes](https://github.com/square/okhttp/releases )
- [Changelog](https://github.com/square/okhttp/blob/master/CHANGELOG.md )
- [Commits](https://github.com/square/okhttp/compare/parent-4.7.2...parent-4.8.0 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 08:39:23 +00:00
dependabot-preview[bot]
906e9d1279
Bump mysql-connector-java from 8.0.20 to 8.0.21
...
Bumps [mysql-connector-java](https://github.com/mysql/mysql-connector-j ) from 8.0.20 to 8.0.21.
- [Release notes](https://github.com/mysql/mysql-connector-j/releases )
- [Changelog](https://github.com/mysql/mysql-connector-j/blob/release/8.0/CHANGES )
- [Commits](https://github.com/mysql/mysql-connector-j/compare/8.0.20...8.0.21 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 08:39:00 +00:00
dependabot-preview[bot]
940c508584
Bump google-api-services-drive
...
Bumps google-api-services-drive from v3-rev20200618-1.30.9 to v3-rev20200618-1.30.10.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 08:38:36 +00:00
Tom Morris
5717d17b50
Merge pull request #2921 from weblate/weblate-openrefine-translations
...
Translations update from Weblate
2020-07-12 14:32:42 -04:00
Hosted Weblate
69dc478450
Merge branch 'origin/master' into Weblate.
2020-07-12 13:41:53 +02:00
Susanna Ånäs
fbd28f960c
Translated using Weblate (Finnish)
...
Currently translated at 23.3% (45 of 193 strings)
Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/fi/
2020-07-12 13:41:51 +02:00
Allan Nordhøy
98b64b7a01
Translated using Weblate (Norwegian Bokmål)
...
Currently translated at 51.6% (389 of 753 strings)
Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nb_NO/
2020-07-12 13:41:50 +02:00
Rafael Fontenelle
f329f5085b
Translated using Weblate (Portuguese (Brazil))
...
Currently translated at 100.0% (753 of 753 strings)
Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-07-12 13:41:49 +02:00
Tom Morris
d209039a6e
Merge pull request #2918 from weblate/weblate-openrefine-translations
...
Translations update from Weblate
2020-07-11 14:02:56 -04:00
Hosted Weblate
6c69525545
Merge branch 'origin/master' into Weblate.
2020-07-11 12:55:18 +02:00
Allan Nordhøy
128a3089ed
Translated using Weblate (Norwegian Bokmål)
...
Currently translated at 51.1% (385 of 753 strings)
Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nb_NO/
2020-07-11 12:55:18 +02:00
Rafael Fontenelle
b0177e6e33
Translated using Weblate (Portuguese (Brazil))
...
Currently translated at 100.0% (753 of 753 strings)
Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-07-11 12:55:17 +02:00
Isao Matsunami
1a7ae77431
Translated using Weblate (Japanese)
...
Currently translated at 100.0% (753 of 753 strings)
Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-07-11 12:55:17 +02:00
Susanna Ånäs
16695e54b5
Added translation using Weblate (Finnish)
2020-07-11 12:55:13 +02:00
Tom Morris
306b541c69
Fix Excel date import - Fixes #1908 ( #2909 )
...
* Add utility functions to check/convert dates
* Add date tests and refactor to DRY up
* Fix date import - fixes #1908
Change from java.util.Date to OpenRefine 3.0+'s OffsetDateTime
Fixes #1908
* Centralize date conversion
* Moving utility methods to ParsingUtilities
* Fix tests
2020-07-09 23:13:44 +02:00
Urvashi Gupta
a0f2d11255
addStandardServiceOnEnter ( #2914 )
2020-07-09 22:57:24 +02:00
dependabot-preview[bot]
a0a889688b
Bump google-api-services-drive ( #2911 )
...
Bumps google-api-services-drive from v3-rev20200609-1.30.9 to v3-rev20200618-1.30.9.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-07-09 10:29:00 +02:00
dependabot-preview[bot]
380942d53f
Bump httpmime from 4.5.2 to 4.5.12 ( #2904 )
...
Bumps httpmime from 4.5.2 to 4.5.12.
Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-07-08 10:29:09 +02:00
Tom Morris
f23e3096f3
Tweak CI build settings - refs #2861 ( #2894 )
...
* Sleep to wait for database servers on Mac - refs #2861
* Tweak JDK build settings (again) - refs #2861
- Use default JDK on platforms where possible
- Make problematic builds (requiring Java installs) optional
2020-07-07 21:41:55 +02:00
Tom Morris
0562638ffa
Use standard text normalization - fixes #2898 ( #2900 )
...
* Use standard text normalization - fixes #2898
Fixes #2898 . Fixes #409 . Refs #650
Replaces homegrown ISO Latin-1 only character subsitition
with standard Java Normalize to NFD, followed by diacritic
removal and a few custom character expansions/replacements.
* Fix Mac build
* Improve compatibility with previous code
One intentional change is folding O with stroke to
oe instead of o.
- Use more powerful NFKD instead of NFD
- strip punctuation after decomposition since it can generate
new punctuation
- Add compatibility test for old asciify() method
- Add some graphically similar characters to substitution table
* Add oe character/ligature & more long S forms
* More tests for ligatures and Latin Extended
* Add Latin-1 Supplement tests
2020-07-07 21:35:41 +02:00