Commit Graph

2656 Commits

Author SHA1 Message Date
dependabot-preview[bot]
edf8595977
Bump mockito-core from 3.3.3 to 3.4.2
Bumps [mockito-core](https://github.com/mockito/mockito) from 3.3.3 to 3.4.2.
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](https://github.com/mockito/mockito/compare/v3.3.3...v3.4.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-17 08:17:43 +00:00
dependabot-preview[bot]
0f391b5343
Bump commons-lang3 from 3.10 to 3.11
Bumps commons-lang3 from 3.10 to 3.11.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-17 08:17:12 +00:00
Antonin Delpeuch
858bd463a4 Revert "Bump git-commit-id-plugin from 4.0.0 to 4.0.1 (#2948)"
The dependency update broke the snapshot release process on GitHub Actions:
https://github.com/OpenRefine/OpenRefine/runs/876878262

This reverts commit 52bb2c4d38.
2020-07-16 11:07:54 +02:00
dependabot-preview[bot]
52bb2c4d38
Bump git-commit-id-plugin from 4.0.0 to 4.0.1 (#2948)
Bumps git-commit-id-plugin from 4.0.0 to 4.0.1.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-07-16 11:01:43 +02:00
Tom Morris
f2e61b6628
Add tests for wide XLS/XLSX export (#2945)
Refs #2122. Also reenable a couple of disabled tests
2020-07-16 10:01:17 +02:00
Tom Morris
a3fab26cca
Fix the text format guesser so it doesn't inappropriately guess WikiText (#2924)
* Fix text guesser so it doesn't guess wikitext

Fixes #2850
- Add simple magic detector for zip & gzip files to keep
  it from attempting to guess binary files
- Add a counter for C0 controls for the same reason
- Tighten wikitable counters to require marker at
  beginning of the line, per the specification
- Refactor to use Apache Commons instead of private
  counting methods
- Add tests for most TextGuesser formats

* Remove misplaced duplicate test data file

* Fix LGTM warning + minor cleanups

* Use BoundedInputStream to prevent runaway lines
2020-07-15 08:56:00 +02:00
Hosted Weblate
f9d6c2b93b
Merge branch 'origin/master' into Weblate. 2020-07-14 22:41:55 +02:00
Isao Matsunami
a2100f64f7
Translated using Weblate (Japanese)
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-07-14 22:41:51 +02:00
Tom Morris
561619399c
Fix order dependent NPE in LoadLanguage test (#2922)
* Ensure ProjectManager is initialized before test - fixes #2895

* Fix indentation (detabify)
2020-07-14 18:06:04 +02:00
Tom Morris
ed68541988
Remove informational logging from tests that are passing (#2923)
* Change logging from info to debug

* Make tests less chatty when they're passing
2020-07-14 17:47:36 +02:00
Urvashi Gupta
f00129b852
fixes service panel toggling (#2915) 2020-07-14 16:46:10 +02:00
Tom Morris
233cb95289
Ignore events which don't change text input - fixes #1134 (#2846)
* Ignore events which don't change text input - fixes #1134

* Fix bind
2020-07-14 08:35:46 +02:00
dependabot-preview[bot]
396efc0d1b
Bump mockwebserver from 4.7.2 to 4.8.0
Bumps [mockwebserver](https://github.com/square/okhttp) from 4.7.2 to 4.8.0.
- [Release notes](https://github.com/square/okhttp/releases)
- [Changelog](https://github.com/square/okhttp/blob/master/CHANGELOG.md)
- [Commits](https://github.com/square/okhttp/compare/parent-4.7.2...parent-4.8.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 08:39:23 +00:00
Allan Nordhøy
98b64b7a01
Translated using Weblate (Norwegian Bokmål)
Currently translated at 51.6% (389 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nb_NO/
2020-07-12 13:41:50 +02:00
Rafael Fontenelle
f329f5085b
Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-07-12 13:41:49 +02:00
Hosted Weblate
6c69525545
Merge branch 'origin/master' into Weblate. 2020-07-11 12:55:18 +02:00
Allan Nordhøy
128a3089ed
Translated using Weblate (Norwegian Bokmål)
Currently translated at 51.1% (385 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nb_NO/
2020-07-11 12:55:18 +02:00
Rafael Fontenelle
b0177e6e33
Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-07-11 12:55:17 +02:00
Isao Matsunami
1a7ae77431
Translated using Weblate (Japanese)
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-07-11 12:55:17 +02:00
Tom Morris
306b541c69
Fix Excel date import - Fixes #1908 (#2909)
* Add utility functions to check/convert dates

* Add date tests and refactor to DRY up

* Fix date import - fixes #1908

Change from java.util.Date to OpenRefine 3.0+'s OffsetDateTime
Fixes #1908

* Centralize date conversion

* Moving utility methods to ParsingUtilities

* Fix tests
2020-07-09 23:13:44 +02:00
Urvashi Gupta
a0f2d11255
addStandardServiceOnEnter (#2914) 2020-07-09 22:57:24 +02:00
dependabot-preview[bot]
380942d53f
Bump httpmime from 4.5.2 to 4.5.12 (#2904)
Bumps httpmime from 4.5.2 to 4.5.12.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-07-08 10:29:09 +02:00
Tom Morris
0562638ffa
Use standard text normalization - fixes #2898 (#2900)
* Use standard text normalization - fixes #2898

Fixes #2898. Fixes #409. Refs #650

Replaces homegrown ISO Latin-1 only character subsitition
with standard Java Normalize to NFD, followed by diacritic
removal and a few custom character expansions/replacements.

* Fix Mac build

* Improve compatibility with previous code

One intentional change is folding O with stroke to
oe instead of o.

- Use more powerful NFKD instead of NFD
- strip punctuation after decomposition since it can generate
  new punctuation
- Add compatibility test for old asciify() method
- Add some graphically similar characters to substitution table

* Add oe character/ligature & more long S forms

* More tests for ligatures and Latin Extended

* Add Latin-1 Supplement tests
2020-07-07 21:35:41 +02:00
Urvashi Gupta
f62f63706c
Report HTTP error codes to the user when creating a project from a URL (#2870)
* HTTP Error

* urlImportingTestCompleted
2020-07-07 11:58:47 +02:00
Tom Morris
e61d50a1aa
Fix NGramFingerprintKeyer to ignore accents - fixes #1161 (#2899)
Fixes #1161
This change parallels what was done in #1257 1da3c00 to fix
the FingerprintKeyer and moves the diacritic removal before
the deduping. Includes a test.
2020-07-07 09:02:49 +02:00
morrme
66aeaa4409
Remove incorrect "dates" from guess data type label - fixes #2883
Fixes #2883.
2020-07-06 19:55:23 -04:00
Hosted Weblate
f421cfd76f
Merge branch 'origin/master' into Weblate. 2020-07-06 03:42:12 +02:00
Tijs De Schacht
dfcd5a0f25
Translated using Weblate (Dutch)
Currently translated at 54.4% (410 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nl/
2020-07-06 03:42:08 +02:00
Mohamed El ouard Baouche
a6a5935585
Translated using Weblate (Arabic)
Currently translated at 5.8% (44 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ar/
2020-07-06 03:41:49 +02:00
Isao Matsunami
948d1acae1
Translated using Weblate (Japanese)
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-07-06 03:41:49 +02:00
Tom Morris
8a6171432d
Translated using Weblate (French)
Currently translated at 99.0% (746 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2020-07-06 03:41:48 +02:00
Tom Morris
3717111db8
Fix Open Office Spreadsheet (ODS) dates (#2843)
* Truncate any completely empty columns on the right

Fixes #565
The current versions of Open Office create default spreadsheets
with over 1000 empty columns. Keep track of the rightmost
non-empty column when importing and truncate everything else.

Also adds a basic ODS import test.

* Fix dates in ODS spreadsheets

Fixes #2224
2020-07-04 08:42:33 +02:00
Antonin Delpeuch
f4692de9e1 Increase maximum wait for testInvalidUrl, follow-up for #2876 #2875 2020-07-03 21:48:43 +02:00
Tom Morris
df8d092132
Micro benchmark harness & ToNumber optimizations (#2859)
* Performance optimized version of ToNumber

Approximately 5x faster for floats (data dependent)
and about the same speed for integers.

- Instead of blindly trying to parse as Long, do a quick check
  for obvious problems (e.g. decimal point).
- Don't trim. It's already done by called methods.
- Use valueOf() instead of parse() to avoid object creation

* Add Java Microbenchmark Harness

The shaded JAR is missing the OpenRefine classes, for a reason
that I haven't figured out, so requires openrefine-main.jar at runtime.

* Remove old implementations of ToNumber

* Remove unneeded dependencies from main project

* Clean up and reformat
2020-07-03 21:42:44 +02:00
Tom Morris
5d6af9cb6c
Merge pull request #2865 from tfmorris/2863-tree-column-ordering
Remove shortest-column-name ordering - fixes #2863
2020-07-03 15:23:36 -04:00
Tom Morris
f5786afa35
Increase test timeout - fixes #2875 (#2876) 2020-07-03 21:20:01 +02:00
Thad Guidry
49fd21759c
remove English sentence from French translation (#2871) 2020-07-03 16:12:43 +02:00
Tom Morris
139019f6e3
Internationalize clipboard default project name (#2814)
Fixes #2776
2020-07-03 14:22:44 +02:00
chetan
3932b23eb6 Fixed the guessing of JSON for .txt(2820) 2020-07-03 10:46:07 +05:30
Tom Morris
d3db73aa67 Remove shortest-column-name ordering
Refs #2863
The tree importer sorts columns/column groups by how populated
they are, which is of arguable utility, but the tie-breaker
of ordering by shortest column name is completely silly.

This change removes that and, in conjunction with a stable sort
algorithm, will preserve the original order of the columns.
2020-07-02 16:12:55 -04:00
Tom Morris
28a9f68236
Unit test improvements (#2856)
* Fix two deprecated methods usages

* Test ToNumber conversions

* Test behavior of all functions when passed 0 or 8 arguments

There are 16 which fail currently on 0 args (return null or
False instead of EvalError), but have been whitelisted until
we can verify whether it's safe to change them without introducing
compatibility issues.

There are 19 which fail to return an error on too many (ie 8) args.
2020-07-02 20:29:21 +02:00
Tom Morris
54291ef441
Use Apache IO Commons IOUtils instead of homerolled (#2845)
Probably should remove the funky Gzip support with the
overloaded use of the encoding parameter, but this is
a start.
2020-06-30 13:49:47 +02:00
Chetan Verma
e2a2dd2a4e
Fix misstatement about supported formats in import project screen (#2841)
Closes #2753.
2020-06-30 08:25:15 +02:00
Tom Morris
0f3a6006f3
Add Excel95 import test and improve other importer tests (#2844)
No issue.
- we don't support Excel95, but make sure that it generates an exception
- move the test data file into the appropriate directory
- for any normal test, consider exceptions a failure
2020-06-30 08:20:56 +02:00
Tom Morris
421974cc3d
Truncate any completely empty columns on the right (#2842)
Fixes #565
The current versions of Open Office create default spreadsheets
with over 1000 empty columns. Keep track of the rightmost
non-empty column when importing and truncate everything else.

Also adds a basic ODS import test.
2020-06-30 08:19:00 +02:00
Tom Morris
83f52d4ba5
Fall back to Apache Jena 3.9.0 (from 3.15.0) (#2826)
Fixes #2824
Versions up through 3.14.0 appear to work, but since odfdom bundles
Jena 3.9.0, we're going to be conservative and match that.

As an added bonus, includes a blank node test which will trigger
the failure.
2020-06-27 23:40:21 +02:00
Antoine Beaubien
043e595ea0
Change pref name for ui.browsing.pageSize (#2817)
Change the preference key name ui.gridPaginationSize for ui.browsing.pageSize.
2020-06-27 21:58:48 +02:00
Lisa Chandra
7b8f8486f6
Adds a default separator preference for split/join multi valued cells (#2520)
* default value for split/join

* using the new preference interface

* changed preference name to ui.cell.rowSplitDefaultSeparator
2020-06-25 14:35:53 +02:00
Tom Morris
cfa1038066
Remove commons-digester dependency (#2798) 2020-06-25 14:16:25 +02:00
Tom Morris
4b146acc6e
Create Project import improvements (#2806)
* Fix charset encoding & MIME type handling

Character set (ie what we call "encoding") is part of the Content-Type,
*not* the Content-Encoding, which specifies compression (e.g. gzip).

This correctly sets the character set encoding as well as cleaning
the MIME type so that additional parsing doesn't need to be done
downstream (and removes that code).

* Use "text" instead of "text/line-based" as default fallback format

The TextLineBasedGuesser only tries a limited number of
formats (CSV, TSV, fixed), so we can't get out of that hole to
find JSON, XML, etc.

Start with a more general format instead to improve our
guessing odds.

* Support content type Structured Name Syntax Suffixes (+json +xml)

If we can't find a fully specified content type in our lookup,
fall back to just the suffix (which is registered with a leading +)
Fixes #2800 Fixes #2805
2020-06-25 08:36:57 +02:00
Tom Morris
f9eb819b01
Merge pull request #2737 from OpenRefine/dependabot/maven/org.slf4j-slf4j-log4j12-1.7.30
Bump slf4j-log4j12 from 1.7.18 to 1.7.30
2020-06-24 16:00:22 -04:00
Hosted Weblate
07fbc70ada
Merge branch 'origin/master' into Weblate. 2020-06-24 21:41:53 +02:00
Isao Matsunami
1b30d61b2f
Translated using Weblate (Japanese)
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-06-24 21:41:46 +02:00
Adolfo Jayme Barrientos
cf388fc5f4
Translated using Weblate (Spanish)
Currently translated at 99.4% (749 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
2020-06-24 21:41:46 +02:00
Tom Morris
76d30ee1f0
Merge pull request #2794 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.2.0
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
2020-06-23 17:08:40 -04:00
Tom Morris
1849e62234
Better error handling for reconciliation process - fixes #2590 (#2671)
* Harden reconciliation - Fixes #2590

- check for non-JSON / unparseable JSON returns
- handle malformed results response with no name for candidates
- catch any Exception, not just IOExceptions
- call processManager.onFailedProcess() for cleanup on error

* Add default constructor for Jackson

Jackson complains about needing a default constructor for the
NON_DEFAULT annotation, but I'm not sure why this worked before.

* Clean up indentation and unused variable - no functional changes

Make indentation consistent throughout the module, changing recently
added lines to use the standard all spaces convention.

Remove unused count variable

* Simplify control flow

* Update limit parameter comment. No functional change.

* Replace ternary expression which is causing NPE

* Add reconciliation tests using mock HTTP server
2020-06-23 21:54:54 +02:00
dependabot-preview[bot]
408b782117
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-3.1.0...build-helper-maven-plugin-3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-23 08:45:07 +00:00
Tom Morris
0bfa3dd68a
Merge pull request #2745 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.1.0
Bump build-helper-maven-plugin from 1.8 to 3.1.0
2020-06-22 13:06:02 -04:00
Tom Morris
bf57667a47
Merge pull request #2789 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-resources-plugin-3.1.0
Bump maven-resources-plugin from 2.6 to 3.1.0
2020-06-22 12:48:59 -04:00
Hosted Weblate
1c63f6bf96
Merge branch 'origin/master' into Weblate. 2020-06-22 12:03:51 +02:00
Rafael Fontenelle
0da1b34095
Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-06-22 12:03:51 +02:00
Adolfo Jayme Barrientos
e35358709a
Translated using Weblate (Spanish)
Currently translated at 99.4% (749 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
2020-06-22 12:03:51 +02:00
dependabot-preview[bot]
a8ae5d37ed
Bump maven-resources-plugin from 2.6 to 3.1.0
Bumps [maven-resources-plugin](https://github.com/apache/maven-resources-plugin) from 2.6 to 3.1.0.
- [Release notes](https://github.com/apache/maven-resources-plugin/releases)
- [Commits](https://github.com/apache/maven-resources-plugin/compare/maven-resources-plugin-2.6...maven-resources-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-22 08:45:55 +00:00
Tom Morris
e293602897
Restore character encoding guesser (#2755)
* Fixes #486. Builds on code from Steffen Stundzig

- Switch from ICU4J to juniversalchardet
  (Java port of Mozilla charset detector)
- Replace org.json code with Jackson
- Add tests
- Add TODO for multi-file character encoding mismatches

* Restore dependency lost in rebase

Co-authored-by: Steffen Stundzig <git@stundzig.de>
2020-06-22 06:04:51 +02:00
Hosted Weblate
ba4b70db4e
Merge branch 'origin/master' into Weblate. 2020-06-21 21:41:51 +02:00
Rafael Fontenelle
cc787b4257
Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (752 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-06-21 21:41:47 +02:00
Isao Matsunami
0383a7385e
Translated using Weblate (Japanese)
Currently translated at 100.0% (752 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-06-21 21:41:46 +02:00
Adolfo Jayme Barrientos
b1625c714d
Translated using Weblate (Spanish)
Currently translated at 99.4% (748 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
2020-06-21 21:41:45 +02:00
Tom Morris
2977ffa167
Merge pull request #2778 from OpenRefine/2777-test-dependencies
Restrict copied jars to runtime dependencies
2020-06-21 15:09:28 -04:00
Antonin Delpeuch
e92200a35f Move jaxb-api dependency out of the test section 2020-06-21 20:56:33 +02:00
Tom Morris
5d6d0ad6ba
Add missing wiring for i18n plurals. (#2774)
* Add missing wiring for i18n plurals parser

* Fix goto page plural for French
2020-06-21 15:57:17 +02:00
Antonin Delpeuch
62cb20a201 Restrict copied jars to runtime dependencies. Fixes #2777 2020-06-21 15:36:17 +02:00
Antoine Beaubien
0cf7880391
(I #2765) Fix i18n not working in the Edit Pref Window (#2766)
* Fix i18n not working in the Edit Pref Window

Fix i18n not working in the Edit Pref Window, added an error message on failure.

* réussie -> réussi.
2020-06-21 08:26:00 +02:00
Hosted Weblate
eb752d7d5a
Merge branch 'origin/master' into Weblate. 2020-06-20 12:41:48 +02:00
Rafael Fontenelle
7d12275881
Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (743 of 743 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-06-20 12:41:45 +02:00
Isao Matsunami
842de012df
Translated using Weblate (Japanese)
Currently translated at 100.0% (743 of 743 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-06-20 12:41:45 +02:00
Adolfo Jayme Barrientos
92ce62b0da
Translated using Weblate (Spanish)
Currently translated at 100.0% (743 of 743 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
2020-06-20 12:41:44 +02:00
dependabot-preview[bot]
479bc63eaf
Bump httpcore from 4.4.9 to 4.4.13
Bumps httpcore from 4.4.9 to 4.4.13.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-19 08:20:00 +00:00
Tom Morris
f88c0e3657
Preserve international characters in project/file names on import/export (#2720)
* Preserve international characters on import/export

Fixes #1352. Preserve non-ASCII characters in project names on
project creation and filenames on export.

Uses existing filename cleaner with the addition of a few
more characters from StackOverflow, plus "#" which messes
up the download URL. Also URIencode download URL.

Removes unused I18N-incompatible cleaning function from
Wikidata extension rather than fixing it.

* Use common name cleaner function

Also preview cleaned table name instead of raw name, so user can see it.
Also add a TODO for better preview of column names
2020-06-18 22:06:46 +02:00
Antoine Beaubien
7793ffbbe9
(I #2624) Add preferences for the the grid's page size (#2626)
* Add preferences for the row display quantity

Be able to control the choices for the quantity of rows displayed.

* Added _checkPaginationSize(gridPageSize, defaultGridPageSize)

Added DataTableView._checkPaginationSize(gridPageSize, defaultGridPageSize), gridPageSize = smallest size.

* Update data-table-view.js

Fix missing semi-comma.

* Fix typeof gridPageSize != "object" not working for null

Fix typeof gridPageSize != "object" not working for null

* Update data-table-view.js

* Fix tableHeader instead of headerTable

Fix tableHeader instead of headerTable
2020-06-18 10:35:37 +02:00
Tom Morris
77b858db18
Fix race in Process Manager (#2748)
* Remove redundant JSON diff logging

* Fix race in process manager test causing intermittent failure
2020-06-17 21:24:25 +02:00
Antoine Beaubien
d7aaac2e97
(I #2638) Feature to Goto a page directly (#2639)
* Start for Goto Page link.

First implementation. Is functional.

* Background-color & validation

Background-color for each « button » & validation for the page choice of the user: number, > 1 & < last & singular for a one page project.

* Changed from prompt() to <input type="number">

Changed from prompt() to <input type="number">, and visual X out Y.

* Manage bounds in a sticky way

If the user choose below 1, 1 will be displayed, and if the user choose above the max, the max page will be displayed.

* width of <input> & « of X pages »

Add pages after « of maxValue », calculate the width of <input> based on max value.

* Update data-table-view.js

Little fix.

* Correct min and max for <input>

Correct min and max for <input>

* Managment of the arrow's key down.

Add managment to keep the arrow's key in the CurrentPage <input>.

* Fixes for Thad’s KeyDown's « Infinite Paging »

Fixes for Thad’s KeyDown's « Infinite Paging » & PageSize changes.

* Code rehookCurrentPageInput & spacing

Code rehookCurrentPageInput & spacing for PageSize section

* Update data-table-view.js

Fix & move code in Page Control.

* Wrap in a Try/Catch the currentPageInput.focus()

Wrap in a Try/Catch the currentPageInput.focus() and add a verification of focus change with if(!(currentPageInput.is(":focus"))) window.setTimeout(rehookCurrentPageInput, rehookDelay).

* Fixed currentPageInput != document.activeElement

Fixed currentPageInput != document.activeElement

that was before: !(currentPageInput.is(":focus"))

* Better handling of the « Infinite Paging »

Better handling of the « Infinite Paging » with window.setTimeout(rehookCurrentPageInput, rehookDelay)

* $.i18n('core-views/goto-page', …

$.i18n('core-views/goto-page', '<span id="currentPageInput" />', '<span id="lastPageSpan" />'))

* Fix i18n plural

Fix i18n plural, FR still not fixed.

* Remove {{plural:$2|page|pages}} in french

Remove {{plural:$2|page|pages}} in French, not working.

* Update data-table-view.js

Forgot a semi-comma.

* First implementation

First implementation, is functional.

* Remove setTimeout(refocusCurrentPageInput, refocusDelay);

Remove setTimeout(refocusCurrentPageInput, refocusDelay);, instead, onready after creating the page input field.

* Typo: missing semi-colon

Typo: missing semi-colon

* Fix bug related to stealing focus of facets & added a delay

Fix bug related to stealing focus of facets & added a delay (1 s.) before changing pages.

* Revert "Remove {{plural:$2|page|pages}} in french"

This reverts commit 7274a21ee04e6480e50de39f1a7788164dd1981a.

* Start for Goto Page link.

First implementation. Is functional.

* Background-color & validation

Background-color for each « button » & validation for the page choice of the user: number, > 1 & < last & singular for a one page project.

* Changed from prompt() to <input type="number">

Changed from prompt() to <input type="number">, and visual X out Y.

* Manage bounds in a sticky way

If the user choose below 1, 1 will be displayed, and if the user choose above the max, the max page will be displayed.

* width of <input> & « of X pages »

Add pages after « of maxValue », calculate the width of <input> based on max value.

* Update data-table-view.js

Little fix.

* Correct min and max for <input>

Correct min and max for <input>

* Managment of the arrow's key down.

Add managment to keep the arrow's key in the CurrentPage <input>.

* Fixes for Thad’s KeyDown's « Infinite Paging »

Fixes for Thad’s KeyDown's « Infinite Paging » & PageSize changes.

* Code rehookCurrentPageInput & spacing

Code rehookCurrentPageInput & spacing for PageSize section

* Update data-table-view.js

Fix & move code in Page Control.

* Wrap in a Try/Catch the currentPageInput.focus()

Wrap in a Try/Catch the currentPageInput.focus() and add a verification of focus change with if(!(currentPageInput.is(":focus"))) window.setTimeout(rehookCurrentPageInput, rehookDelay).

* Fixed currentPageInput != document.activeElement

Fixed currentPageInput != document.activeElement

that was before: !(currentPageInput.is(":focus"))

* Better handling of the « Infinite Paging »

Better handling of the « Infinite Paging » with window.setTimeout(rehookCurrentPageInput, rehookDelay)

* $.i18n('core-views/goto-page', …

$.i18n('core-views/goto-page', '<span id="currentPageInput" />', '<span id="lastPageSpan" />'))

* Bump rhino from 1.7.10 to 1.7.12

Bumps [rhino](https://github.com/mozilla/rhino) from 1.7.10 to 1.7.12.
- [Release notes](https://github.com/mozilla/rhino/releases)
- [Changelog](https://github.com/mozilla/rhino/blob/master/RELEASE-NOTES.md)
- [Commits](https://github.com/mozilla/rhino/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Fix i18n plural

Fix i18n plural, FR still not fixed.

* Remove {{plural:$2|page|pages}} in french

Remove {{plural:$2|page|pages}} in French, not working.

* Update data-table-view.js

Forgot a semi-comma.

* Bump guava from 19.0 to 23.0

Bumps [guava](https://github.com/google/guava) from 19.0 to 23.0.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/compare/v19.0...v23.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump testng from 6.9.10 to 7.1.0

Bumps [testng](https://github.com/cbeust/testng) from 6.9.10 to 7.1.0.
- [Release notes](https://github.com/cbeust/testng/releases)
- [Changelog](https://github.com/cbeust/testng/blob/master/CHANGES.txt)
- [Commits](https://github.com/cbeust/testng/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump to Guava 23.6.1-jre

* Bump jasypt from 1.9.2 to 1.9.3

Bumps [jasypt](https://github.com/jasypt/jasypt) from 1.9.2 to 1.9.3.
- [Release notes](https://github.com/jasypt/jasypt/releases)
- [Commits](https://github.com/jasypt/jasypt/commits/jasypt-1.9.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Added conflicts-with constraints (#2641)

Implemented conflicts-with scrutinizer as part of #2354

* Fix a bug introduced by I #1038, PR #2616 (#2684)

Fix a bug introduced by I #1038, where the first tab, in the Wikidata mode, would have a bad background. PR #2616

* Fixed typos made in PR #2641

* Remove setTimeout(refocusCurrentPageInput, refocusDelay);

Remove setTimeout(refocusCurrentPageInput, refocusDelay);, instead, onready after creating the page input field.

* Trim input url whitespace (#2534)

Fixes #2516

* Bump google-http-client-jackson2 from 1.20.0 to 1.35.0

Bumps [google-http-client-jackson2](https://github.com/googleapis/google-http-java-client) from 1.20.0 to 1.35.0.
- [Release notes](https://github.com/googleapis/google-http-java-client/releases)
- [Changelog](https://github.com/googleapis/google-http-java-client/blob/master/CHANGELOG.md)
- [Commits](https://github.com/googleapis/google-http-java-client/compare/1.20.0...v1.35.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Switch to new rhino-runtime component

* Typo: missing semi-colon

Typo: missing semi-colon

* Replace Apache Ant with Commons Compress (#2691)

NOTE: Changes the public API where some of the old types were
embedded which means that any extensions that extend these
interfaces will have to be updated.

Fixes #2690.

* Fix bug related to stealing focus of facets & added a delay

Fix bug related to stealing focus of facets & added a delay (1 s.) before changing pages.

* Revert "Remove {{plural:$2|page|pages}} in french"

This reverts commit 7274a21ee04e6480e50de39f1a7788164dd1981a.

* Update to latest Jython version 2.7.2

Closes #2642

* Bump git-commit-id-plugin from 2.2.4 to 4.0.0

Bumps [git-commit-id-plugin](https://github.com/git-commit-id/maven-git-commit-id-plugin) from 2.2.4 to 4.0.0.
- [Release notes](https://github.com/git-commit-id/maven-git-commit-id-plugin/releases)
- [Commits](https://github.com/git-commit-id/maven-git-commit-id-plugin/compare/v2.2.4...v4.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump maven-assembly-plugin from 3.1.0 to 3.3.0

Bumps [maven-assembly-plugin](https://github.com/apache/maven-assembly-plugin) from 3.1.0 to 3.3.0.
- [Release notes](https://github.com/apache/maven-assembly-plugin/releases)
- [Commits](https://github.com/apache/maven-assembly-plugin/compare/maven-assembly-plugin-3.1.0...maven-assembly-plugin-3.3.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump httpclient from 4.5.5 to 4.5.12

Bumps httpclient from 4.5.5 to 4.5.12.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump powermock.version from 2.0.2 to 2.0.7

Bumps `powermock.version` from 2.0.2 to 2.0.7.

Updates `powermock-module-testng` from 2.0.2 to 2.0.7
- [Release notes](https://github.com/powermock/powermock/releases)
- [Changelog](https://github.com/powermock/powermock/blob/release/2.x/docs/changelog.txt)
- [Commits](https://github.com/powermock/powermock/compare/powermock-2.0.2...powermock-2.0.7)

Updates `powermock-api-mockito2` from 2.0.2 to 2.0.7
- [Release notes](https://github.com/powermock/powermock/releases)
- [Changelog](https://github.com/powermock/powermock/blob/release/2.x/docs/changelog.txt)
- [Commits](https://github.com/powermock/powermock/compare/powermock-2.0.2...powermock-2.0.7)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump butterfly from 1.0.2 to 1.0.3

Bumps [butterfly](https://github.com/OpenRefine/simile-butterfly) from 1.0.2 to 1.0.3.
- [Release notes](https://github.com/OpenRefine/simile-butterfly/releases)
- [Commits](https://github.com/OpenRefine/simile-butterfly/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump slf4j-api from 1.7.18 to 1.7.30

Bumps [slf4j-api](https://github.com/qos-ch/slf4j) from 1.7.18 to 1.7.30.
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/compare/v_1.7.18...v_1.7.30)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Bump commons-validator from 1.5.1 to 1.6

Bumps commons-validator from 1.5.1 to 1.6.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Added translation using Weblate (Portuguese (Brazil))

* Translated using Weblate (Portuguese (Brazil))

Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/pt_BR/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (179 of 179 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ja/

* Disables FacetContainer while computing clusters

fixes #2675

* Added translation using Weblate (Portuguese (Brazil))

* Translated using Weblate (Portuguese (Brazil))

Currently translated at 100.0% (740 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/

* Added translation using Weblate (Portuguese (Brazil))

* Translated using Weblate (Portuguese (Brazil))

Currently translated at 100.0% (60 of 60 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/pt_BR/

* Translated using Weblate (Portuguese (Brazil))

Currently translated at 6.7% (12 of 179 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/pt_BR/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (60 of 60 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (740 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (60 of 60 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/

* Added translation using Weblate (Bengali (India))

* Load GDrive icon from local resource, not Github (#2689)

Fixes #2688.

* Convert illegal characters into legal ones. (#2431)

* Convert illegal characters into leagal ones.

* Test tab in key & value string

Also fix up test that depended on previous TAB
related error message and clean up logging

Co-authored-by: Tom Morris <tfmorris@gmail.com>

* Bump signpost-commonshttp4 from 1.2.1.2 to 2.0.0 (#2695)

Bumps [signpost-commonshttp4](https://github.com/mttkay/signpost) from 1.2.1.2 to 2.0.0.
- [Release notes](https://github.com/mttkay/signpost/releases)
- [Changelog](https://github.com/mttkay/signpost/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mttkay/signpost/compare/1.2.1.2...oauth-signpost-2.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>

* Add comment to help designers understand TreeData (#2715)

* Update jquery.i18n to 1.07 and fix non-English plural support (#2717)

* Update jquery.i18n to 1.07 and add missing rule parser

Fixes #2700
Adds missing CLDRPluralRuleParser.js so that plurals are supported.
Updates all files to jquery.i18n 1.07
Includes a bunch of specialty language support,
but only Finnish and Russian are loaded as examples.

* Add some missing translations, including plurals

Fix some cases of Javascript string concatenation and
plural conditionalization to demonstrate that plurals work
in both English and French now.

NOTE: Corresponding updates need to be made to all the other
language files since some keys were renamed or eliminated.

* Unused imports and other minor cleanups (#2723)

* Two minor fixes

- prevent invalid index error on empty strings (shouldn't normally happen)
- update deprecated Apache Commons Lang method

* Remove unused imports

* Remove feature Edit Facet Name

Remove feature Edit Facet Name that got merged by mistake.

* Remove feature Edit Facet Name

Remove feature Edit Facet Name that got merged by mistake.

* Spacing

Spacing

* Fix the delay, adjust to .2 s.

Fix the delay, adjust to .2 s. and stop using promises.

* Fix headerTable to tableHeader

Fix headerTable to tableHeader (PR #2719)

* data-header-table to data-table-header

data-header-table to data-table-header

* Remove .data-header-table-container

Remove .data-header-table-container

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Tom Morris <tfmorris@gmail.com>
Co-authored-by: Ekta Mishra <ektamishra1999@gmail.com>
Co-authored-by: Nishtha <51858166+Nishtha3512@users.noreply.github.com>
Co-authored-by: Thad Guidry <thadguidry@gmail.com>
Co-authored-by: Rafael Fontenelle <rafaelff@gnome.org>
Co-authored-by: Isao Matsunami <isao.matsunami@gmail.com>
Co-authored-by: Biswaranjan Manna <manna.biswaranjan@gmail.com>
Co-authored-by: chuhao zeng <32441682+zengchu2@users.noreply.github.com>
2020-06-17 11:31:56 +02:00
dependabot-preview[bot]
b53d738df8
Bump build-helper-maven-plugin from 1.8 to 3.1.0
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 1.8 to 3.1.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-1.8...build-helper-maven-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-17 08:26:08 +00:00
Tom Morris
5d2c10b9d8
Merge pull request #2731 from tfmorris/jena-3.7.0
Bump Jena from 3.6.0 to 3.15.0
2020-06-16 17:08:01 -04:00
Tom Morris
761858cfe3 Use property for all SLF4J versions 2020-06-16 17:07:21 -04:00
Tom Morris
a4e9e130ef Use property for Jena version 2020-06-16 16:58:26 -04:00
Tom Morris
5f368bc56d
Use ContentDisposition instead of ContentType to control download (#2722)
* Use ContentDisposition instead of ContentType to control download

Fixes #1197. Previously we were using a funky ContentType to attempt
to force a file download rather than display in browser, but this
conflicted with attempts to save UTF-8 which was outside the Basic
Multilingual Plane (BMP).

By switching to ContentDisposition: attachment, which has been
the preferred method for a number of years, we can avoid this conflict.

As part of this, switch to using the "preview" param consistently
to control preview vs download rather than the content type.

* Switch content type to text/plain

Now that we don't need to use ContentType to control download
behavior, we can use something more reasonable.
2020-06-16 15:46:07 +02:00
dependabot-preview[bot]
5ecb260fe4
Bump joda-time from 2.9.9 to 2.10.6 (#2738)
Bumps [joda-time](https://github.com/JodaOrg/joda-time) from 2.9.9 to 2.10.6.
- [Release notes](https://github.com/JodaOrg/joda-time/releases)
- [Changelog](https://github.com/JodaOrg/joda-time/blob/master/RELEASE-NOTES.txt)
- [Commits](https://github.com/JodaOrg/joda-time/compare/v2.9.9...v2.10.6)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-16 11:45:27 +02:00
Lisa Chandra
95e5e19eb3
Refactoring the data table into a single container (#2719)
* feat: Bounding the table to a single container

* Making the table more responsive

* fixing design

* remove references to adjustDataTables

* remove useless table-scroll function

* Fix naming and restore old styling

* fix border top & font size

* fix firefox css bug

* fix for XML/JSON Importers

* Fixed styling

* fixed typos

* fixed column rendering and added a sticky header

* fixed firefox borders

* fixed border and table background

* fix importer stylings (td)

Co-authored-by: kushthedude <kushthedude@gmail.com>
2020-06-16 11:40:13 +02:00
dependabot-preview[bot]
6f4b615f84
Bump slf4j-log4j12 from 1.7.18 to 1.7.30
Bumps [slf4j-log4j12](https://github.com/qos-ch/slf4j) from 1.7.18 to 1.7.30.
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/compare/v_1.7.18...v_1.7.30)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-16 08:19:06 +00:00
Tom Morris
749704518c
Use Apache HTTP Commons for Fetch URL (#2692)
* Use mockwebserver instead of live network for tests

Fixes #2680. Fixes #1904.

* Remove use of deprecated methods

* Convert to use Apache HTTP Components client library

Fixes #1410 by virtue of redirect following being a built-in
capability of the library, along with retries with binary backoff,
built-in decompression, etc.

* Address review comments
2020-06-16 09:38:06 +02:00
Tom Morris
983c8bd422
Merge pull request #2704 from OpenRefine/dependabot/maven/javax.xml.bind-jaxb-api-2.3.1
Bump jaxb-api from 2.2.3 to 2.3.1
2020-06-15 23:44:16 -04:00
Tom Morris
19bd2fbfb1
Merge pull request #2732 from OpenRefine/dependabot/maven/main/com.google.guava-guava-24.1.1-jre
Bump guava from 23.6.1-jre to 24.1.1-jre in /main
2020-06-15 23:35:50 -04:00
Tom Morris
559494b75d Add TODOs for Jena RDF language names 2020-06-15 20:04:05 -04:00
Tom Morris
480bf4fb85 Update Jena to 3.15.0
Also add explicit dependency on Apache commons-io
which should be a transitive dependency, but doesn't
work for Jena 3.8+

Tried switching to standard packaging of
apache-jena-libs, but that doesn't know how
to find the JSONLD parser.
2020-06-15 20:01:45 -04:00
Tom Morris
348d82d131
Merge pull request #2725 from OpenRefine/issue-2724-wikidata-endpoint
Update URL of Wikidata reconciliation service
2020-06-15 17:20:05 -04:00
dependabot[bot]
2397647dca
Bump guava from 23.6.1-jre to 24.1.1-jre in /main
Bumps [guava](https://github.com/google/guava) from 23.6.1-jre to 24.1.1-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

Signed-off-by: dependabot[bot] <support@github.com>
2020-06-15 21:19:11 +00:00
dependabot-preview[bot]
7fcea61132
Bump swc-parser-lazy from 3.1.7 to 3.1.9 (#2698)
Bumps swc-parser-lazy from 3.1.7 to 3.1.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 20:05:54 +02:00
james-cui
04055153a1
add archive column (#2573)
Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
2020-06-15 19:56:00 +02:00
Joanne Ong
d57d76f7df
Fix imprecise facet statistics in records mode (#2607)
* Fix bug in choice counts for records mode

* Add test for value grouper on records

* Refactor and comment code

* Count distinct instances of null/blank data

* Update test to check for blank data count in records

* Remove unnecessary import statement
2020-06-15 19:38:50 +02:00
Lisa Chandra
947356ddad
[FEAT]Adds new options for split (#2471)
* added options ui

* added definition for both separators

* added tests

* removed definitions from backend and added them to frontend

* added reverse order and handling for accented characters

* added tests for accented characters and reverse split

* fixed build errors

* unicode character ranges instead

* added examples
2020-06-15 19:30:18 +02:00
Hosted Weblate
c70e100dcd
Merge branch 'origin/master' into Weblate. 2020-06-15 15:41:50 +02:00
Biswaranjan Manna
5fe05351a8
Translated using Weblate (Bengali)
Currently translated at 7.9% (59 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/bn/
2020-06-15 15:41:47 +02:00
Adolfo Jayme Barrientos
94af06fe0e
Translated using Weblate (Spanish)
Currently translated at 98.7% (731 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
2020-06-15 15:41:45 +02:00
dependabot-preview[bot]
4e9d365fcd
Bump maven-compiler-plugin from 3.1 to 3.8.1 (#2728)
Bumps [maven-compiler-plugin](https://github.com/apache/maven-compiler-plugin) from 3.1 to 3.8.1.
- [Release notes](https://github.com/apache/maven-compiler-plugin/releases)
- [Commits](https://github.com/apache/maven-compiler-plugin/compare/maven-compiler-plugin-3.1...maven-compiler-plugin-3.8.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 11:20:38 +02:00
Antonin Delpeuch
1bb9e8a67e Update URL of Wikidata reconciliation service. Closes #2724 2020-06-15 00:35:10 +02:00
Tom Morris
bf1c890cc3
Unused imports and other minor cleanups (#2723)
* Two minor fixes

- prevent invalid index error on empty strings (shouldn't normally happen)
- update deprecated Apache Commons Lang method

* Remove unused imports
2020-06-14 21:18:02 +02:00
Tom Morris
03c860d961
Update jquery.i18n to 1.07 and fix non-English plural support (#2717)
* Update jquery.i18n to 1.07 and add missing rule parser

Fixes #2700
Adds missing CLDRPluralRuleParser.js so that plurals are supported.
Updates all files to jquery.i18n 1.07
Includes a bunch of specialty language support,
but only Finnish and Russian are loaded as examples.

* Add some missing translations, including plurals

Fix some cases of Javascript string concatenation and
plural conditionalization to demonstrate that plurals work
in both English and French now.

NOTE: Corresponding updates need to be made to all the other
language files since some keys were renamed or eliminated.
2020-06-14 10:23:23 +02:00
Thad Guidry
e8f9c7d065
Add comment to help designers understand TreeData (#2715) 2020-06-14 10:11:51 +02:00
dependabot-preview[bot]
686315b0c3
Bump signpost-commonshttp4 from 1.2.1.2 to 2.0.0 (#2695)
Bumps [signpost-commonshttp4](https://github.com/mttkay/signpost) from 1.2.1.2 to 2.0.0.
- [Release notes](https://github.com/mttkay/signpost/releases)
- [Changelog](https://github.com/mttkay/signpost/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mttkay/signpost/compare/1.2.1.2...oauth-signpost-2.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-14 09:58:33 +02:00
chuhao zeng
9b03ecae41
Convert illegal characters into legal ones. (#2431)
* Convert illegal characters into leagal ones.

* Test tab in key & value string

Also fix up test that depended on previous TAB
related error message and clean up logging

Co-authored-by: Tom Morris <tfmorris@gmail.com>
2020-06-14 09:47:58 +02:00
Tom Morris
7b41bbe0b0
Merge pull request #2708 from weblate/weblate-openrefine-translations
Translations update from Weblate
2020-06-13 23:07:04 -04:00
Tom Morris
1a452256e5
Merge pull request #2707 from OpenRefine/dependabot/maven/commons-validator-commons-validator-1.6
Bump commons-validator from 1.5.1 to 1.6
2020-06-13 22:58:28 -04:00
Hosted Weblate
0416f840d9
Merge branch 'origin/master' into Weblate. 2020-06-13 21:41:52 +02:00
Rafael Fontenelle
0839933944
Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (740 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2020-06-13 21:41:44 +02:00
Isao Matsunami
c3c1f76c0d
Translated using Weblate (Japanese)
Currently translated at 100.0% (740 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2020-06-13 21:41:43 +02:00
darecoder1999
d91503f7c7 Disables FacetContainer while computing clusters
fixes #2675
2020-06-13 00:19:26 +05:30
dependabot-preview[bot]
f0ebb3fcd6
Bump commons-validator from 1.5.1 to 1.6
Bumps commons-validator from 1.5.1 to 1.6.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-12 08:19:45 +00:00
dependabot-preview[bot]
5fdbd382dc
Bump jaxb-api from 2.2.3 to 2.3.1
Bumps [jaxb-api](https://github.com/javaee/jaxb-spec) from 2.2.3 to 2.3.1.
- [Release notes](https://github.com/javaee/jaxb-spec/releases)
- [Commits](https://github.com/javaee/jaxb-spec/commits/2.3.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-12 08:18:43 +00:00
Tom Morris
a7e84e8a56
Merge pull request #2697 from OpenRefine/dependabot/maven/powermock.version-2.0.7
Bump powermock.version from 2.0.2 to 2.0.7
2020-06-11 21:44:15 -04:00
dependabot-preview[bot]
c8f8290aa1
Bump slf4j-api from 1.7.18 to 1.7.30
Bumps [slf4j-api](https://github.com/qos-ch/slf4j) from 1.7.18 to 1.7.30.
- [Release notes](https://github.com/qos-ch/slf4j/releases)
- [Commits](https://github.com/qos-ch/slf4j/compare/v_1.7.18...v_1.7.30)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-12 01:33:00 +00:00
Tom Morris
24754cbb9b
Merge pull request #2677 from OpenRefine/dependabot/maven/pl.project13.maven-git-commit-id-plugin-4.0.0
Bump git-commit-id-plugin from 2.2.4 to 4.0.0
2020-06-11 21:31:10 -04:00
Tom Morris
4b874f129a
Merge pull request #2696 from OpenRefine/dependabot/maven/org.apache.httpcomponents-httpclient-4.5.12
Bump httpclient from 4.5.5 to 4.5.12
2020-06-11 14:01:25 -04:00
Tom Morris
25caaec9a2
Merge pull request #2699 from OpenRefine/dependabot/maven/org.openrefine.dependencies-butterfly-1.0.3
Bump butterfly from 1.0.2 to 1.0.3
2020-06-11 13:58:40 -04:00
Tom Morris
18c18e587e
Replace Apache Ant with Commons Compress (#2691)
NOTE: Changes the public API where some of the old types were
embedded which means that any extensions that extend these
interfaces will have to be updated.

Fixes #2690.
2020-06-11 16:39:51 +02:00
dependabot-preview[bot]
55b3f0ac41
Bump butterfly from 1.0.2 to 1.0.3
Bumps [butterfly](https://github.com/OpenRefine/simile-butterfly) from 1.0.2 to 1.0.3.
- [Release notes](https://github.com/OpenRefine/simile-butterfly/releases)
- [Commits](https://github.com/OpenRefine/simile-butterfly/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-11 08:23:39 +00:00
dependabot-preview[bot]
af9e5ab3f0
Bump powermock.version from 2.0.2 to 2.0.7
Bumps `powermock.version` from 2.0.2 to 2.0.7.

Updates `powermock-module-testng` from 2.0.2 to 2.0.7
- [Release notes](https://github.com/powermock/powermock/releases)
- [Changelog](https://github.com/powermock/powermock/blob/release/2.x/docs/changelog.txt)
- [Commits](https://github.com/powermock/powermock/compare/powermock-2.0.2...powermock-2.0.7)

Updates `powermock-api-mockito2` from 2.0.2 to 2.0.7
- [Release notes](https://github.com/powermock/powermock/releases)
- [Changelog](https://github.com/powermock/powermock/blob/release/2.x/docs/changelog.txt)
- [Commits](https://github.com/powermock/powermock/compare/powermock-2.0.2...powermock-2.0.7)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-11 08:23:05 +00:00
dependabot-preview[bot]
2c490e101c
Bump httpclient from 4.5.5 to 4.5.12
Bumps httpclient from 4.5.5 to 4.5.12.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-11 08:22:37 +00:00
dependabot-preview[bot]
cb9fb8ce76
Bump git-commit-id-plugin from 2.2.4 to 4.0.0
Bumps [git-commit-id-plugin](https://github.com/git-commit-id/maven-git-commit-id-plugin) from 2.2.4 to 4.0.0.
- [Release notes](https://github.com/git-commit-id/maven-git-commit-id-plugin/releases)
- [Commits](https://github.com/git-commit-id/maven-git-commit-id-plugin/compare/v2.2.4...v4.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-11 02:08:41 +00:00
Tom Morris
7c9b78d076
Merge pull request #2654 from OpenRefine/dependabot/maven/org.mozilla-rhino-1.7.12
Switch to rhino-runtime and bump from 1.7.10 to 1.7.12
2020-06-10 20:54:01 -04:00
Tom Morris
8ac6c4b889
Switch to new rhino-runtime component 2020-06-10 20:43:01 -04:00
Tom Morris
e3df28c155
Merge pull request #2672 from OpenRefine/dependabot/maven/org.testng-testng-7.1.0
Bump testng from 6.9.10 to 7.1.0
2020-06-10 20:29:07 -04:00
Tom Morris
1d78d9f5d3
Merge pull request #2663 from OpenRefine/dependabot/maven/com.google.guava-guava-23.0
Bump guava from 19.0 to 23.6.1-jre
2020-06-10 20:07:54 -04:00
Nishtha
cccaf2992a
Trim input url whitespace (#2534)
Fixes #2516
2020-06-10 08:28:30 -04:00
Antoine Beaubien
515d701973
Fix a bug introduced by I #1038, PR #2616 (#2684)
Fix a bug introduced by I #1038, where the first tab, in the Wikidata mode, would have a bad background. PR #2616
2020-06-09 20:50:39 +02:00
Lu Liu
1c4243ea57
use absolute path (#2679) 2020-06-06 11:25:52 +01:00
Tom Morris
e6ed8e5d62
Save preferences JSON using UTF-8 encoding. Bulletproof prefs load. (#2657)
* Save preferences JSON using UTF-8 encoding. Bulletproof prefs load.

Fixes #2543. Fixes #2627.

Always use UTF-8 to write JSON because platform default encoding
might not be legal JSON (e.g. ISO 8859-1).

Also be more conservative about keeping backups if we fail to write.

* Handle case where backup prefs is better than more recent

* Recover from corrupted prefs with null starred list.

Fixes #2544. Replaces null with an empty list.

* Run tests with non-UTF-8 encoding

Make sure that we don't depend on UTF-8 being the default encoding
because it isn't true everywhere (e.g. Windows)

* Add test for non-ASCII chars in workspace.json

This depends on the default Java encoding being something
other than UTF-8 to test properly.
2020-06-06 10:00:01 +01:00
Tom Morris
8a5baf77a2
Merge pull request #2664 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-jar-plugin-3.2.0
Bump maven-jar-plugin from 3.1.0 to 3.2.0
2020-06-03 12:45:09 -04:00
Tom Morris
9d0903971e
Bump to Guava 23.6.1-jre 2020-06-03 12:40:16 -04:00
dependabot-preview[bot]
56bbb073cd
Bump testng from 6.9.10 to 7.1.0
Bumps [testng](https://github.com/cbeust/testng) from 6.9.10 to 7.1.0.
- [Release notes](https://github.com/cbeust/testng/releases)
- [Changelog](https://github.com/cbeust/testng/blob/master/CHANGES.txt)
- [Commits](https://github.com/cbeust/testng/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-03 08:49:47 +00:00
dependabot-preview[bot]
72b8bfed05
Bump commons-lang3 from 3.6 to 3.10 (#2648)
Bumps commons-lang3 from 3.6 to 3.10.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-03 07:03:01 +01:00
dependabot-preview[bot]
88ab328e93
Bump mockito-core from 2.23.4 to 3.3.3 (#2662)
Bumps [mockito-core](https://github.com/mockito/mockito) from 2.23.4 to 3.3.3.
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](https://github.com/mockito/mockito/compare/v2.23.4...v3.3.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-03 07:01:22 +01:00
Tom Morris
5c801b2d4c
Fix duplicate i18n keys for FR &ES (#2668)
remove-facet was mentioned twice with 2 different messages
2020-06-02 18:05:18 +01:00
dependabot-preview[bot]
7056f7222c
Bump maven-jar-plugin from 3.1.0 to 3.2.0
Bumps [maven-jar-plugin](https://github.com/apache/maven-jar-plugin) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/apache/maven-jar-plugin/releases)
- [Commits](https://github.com/apache/maven-jar-plugin/compare/maven-jar-plugin-3.1.0...maven-jar-plugin-3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-01 09:06:36 +00:00
dependabot-preview[bot]
2adfb8cf0e
Bump guava from 19.0 to 23.0
Bumps [guava](https://github.com/google/guava) from 19.0 to 23.0.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/compare/v19.0...v23.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-01 09:06:21 +00:00
Antoine Beaubien
0690f45762
(I #1038) Add a Show/Hide left panel button (#2616)
* Add a Show/Hide left panel

Add a Show/Hide left Facets-Undo/Redo panel.

* Update summary-bar.js

Simplify the code for the "hide-left-panel-button".

* Remove the gap on the left of the button

Remove the gap on the left of the button and align left with table.

* Translated using Weblate (Japanese)

Currently translated at 100.0% (740 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (171 of 171 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/

* Updated  showhide (collapse) arrow image

* Bolden the border dark-blue

Bolden the border dark-blue

* Changed from SPAN to A tag

Changed from SPAN to A tag.

* Update project.less

Minor change: left: 22px;

* Add a Show/Hide left panel

Add a Show/Hide left Facets-Undo/Redo panel.

* Update summary-bar.js

Simplify the code for the "hide-left-panel-button".

* Remove the gap on the left of the button

Remove the gap on the left of the button and align left with table.

* Updated  showhide (collapse) arrow image

* Bolden the border dark-blue

Bolden the border dark-blue

* Changed from SPAN to A tag

Changed from SPAN to A tag.

* Update project.less

Minor change: left: 22px;

* Changed cell.error to cell.errorMessage & added help data. (#2628)

* Changed cell.error to cell.errorMessage & added help data.

Changed cell.error to cell.errorMessage and added the informations into the internal help system.

* FR Text correction

* HU Fix text

3 instead of 2.

* The show/hide button now changes side

The show/hide button now changes side.

* Update project.js

Removed unneeded self.

* Update summary-bar.js

Removed unneeded self.

* [Security] Bump jackson.version from 2.9.10 to 2.11.0

Bumps `jackson.version` from 2.9.10 to 2.11.0.

Updates `jackson-databind` from 2.9.10 to 2.11.0
- [Release notes](https://github.com/FasterXML/jackson/releases)
- [Commits](https://github.com/FasterXML/jackson/commits)

Updates `jackson-annotations` from 2.9.10 to 2.11.0
- [Release notes](https://github.com/FasterXML/jackson/releases)
- [Commits](https://github.com/FasterXML/jackson/commits)

Updates `jackson-core` from 2.9.10 to 2.11.0
- [Release notes](https://github.com/FasterXML/jackson-core/releases)
- [Commits](https://github.com/FasterXML/jackson-core/compare/jackson-core-2.9.10...jackson-core-2.11.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Translated using Weblate (Russian)

Currently translated at 91.0% (674 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ru/

* Only show the database login fields when necessary (#2615)

* DB login fields visibility controled by CSS

The database login field’s visibility is now controled by CSS styling.

* Change field name from Database to Database file.

Change field name from Database to Database file.

* Use full db name as CSS classes

Use full db name instead of diminutives for the CSS classes.

* Added translation to placeholders

Added translation to the Input placeholders.

* Undo a change, remerge Database field & File

remerge Database field and DatabaseFile Field like before.

* Created DatabaseSourceUI._updateDatabaseType(dbType)

Created Refine.DatabaseSourceUI.prototype._updateDatabaseType(databaseType)

* Make MySQL the default database

<option value="mysql" selected="selected"">MySQL</option>

* Update database-import-form.html

Fixed typo. (<option value="mysql" selected="selected">MySQL</option>)

* New default connection name value

New default connection name value, translation of it, changing cssClassName from options to dbtype-options, adding the prefix "dbt-" to the db types and fix the changing of placeholder databaseName/databaseFileName when neccessary.

* Fix issue with « saved connections »

Fix issue with « saved connections » and added 2 defaults values for dbHost and dbType.

* Default DB back to MySQL.

<option value="mysql" selected="selected">MySQL</option>

* Update extensions/database/module/langs/translation-en.json

Co-authored-by: Thad Guidry <thadguidry@gmail.com>

* Better default with « mysql »

* Fix sqlite #databaseHost before calling self._updateDatabaseType()

Fix $( "#databaseHost" ).val(self._defaultDatabaseHost) to be set before calling self._updateDatabaseType(self._defaultDatabaseType) that may change it.

* Removed field name & fixed default connection name

Removed field name text since it's populated from i18n and fixed the default connection name so that it has no space in it.

* Little update to placeholder text

Co-authored-by: Thad Guidry <thadguidry@gmail.com>

* Resize the grid UI as well

Co-authored-by: Isao Matsunami <isao.matsunami@gmail.com>
Co-authored-by: Hosted Weblate <hosted@weblate.org>
Co-authored-by: Thad Guidry <thadguidry@gmail.com>
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Tom Morris <tfmorris@gmail.com>
Co-authored-by: Artem <KovalevArtem.ru@gmail.com>
Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
2020-05-30 12:01:26 +01:00
dependabot-preview[bot]
7058f39aee
Bump maven-dependency-plugin from 3.1.1 to 3.1.2 (#2651)
Bumps [maven-dependency-plugin](https://github.com/apache/maven-dependency-plugin) from 3.1.1 to 3.1.2.
- [Release notes](https://github.com/apache/maven-dependency-plugin/releases)
- [Commits](https://github.com/apache/maven-dependency-plugin/compare/maven-dependency-plugin-3.1.1...maven-dependency-plugin-3.1.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-30 10:49:21 +01:00
dependabot-preview[bot]
632a5f9bf5
Bump jsoup from 1.11.3 to 1.13.1 (#2647)
Bumps [jsoup](https://github.com/jhy/jsoup) from 1.11.3 to 1.13.1.
- [Release notes](https://github.com/jhy/jsoup/releases)
- [Changelog](https://github.com/jhy/jsoup/blob/master/CHANGES)
- [Commits](https://github.com/jhy/jsoup/compare/jsoup-1.11.3...jsoup-1.13.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-30 10:46:39 +01:00
dependabot-preview[bot]
b1f13ffc9b
Bump signpost-core from 1.2.1.2 to 2.0.0 (#2646)
Bumps [signpost-core](https://github.com/mttkay/signpost) from 1.2.1.2 to 2.0.0.
- [Release notes](https://github.com/mttkay/signpost/releases)
- [Changelog](https://github.com/mttkay/signpost/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mttkay/signpost/compare/1.2.1.2...oauth-signpost-2.0.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-30 10:45:07 +01:00
Hosted Weblate
c70872ce56
Merge branch 'origin/master' into Weblate. 2020-05-29 00:41:45 +02:00