s434730/RandomSec
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
6,142 Commits 6 Branches 0 Tags 1.3 GiB
22754ee732
Commit Graph

2947 Commits

Author SHA1 Message Date
Florian Giroud
382c030a7c
fix: UX tests linting (#3593) 2021-02-07 21:27:12 +01:00
S-Harshit
fb248495f1
Add UX Test for column / Text filter (#3566) 
* AddUX Test for column / Text filter

fixes #3421
 2021-02-07 21:05:36 +01:00
dependabot[bot]
c1cbc2bdd7
Bump cypress from 6.2.1 to 6.4.0 in /main/tests/cypress (#3551) 
Bumps [cypress](https://github.com/cypress-io/cypress) from 6.2.1 to 6.4.0.
- [Release notes](https://github.com/cypress-io/cypress/releases)
- [Changelog](https://github.com/cypress-io/cypress/blob/develop/.releaserc.base.js)
- [Commits](https://github.com/cypress-io/cypress/compare/v6.2.1...v6.4.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-02-07 20:56:09 +01:00
Florian Giroud
7003dd2d2d
doc: Enriched UX testing documentation, #3573 (#3583) 2021-02-07 19:07:54 +01:00
Kush Trivedi
859828a0f0
feat: add ESLint configuration for cypress-test-suite (#3564) 
* feat: Initialise ES-Lint for cypress
 2021-02-07 18:53:13 +01:00
Antonin Delpeuch
a0bea8f8c7 Revert "Merge pull request #3588 from singhakshita/hyperlink-issue-tests" 
This reverts commit 79aa260442, reversing
changes made to d6edf5ddb0.

See discussion at:
https://github.com/OpenRefine/OpenRefine/pull/3588
 2021-02-07 09:21:26 +01:00
singhakshita
44d019a014
Update main/tests/cypress/cypress/integration/project/grid/column/edit-cells/common-transforms/proper-display.spec.js 
Co-authored-by: Thad Guidry <thadguidry@gmail.com>
 2021-02-06 21:35:20 +05:30
akshitasingh
002d795c43 tests fixed 2021-02-06 11:41:02 +05:30
akshitasingh
86d64bfb15 lint fix 2021-02-06 08:16:30 +05:30
akshitasingh
d0802fa0ce tests for hyperlink 2021-02-05 22:41:29 +05:30
Kush Trivedi
3692257aa1
feat: add tests for pagination and pagesize (#3550) 
* feat: add tests for pagination and pagesize
 2021-02-04 15:42:57 +01:00
Kush Trivedi
6750a45d53
feat: add prettier lint scripts and workflow (#3546) 
* feat: add lint scripts and workflow

Signed-off-by: kushthedude <kushthedude@gmail.com>

* fix lint

Signed-off-by: kushthedude <kushthedude@gmail.com>
 2021-02-04 15:37:03 +01:00
J. Lavoie
9c5a28aaf0
Translated using Weblate (German) 
Currently translated at 98.1% (757 of 771 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
 2021-02-03 21:42:00 +01:00
J. Lavoie
b2065f01a7
Translated using Weblate (Italian) 
Currently translated at 92.7% (715 of 771 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/it/
 2021-02-03 21:42:00 +01:00
J. Lavoie
c37b7c4cc8
Translated using Weblate (French) 
Currently translated at 100.0% (771 of 771 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
 2021-02-03 21:41:59 +01:00
Florian Giroud
a5db3774f9
test: Added tests for expression panels, #3498 (#3535) 
* test: Added tests for expression panels, #3498

* Cosmetic changes, renaming tests

* Refactored unique expressions used in tests
 2021-02-02 09:09:25 +01:00
Florian Giroud
23be710f2c
test: Refactored the facet test, added more cases (#3534) 
* test: Refactored the facet test, added more cases, added utility methods, #3419

* Update main/tests/cypress/cypress/integration/project/grid/column/facet/facets.spec.js

Co-authored-by: Thad Guidry <thadguidry@gmail.com>

* Update main/tests/cypress/cypress/integration/project/grid/column/facet/facets.spec.js

Co-authored-by: Thad Guidry <thadguidry@gmail.com>

* Update main/tests/cypress/cypress/integration/project/grid/column/facet/facets.spec.js

Co-authored-by: Thad Guidry <thadguidry@gmail.com>

* Removed assertion from utility method editCell

Co-authored-by: Thad Guidry <thadguidry@gmail.com>
 2021-02-02 09:07:40 +01:00
Florian Giroud
3ce9292b66
test: Added test cases for edit Cells, #3423 (#3541) 2021-02-01 14:43:27 +01:00
Kush Trivedi
b8982d1d6e
tests: add test for filtering project through tags (#3521) 
* tests: add test for filtering project through tags

Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-02-01 13:49:04 +01:00
Kush Trivedi
0b748bcc37
feat: add tests for sorting column (#3519) 
* feat: add tests for sorting column
 2021-02-01 13:40:40 +01:00
dependabot[bot]
ee6fccdd67
Bump mockwebserver from 4.9.0 to 4.9.1 (#3549) 
Bumps [mockwebserver](https://github.com/square/okhttp) from 4.9.0 to 4.9.1.
- [Release notes](https://github.com/square/okhttp/releases)
- [Changelog](https://github.com/square/okhttp/blob/master/CHANGELOG.md)
- [Commits](https://github.com/square/okhttp/compare/parent-4.9.0...parent-4.9.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-02-01 11:07:16 +01:00
Isao Matsunami
aff31c50ee
Translated using Weblate (Japanese) 
Currently translated at 100.0% (771 of 771 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2021-01-29 11:17:46 +01:00
Kush Trivedi
7e81f9500b
fix: properly migrate to cypress 6.2.1 (#3533) 
Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-01-28 12:36:02 +01:00
Florian Giroud
8c50a18a85
fix: Reverted Cypress to 6.2.1 
Reverted Cypress, because of too many stability issues with the latest 6.3
 2021-01-28 12:22:23 +01:00
Kush Trivedi
900ff2db9a
tests: UX Test for project list deletion, sort, filter (#3480) 
* tests: UX Test for project list deletion, sort, filter

Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-01-28 11:45:05 +01:00
Kush Trivedi
f661201e9a
fix: add additional version translation (#3485) 
Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-01-27 09:57:42 +01:00
dependabot[bot]
448faf0f27
Bump jena.version from 3.9.0 to 3.17.0 (#3379) 
* Bump jena.version from 3.9.0 to 3.17.0

Bumps `jena.version` from 3.9.0 to 3.17.0.

Updates `jena-arq` from 3.9.0 to 3.17.0

Updates `jena-base` from 3.9.0 to 3.17.0

Updates `jena-cmds` from 3.9.0 to 3.17.0

Updates `jena-core` from 3.9.0 to 3.17.0

Signed-off-by: dependabot[bot] <support@github.com>

* Add commons-codec dependency for Jena

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Tom Morris <tfmorris@gmail.com>
 2021-01-27 09:20:56 +01:00
dependabot[bot]
951175a1f5
Bump cypress-file-upload from 5.0.1 to 5.0.2 in /main/tests/cypress (#3516) 
Bumps [cypress-file-upload](https://github.com/abramenal/cypress-file-upload) from 5.0.1 to 5.0.2.
- [Release notes](https://github.com/abramenal/cypress-file-upload/releases)
- [Commits](https://github.com/abramenal/cypress-file-upload/compare/v5.0.1...v5.0.2)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-01-27 09:15:30 +01:00
dependabot[bot]
a4ea122cc8
Bump clojure from 1.10.1 to 1.10.2 (#3523) 
Bumps [clojure](https://github.com/clojure/clojure) from 1.10.1 to 1.10.2.
- [Release notes](https://github.com/clojure/clojure/releases)
- [Changelog](https://github.com/clojure/clojure/blob/master/changes.md)
- [Commits](https://github.com/clojure/clojure/compare/clojure-1.10.1...clojure-1.10.2)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-01-27 09:15:14 +01:00
Antoine Beaubien
8b978d1336
Fix editing preference with old value (#2769) 
Fix the editing of a pref that proposed the oldest value of a preference, instead of the current value
 2021-01-27 09:07:03 +01:00
Florian Giroud
a421447a8f
test: Improved the way we handle fixtures, #3505 (#3506) 
* test: Improved the way we handle fixtures, #3505

* Added a fix for an invalid call to loadAndVisitProject, added cypress download path to gitignore
 2021-01-25 21:05:03 +01:00
dependabot[bot]
61fe0ed458
Bump cypress-file-upload from 5.0.0 to 5.0.1 in /main/tests/cypress (#3503) 
Bumps [cypress-file-upload](https://github.com/abramenal/cypress-file-upload) from 5.0.0 to 5.0.1.
- [Release notes](https://github.com/abramenal/cypress-file-upload/releases)
- [Commits](https://github.com/abramenal/cypress-file-upload/compare/v5.0.0...v5.0.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-01-22 12:23:39 +01:00
allanaaa
d7cd7834a4
Updating codebase links (#3508) 
* Updating codebase links

Changing obsolete links to the github wiki to the new docs.

* Open Help in new window
 2021-01-22 08:51:47 +01:00
Kush Trivedi
2f375664f2
feat: introduct prettier style formatting for cypress test suite (#3494) 
Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-01-21 14:08:01 +01:00
dependabot[bot]
1a2a5082d7
Bump fs-extra from 9.0.1 to 9.1.0 in /main/tests/cypress (#3500) 
Bumps [fs-extra](https://github.com/jprichardson/node-fs-extra) from 9.0.1 to 9.1.0.
- [Release notes](https://github.com/jprichardson/node-fs-extra/releases)
- [Changelog](https://github.com/jprichardson/node-fs-extra/blob/master/CHANGELOG.md)
- [Commits](https://github.com/jprichardson/node-fs-extra/compare/9.0.1...9.1.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-01-20 17:38:00 +01:00
dependabot[bot]
00f31eb758
Bump cypress from 6.2.1 to 6.3.0 in /main/tests/cypress (#3501) 
Bumps [cypress](https://github.com/cypress-io/cypress) from 6.2.1 to 6.3.0.
- [Release notes](https://github.com/cypress-io/cypress/releases)
- [Changelog](https://github.com/cypress-io/cypress/blob/develop/.releaserc.base.js)
- [Commits](https://github.com/cypress-io/cypress/compare/v6.2.1...v6.3.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-01-20 14:45:39 +01:00
S-Harshit
7f18c66189
Broken counts in file selection dialog (#3495) 
* Broken counts in file selection dialog. Closes #3460

* Update file-selection-panel.js
 2021-01-19 09:11:31 +01:00
dependabot[bot]
c6f15ed653
Bump cypress-file-upload from 4.1.1 to 5.0.0 in /main/tests/cypress (#3493) 
Bumps [cypress-file-upload](https://github.com/abramenal/cypress-file-upload) from 4.1.1 to 5.0.0.
- [Release notes](https://github.com/abramenal/cypress-file-upload/releases)
- [Commits](https://github.com/abramenal/cypress-file-upload/compare/v4.1.1...v5.0.0)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-01-18 22:27:12 +01:00
Hosted Weblate
6b873ed3ea
Merge branch 'origin/master' into Weblate. 2021-01-17 10:36:09 +01:00
Isao Matsunami
95c375c034
Translated using Weblate (Japanese) 
Currently translated at 100.0% (770 of 770 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2021-01-17 10:36:09 +01:00
Kush Trivedi
b52261405a
fix: unwanted characted in version metadata (#3482) 
Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-01-17 10:35:59 +01:00
rachittiwari8562
c9ceb9ef47
fixes-issue-#3362 (#3375) 2021-01-13 19:48:18 +01:00
Armand Tavera
690fdeb0b3
Fixes #3364 expanded the sqlexporter dialogs on translation-en.json (#3385) 
* expanded the sqlexporter dialogs on translation-en.json

* renamed the include content and include structure checkbox description
 2021-01-13 19:46:46 +01:00
Boris Lehečka
5204fd0ee0
Translated using Weblate (Czech) 
Currently translated at 33.7% (260 of 770 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/cs/
 2021-01-12 18:32:13 +01:00
CennoxX
823097fb2e
Translated using Weblate (German) 
Currently translated at 98.5% (759 of 770 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
 2021-01-12 18:32:09 +01:00
Isao Matsunami
1c8656cc92
Translated using Weblate (Japanese) 
Currently translated at 100.0% (770 of 770 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2021-01-12 18:32:09 +01:00
Florian Giroud
e2361fee56
Issue 3453, organized the test suite (#3456) 
* Moved and renamed Cypress tests, created folders skeleton

* Updated syntax for assertions in sorting test

* Added test folders

* fix: cache all UI paths for cypress (#3454)

* fix: cache all UI paths for cypress

* Update pull_request.yml

* chore: restore caching in pr workflow (#3457)

Signed-off-by: Kush Trivedi <kushthedude@gmail.com>

Co-authored-by: Kush Trivedi <44091822+kushthedude@users.noreply.github.com>
 2021-01-12 15:24:53 +01:00
dependabot[bot]
a6b7855ede
Bump cypress from 6.0.1 to 6.2.1 in /main/tests/cypress (#3448) 
Bumps [cypress](https://github.com/cypress-io/cypress) from 6.0.1 to 6.2.1.
- [Release notes](https://github.com/cypress-io/cypress/releases)
- [Changelog](https://github.com/cypress-io/cypress/blob/develop/.releaserc.base.js)
- [Commits](https://github.com/cypress-io/cypress/compare/v6.0.1...v6.2.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2021-01-07 22:41:42 +01:00
Kush Trivedi
0e08c50e07
feat: introduce dependabot for cypress suite (#3447) 
Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-01-07 08:37:24 +01:00
Kush Trivedi
fe123129d2
chore: align test-suite name with npm standards (#3439) 
* chore: align test-suite name with npm standards

Signed-off-by: Kush Trivedi <kushthedude@gmail.com>

* chore: rename ci to openrefine

Signed-off-by: Kush Trivedi <kushthedude@gmail.com>

* chore: make requested changes

Signed-off-by: Kush Trivedi <kushthedude@gmail.com>
 2021-01-04 12:28:48 +01:00
Hosted Weblate
2cc7f75569
Merge branch 'origin/master' into Weblate. 2021-01-02 09:46:31 +01:00
Isao Matsunami
87921e7c95
Translated using Weblate (Japanese) 
Currently translated at 100.0% (769 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2021-01-02 09:46:30 +01:00
Cameron Bedard
c6b6616f01
Added confirm dialog for starred expression remove links #501 (#3436) 
* Updated 'remove' link for starred expressions to include a confirm dialog

* bring remove expression dialog dismissal inline with other dialog dismissal

* Changed 'unstar expression?' in translation-en.json to allow better translation.

* Update main/webapp/modules/core/langs/translation-en.json

Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>

Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
 2021-01-02 09:46:24 +01:00
Yaron Shahrabani
8bf621b1ef
Translated using Weblate (Hebrew) 
Currently translated at 87.6% (674 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/he/
 2021-01-01 14:29:12 +01:00
dependabot[bot]
4b3f359002
Bump joda-time from 2.10.8 to 2.10.9 (#3438) 
Bumps [joda-time](https://github.com/JodaOrg/joda-time) from 2.10.8 to 2.10.9.
- [Release notes](https://github.com/JodaOrg/joda-time/releases)
- [Changelog](https://github.com/JodaOrg/joda-time/blob/master/RELEASE-NOTES.txt)
- [Commits](https://github.com/JodaOrg/joda-time/compare/v2.10.8...v2.10.9)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2020-12-30 08:58:12 +01:00
Florian Giroud
4b6106a386
Run UI tests in continuous integration (#3393) 
* Fixed flaky tests

* Refactored ui_test commans-line, added documentation

* Attempt to build a workflow with cypress

* Fixed CI UX tests build

* Changed cyprss actions for pull-request

* Merged Cypress workflow into the regular PR target workflow

* Refactored Github workflows to include Cypress Tests

* Revert Ci build to pull_request_target
 2020-12-15 20:34:15 +01:00
dependabot[bot]
2cf6a359c2
Bump guava from 30.0-jre to 30.1-jre (#3409) 
Bumps [guava](https://github.com/google/guava) from 30.0-jre to 30.1-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2020-12-15 07:53:06 +01:00
dependabot[bot]
eb42515b6e
Bump httpclient5 from 5.0.2 to 5.0.3 
Bumps [httpclient5](https://github.com/apache/httpcomponents-client) from 5.0.2 to 5.0.3.
- [Release notes](https://github.com/apache/httpcomponents-client/releases)
- [Changelog](https://github.com/apache/httpcomponents-client/blob/master/RELEASE_NOTES.txt)
- [Commits](https://github.com/apache/httpcomponents-client/compare/rel/v5.0.2...rel/v5.0.3)

Signed-off-by: dependabot[bot] <support@github.com>
 2020-12-07 07:57:55 +00:00
Tom Morris
14f43dc2cc
Refactor HTTP code into common module & Improve Fetch URL - fixes #3129 (#3237) 
* Refactor HTTP code into a common utility class 

Centralizes the six (slightly) different implementations to use
a common Apache HTTP Client 5 implementation which implements our
strategies for retries, timeouts, error handling, etc.

Apache HTTP Client 5 adds support for Retry-After headers, HTTP/2,
and a bunch of other stuff under the covers.

Moves request delay to a request interceptor and fixes calculation
of the delay (again). Increase retries from 1x to 3x and use delay*2
as the default retry interval, if no Retry-After header. Uses an 
exponential backoff strategy for multiple retries.

* Reuses HTTP client across requests
* Use IOException instead of Exception for HTTP errors
 2020-12-07 00:38:36 -05:00
Mahesh Jindal
4f97fd55a5
Fix: Preventing addition of any empty cells with whitespaces while importing Xml Data with Tests #1095 (#3357) 
* Fix: Preventing addition of any empty cells with whitespaces while importing Xml data with Tests : Issue #1095

* Chore: Using 'CharMatcher' to match whitespace pattern instead of using custom regex : Issue #1095
 2020-12-02 18:11:45 +01:00
dependabot[bot]
c3f1b592e6
Bump httpcore from 4.4.13 to 4.4.14 (#3376) 
Bumps httpcore from 4.4.13 to 4.4.14.

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2020-12-01 10:37:55 +01:00
Tom Morris
2872ceeb7a
Merge pull request #3349 from thadguidry/fingerprint-wynn-thadguidry 
Add Wynn to fingerprint to support Old English texts
 2020-11-28 22:08:00 -05:00
Thad Guidry
3d30897b3b Add Wynn to fingerprint to support Old English texts 2020-11-28 21:40:49 -05:00
Tom Morris
721007ca1c
Merge pull request #3333 from OpenRefine/dependabot/maven/com.github.albfernandez-juniversalchardet-2.4.0 
Bump juniversalchardet from 2.3.2 to 2.4.0
 2020-11-28 20:28:35 -05:00
rachittiwari8562
8740d1bcba
Fix UI of scatterplot-facet and dialog - fixes #3228 (#3338) 2020-11-28 20:16:23 -05:00
boutagouga mabrouk
40b285fb93
Translated using Weblate (Arabic) 
Currently translated at 25.7% (198 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ar/
 2020-11-28 20:29:02 +01:00
Isao Matsunami
ebcd0c3398
Translated using Weblate (Japanese) 
Currently translated at 100.0% (769 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-11-28 20:29:00 +01:00
Alhiani Brahim
f5531baf84
Translated using Weblate (Arabic) 
Currently translated at 17.0% (131 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ar/
 2020-11-23 20:37:42 +01:00
Florian Giroud
7950d764ff
Architecture for front end browser-based UI tests, issue #733 (#3340) 
* Added Cypress tests to OpenRefine
* Installed Cypress
* Added a few tests to cover basic OR features
Y

* Enriched langage Tests

* Enriched project_create tests

* Refactored and enriched undo/redo tests, added extract & apply

* Upgraded Cypress to 5.6.0

* Removed the cypress-dot-env plugin, as Cypress now supports nice configuration capabilities

* Added UX tests documentation

* Improved functional tests documentation, added license and description to tests package.json
 2020-11-23 18:18:12 +01:00
rachittiwari8562
990540ce10
Fix #3330: argument checking in phonetic GREL function (#3345) 
* Fix for issue #3330 phonetic-function

* Update main/src/com/google/refine/expr/functions/strings/Phonetic.java

Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>

* Corrected Intendation

Corrected intendation as suggested.

* Added tests to check invalid parameters

* Added tests to check invalid parameters

Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
 2020-11-22 09:23:06 +01:00
mabrouk boutagouga
6df711f2f7
Translated using Weblate (Arabic) 
Currently translated at 16.9% (130 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ar/
 2020-11-21 12:29:04 +01:00
boutagouga mabrouk
6d27d2dcab
Translated using Weblate (Arabic) 
Currently translated at 16.9% (130 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ar/
 2020-11-21 12:29:04 +01:00
Yaron Shahrabani
8343bf57b5
Translated using Weblate (Hebrew) 
Currently translated at 87.5% (673 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/he/
 2020-11-16 12:28:54 +01:00
mv87
15888fb91c
Translated using Weblate (German) 
Currently translated at 98.9% (761 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
 2020-11-16 11:28:50 +01:00
dependabot[bot]
0337f0035e
Bump juniversalchardet from 2.3.2 to 2.4.0 
Bumps [juniversalchardet](https://github.com/albfernandez/juniversalchardet) from 2.3.2 to 2.4.0.
- [Release notes](https://github.com/albfernandez/juniversalchardet/releases)
- [Commits](https://github.com/albfernandez/juniversalchardet/compare/v2.3.2...v2.4.0)

Signed-off-by: dependabot[bot] <support@github.com>
 2020-11-16 07:39:21 +00:00
rachittiwari8562
b07b734359
Add labels to link radio buttons in reconciliation dialog, fixes #3293 (#3327) 2020-11-11 12:04:41 +01:00
CennoxX
9795e39603
Translated using Weblate (German) 
Currently translated at 93.2% (717 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
 2020-11-09 10:26:48 +01:00
Tom Morris
4359f894b8
Check for errors on Guess Types query - fixes #3173 (#3318) 
Don't assume that the query always succeeds.
Error reporting is rudimentary (alert), but better than nothing.
 2020-11-05 18:24:15 +01:00
Thad Guidry
6c9ad3f31d
Improve documentation of reinterpret GREL function (#3315) 
* add clarity for reinterpret docs

Helps fix #3292

* update reinterpret docs phrasing

We agreed to use "encoding" to be friendly to user exposed messaging instead of "encoder" and "decoder" that is used internally.

* fix serializeReinterpret() test json
 2020-11-05 07:57:12 +01:00
Prachi Joshi
5e1affcbf7 Added translation using Weblate (Marathi) 2020-11-04 16:53:46 +01:00
dependabot[bot]
a77ef1fbd8
Bump guava from 24.1.1-jre to 30.0-jre (#3299) 
Bumps [guava](https://github.com/google/guava) from 24.1.1-jre to 30.0-jre.
- [Release notes](https://github.com/google/guava/releases)
- [Commits](https://github.com/google/guava/commits)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2020-11-04 10:30:18 -05:00
Tom Morris
e809c707ff Fix up Javadoc 2020-11-03 15:44:07 -05:00
Tom Morris
fb96d22dec Revert "Fix Reinterpret missing documentation" 
This reverts commit f7cece6103.
 2020-11-03 14:49:00 -05:00
Thad Guidry
f7cece6103 Fix Reinterpret missing documentation 2020-11-03 09:42:33 -06:00
Adolfo Jayme Barrientos
a6c7328007
Translated using Weblate (Portuguese) 
Currently translated at 97.6% (751 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt/
 2020-11-02 14:26:48 +01:00
Yaron Shahrabani
b842760e96
Translated using Weblate (Hebrew) 
Currently translated at 86.6% (666 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/he/
 2020-11-02 14:26:48 +01:00
Adolfo Jayme Barrientos
4a786366ac
Translated using Weblate (Spanish) 
Currently translated at 99.4% (765 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
 2020-11-02 14:26:47 +01:00
dependabot[bot]
2291b5953c
Bump powermock.version from 2.0.7 to 2.0.9 (#3303) 
Bumps `powermock.version` from 2.0.7 to 2.0.9.

Updates `powermock-module-testng` from 2.0.7 to 2.0.9
- [Release notes](https://github.com/powermock/powermock/releases)
- [Changelog](https://github.com/powermock/powermock/blob/release/2.x/docs/changelog.txt)
- [Commits](https://github.com/powermock/powermock/compare/powermock-2.0.7...powermock-2.0.9)

Updates `powermock-api-mockito2` from 2.0.7 to 2.0.9
- [Release notes](https://github.com/powermock/powermock/releases)
- [Changelog](https://github.com/powermock/powermock/blob/release/2.x/docs/changelog.txt)
- [Commits](https://github.com/powermock/powermock/compare/powermock-2.0.7...powermock-2.0.9)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2020-11-02 11:11:20 +01:00
dependabot[bot]
32dc7957ef
Bump git-commit-id-plugin from 4.0.0 to 4.0.2 (#3298) 
* Bump git-commit-id-plugin from 4.0.0 to 4.0.2

Bumps git-commit-id-plugin from 4.0.0 to 4.0.2.

Signed-off-by: dependabot[bot] <support@github.com>

* Bump to maven-git-commit-id-plugin 4.0.3 for JSON bugfix

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Tom Morris <tfmorris@gmail.com>
 2020-11-02 08:08:50 +01:00
rubyAnne
352127558a
changed to reflect the function's acceptance of either simple string … (#3294) 
* changed to reflect the function's acceptance of either simple string or regex

* cast p into a Pattern

* cast p into a Pattern

* Changed test to reflect the new output from function.
 2020-11-01 08:52:36 +01:00
dependabot-preview[bot]
bbc4d84b2b
Bump joda-time from 2.10.6 to 2.10.8 (#3286) 
Bumps [joda-time](https://github.com/JodaOrg/joda-time) from 2.10.6 to 2.10.8.
- [Release notes](https://github.com/JodaOrg/joda-time/releases)
- [Changelog](https://github.com/JodaOrg/joda-time/blob/master/RELEASE-NOTES.txt)
- [Commits](https://github.com/JodaOrg/joda-time/compare/v2.10.6...v2.10.8)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-10-26 07:52:36 +01:00
Tom Morris
c8220d687e
Improve fingerprint keyers - fixes #3282 (#3283) 
* Add more keyer tests

- All forms of Unicode whitespace for both fingerprint & N-gram fingerprint
- additional N-gram fingerprint cases

* Improve fingerprint keyers

- Update N-gram fingerprint keyer to match (missed last time)
- refactor string normalization to reduce redundancy between two keyers
- add C1 controls to control characters that are stripped
- include all Unicode whitespace characters in splitting delimiter
  and don't strip controls which are whitespace (HT, LF, VT, FF, CR,
NEL)
- minor cleanups, simplifications, and performance optimizations
 2020-10-25 20:32:30 +01:00
Faiq Miftakhul Falakh
6f75d07e1c
Translated using Weblate (Indonesian) 
Currently translated at 1.6% (13 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/id/
 2020-10-22 15:26:48 +02:00
Yaron Shahrabani
03e7a303e4
Translated using Weblate (Hebrew) 
Currently translated at 85.3% (656 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/he/
 2020-10-22 15:26:46 +02:00
Faiq Miftakhul Falakh
275d26cea2
Added translation using Weblate (Indonesian) 2020-10-21 15:16:52 +02:00
Weblate (bot)
ffda8216b4
Translations update from Weblate (#3278) 
* Added translation using Weblate (Polish)

* Added translation using Weblate (Polish)

* Added translation using Weblate (Polish)

* Translated using Weblate (Polish)

Currently translated at 6.3% (49 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pl/

* Translated using Weblate (Polish)

Currently translated at 4.0% (9 of 225 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/pl/

* Translated using Weblate (Polish)

Currently translated at 19.3% (12 of 62 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/pl/

* Translated using Weblate (French)

Currently translated at 99.2% (763 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/

Co-authored-by: Włodzimierz Bartczak <wzbartczak@gmail.com>
Co-authored-by: Tom Morris <tfmorris@gmail.com>
 2020-10-20 13:33:50 -04:00
Georgios Mavropalias
13fad7ae43
Translated using Weblate (Greek) 
Currently translated at 11.4% (88 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/el/
 2020-10-19 11:11:21 +02:00
Yaron Shahrabani
384ca32f71
Translated using Weblate (Hebrew) 
Currently translated at 84.3% (649 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/he/
 2020-10-19 11:11:21 +02:00
ssantos
99f9fd438f
Translated using Weblate (Portuguese) 
Currently translated at 97.6% (751 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt/
 2020-10-08 10:26:52 +02:00
Isao Matsunami
d34172dea3
Translated using Weblate (Japanese) 
Currently translated at 100.0% (769 of 769 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-10-08 10:26:51 +02:00
dependabot-preview[bot]
1aadbfa65f
Bump httpclient from 4.5.12 to 4.5.13 (#3252) 
Bumps httpclient from 4.5.12 to 4.5.13.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-10-07 10:18:38 +02:00
dependabot-preview[bot]
1366ec0611
Bump httpmime from 4.5.12 to 4.5.13 (#3251) 
Bumps httpmime from 4.5.12 to 4.5.13.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-10-07 10:17:48 +02:00
Tom Morris
af1cf375f5
Add Java runtime name & version to About page - fixes #3240 (#3244) 
* Visually center links box

* Add the Java runtime info to the About page - fixes #3240

- Add the Java runtime name & version GetVersionCommand
- Add the returned information to the About page
 2020-10-02 09:41:37 +02:00
Tom Morris
82b1cf0bfa
Merge pull request #3236 from tfmorris/3235-uniques-ordering 
Maintain ordering for GREL uniques() function
 2020-10-01 23:26:19 -04:00
Hosted Weblate
04dfbcd388
Merge branch 'origin/master' into Weblate. 2020-10-01 11:31:40 +02:00
ssantos
74273e0b87
Translated using Weblate (Portuguese) 
Currently translated at 99.8% (751 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt/
 2020-10-01 11:31:39 +02:00
Chetan Verma
047d7c2de4
internationalised the label using $.i18n (#3104) 
* internationalised the label using $.i18n

* fix some problem

* make it more clear and understandable

* change prefix 'core-buttons/ to 'core-import-formats'

* formateNames to formateLabelKey

* fix spelling mistake

* add translation-en.json in pc-axis

* remove from previous file

* Add internationalized activation

* improvement in pc-axis langs

Co-authored-by: chetan <you@example.com>
 2020-10-01 11:31:29 +02:00
Tom Morris
30d16c2077 Add Thad/Owen's test 2020-09-30 20:57:57 -04:00
Tom Morris
dbb8e530c8 Add tests for array reverse & join 2020-09-30 20:24:05 -04:00
Tom Morris
d6e42bf5d9 Annotate another missed test 2020-09-30 20:00:08 -04:00
Tom Morris
959200d141 Maintain order for uniques() - fixes #3235 
Also add tests
 2020-09-30 17:45:24 -04:00
Tom Morris
bb4fc50f17 Enable missed test 2020-09-30 17:44:05 -04:00
dependabot-preview[bot]
ca389c52a0
Bump commons-io from 2.7 to 2.8.0 (#3179) 
Bumps commons-io from 2.7 to 2.8.0.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-09-25 12:49:34 -04:00
Mathieu Saby
7d9092dcba
Translated using Weblate (French) 
Currently translated at 98.1% (738 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
 2020-09-24 21:40:58 +02:00
Tom Morris
c76e2b9a46
disable flaky readTableWithLinks test - refs #3128 (#3207) 2020-09-23 07:41:22 +02:00
Hosted Weblate
f72ca8a1e4
Merge branch 'origin/master' into Weblate. 2020-09-14 09:48:23 +02:00
dependabot-preview[bot]
5b75d5d43e
Bump mockwebserver from 4.8.1 to 4.9.0 (#3187) 
Bumps [mockwebserver](https://github.com/square/okhttp) from 4.8.1 to 4.9.0.
- [Release notes](https://github.com/square/okhttp/releases)
- [Changelog](https://github.com/square/okhttp/blob/master/CHANGELOG.md)
- [Commits](https://github.com/square/okhttp/compare/parent-4.8.1...parent-4.9.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-09-14 09:48:14 +02:00
ssantos
5734282bd0
Translated using Weblate (Portuguese) 
Currently translated at 99.8% (751 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt/
 2020-09-13 23:36:17 +02:00
Georgios Mavropalias
cece265787
Translated using Weblate (Greek) 
Currently translated at 11.5% (87 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/el/
 2020-09-13 23:36:17 +02:00
Thad Guidry
3f6d1eabba
Adds new Jsoup wholeText() function and tests (#3181) 
* Adds new Jsoup wholeText() function and tests
- Ref: https://github.com/jhy/jsoup/blob/master/CHANGES#L275
- Ref: https://jsoup.org/apidocs/org/jsoup/nodes/Element.html#wholeText()

* update the description of function

* Update main/src/com/google/refine/expr/functions/xml/WholeText.java
 2020-09-12 16:14:26 +02:00
Jathin Sreenivas
7c0607b890
Fix #3163, dialog to add recon service submits when pressing Enter (#3183) 
* Fix for issue #3163, Calling the okbutton.click() on press of enter

* Fix for issue #3163, using form and bind on submit.

* Fix for issue #3163, submit using jQuery's submit method
 2020-09-11 20:13:34 +02:00
Hosted Weblate
3196263043
Merge branch 'origin/master' into Weblate. 2020-09-10 13:01:00 +02:00
Gomaa
90d5debb8c
fix #2910: Recon service remove button also selects the service (#3168) 
* FIx for issue #2910 : Service remove button click event propagates to underlying element

* Use stopImmediatePropagation function to fix the issue
 2020-09-10 13:00:49 +02:00
Boris Lehečka
574d94331d
Translated using Weblate (Czech) 
Currently translated at 25.9% (195 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/cs/
 2020-09-09 19:36:10 +02:00
Isao Matsunami
8365a5107b
Translated using Weblate (Japanese) 
Currently translated at 100.0% (752 of 752 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-09-09 19:36:09 +02:00
Tom Morris
eaf881ced7
Importer refactoring cleanup (#2984) 
* Clean up importer refactoring

Remove an extra copy of filename setting.
Revert some additional API changes (retaining both versions)

* Revert archive file name changes & mark as deprecated
 2020-09-06 17:46:08 -04:00
Tom Morris
15a069d3d5
Improve exception reporting - refs #3145 (#3146) 
Include the exception name with the message returned to the user.
 2020-09-06 08:26:49 +02:00
Tom Morris
a86a6d4e3b
sort() handles nulls instead of throwing NPE - fixes #3152 (#3162) 
* Add utility helpers to create array of comparable items

* Extend sort() to handle arrays with nulls

- Instead of NullPointerException on nulls, sort them last
- add JSON helpers to return Comparable[] in addition to Object[]
- Non-homogenous arrays or arrays with non-primitive
  objects (array or object) are not sortable
- Add tests for both new and old sort functionality
 2020-09-05 23:01:47 +02:00
dependabot-preview[bot]
af5f7a5cf4
Bump rhino-runtime from 1.7.12 to 1.7.13 
Bumps [rhino-runtime](https://github.com/mozilla/rhino) from 1.7.12 to 1.7.13.
- [Release notes](https://github.com/mozilla/rhino/releases)
- [Changelog](https://github.com/mozilla/rhino/blob/master/RELEASE-NOTES.md)
- [Commits](https://github.com/mozilla/rhino/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-09-03 06:38:56 +00:00
Tom Morris
37ae9a3d51
Merge pull request #3156 from OpenRefine/3132-recon-read-timeout 
Set read timeout to 60 sec for reconciliation.
 2020-09-02 13:16:17 -04:00
Antonin Delpeuch
609e4bac4c Set read timeout to 60 sec for reconciliation. Closes #3132 2020-09-02 16:03:29 +02:00
Hosted Weblate
7130c513c0
Merge branch 'origin/master' into Weblate. 2020-08-30 20:27:21 +02:00
ssantos
0127dc8350
Translated using Weblate (Portuguese) 
Currently translated at 100.0% (751 of 751 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt/
 2020-08-30 20:27:19 +02:00
Tom Morris
aa43445c99
Extend forEach() to support JSON objects (#3150) 
* Refactor GREL Get tests

- move helper up to RefineTest
- move tests to the correct module

* Extend forEach() to support JSON objects - fixes #3149

Also add tests for existing forEach forms in addition to the new one

* Add a couple more tests
 2020-08-30 08:40:17 +02:00
Tom Morris
0f15c61ef0
Merge pull request #3119 from OpenRefine/dependabot/maven/com.squareup.okhttp3-mockwebserver-4.8.1 
Bump mockwebserver from 4.7.2 to 4.8.1
 2020-08-27 17:25:51 -04:00
Lisa Chandra
5ca5f3cb7b
Restructured the Facets (#3097) 
* added class to List Facet

* added class to Timerange Facet

* added class to Range Facet

* added class to Text Filter Facet

* added class to Scatterplot Facet

* added base class

* added end line in facet.js

* fixed indentations facet.js

* fixed indentation again

* removed fields

* added suggested changes
 2020-08-25 12:29:27 -04:00
ssantos
6a5eb2425f
Added translation using Weblate (Portuguese) 2020-08-24 19:40:57 +02:00
dependabot-preview[bot]
e0646716f4
Bump mockwebserver from 4.7.2 to 4.8.1 
Bumps [mockwebserver](https://github.com/square/okhttp) from 4.7.2 to 4.8.1.
- [Release notes](https://github.com/square/okhttp/releases)
- [Changelog](https://github.com/square/okhttp/blob/master/CHANGELOG.md)
- [Commits](https://github.com/square/okhttp/compare/parent-4.7.2...parent-4.8.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-08-24 06:41:48 +00:00
Tom Morris
95756bf11f Replace deprecated constant 2020-08-23 14:17:40 -04:00
Tom Morris
441c069bc5 Add some string function tests 
Including a test for Apache TEXT-149 behavior change
https://github.com/apache/commons-text/pull/119

Add some more string function tests
 2020-08-23 14:17:40 -04:00
Tom Morris
b5aea3b780 Remove unused imports 2020-08-23 14:17:40 -04:00
Tom Morris
a50669800f Split up multifunction test modules 
Distributes the tests to individual modules per function and
deletes the former multifunction test modules.
 2020-08-23 14:11:49 -04:00
Tom Morris
392a64b25e Refactor tests to hoist common methods into RefineTest 
Moves the invoke() method and the associated fields into
the super class and deletes the redundant implementations.
 2020-08-23 14:11:49 -04:00
Antonin Delpeuch
9ac54edbba
Migrate reconciliation calls to Apache HTTP client (#2906) 
* Migrate reconciliation calls to OkHTTP, for #2903

* Migrate to Apache HTTP Commons

* Migrate data extension to Apache HTTP client

* Deprecate HttpURLConnection in RefineServlet

* Use LaxRedirectStrategy, clean up imports

* Remove read and pool timeouts, only keep the connection timeout

* Adapt mocking of HTTP calls after migration
 2020-08-23 14:04:59 +02:00
Tom Morris
259705ad5f
assertEqualAsJson test helper refactor (#3113) 
* Refactor test helper

Create a version of the assert that uses the standard parameter
order and deprecate the version that uses inverted order.

* Use consistent Assert class and parameter ordering
 2020-08-23 11:04:44 +02:00
Isao Matsunami
9470c47031 Translated using Weblate (Japanese) 
Currently translated at 100.0% (751 of 751 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-08-22 18:14:45 +02:00
Tom Morris
f74e3e048e
Fix i18n key typo - fixes #3093 (#3094) 2020-08-17 22:45:50 +02:00
Tom Morris
5eff85b76c
Update jQuery UI to 1.12 - fixes #3001 (#3010) 
* Update jQuery UI from 1.10.3 to 1.12.1 and associated theme CSS

* Fix sidebar tab layout issue with new jQuery UI

* Update initialization jQuery UI Tabs widgets

selected is now active, but the first tab is selected by default
so we don't need to do it manually.

* Patch GData initialization error

Don't attempt to initialize if we get no docs back (ie unauthorized)
 2020-08-17 14:49:56 +02:00
Tom Morris
591d47abe3
Fix About page script references - fixes #3088 (#3090) 
* Fix About page - fixes #3088

Update jQuery version
Include correct Javascript file to get version information
Fix version display

* Remove obsolete Freebase logo license reference
 2020-08-17 13:16:11 +02:00
Tom Morris
fc21d58ed1
Don't count TABs as control characters - fixes #3061 (#3068) 
* Don't count TABs as control characters - fixes #3061

* Add TSV test. Replace info logging w/assert message
 2020-08-16 10:35:25 +02:00
vuod
907b0d5169
Translated using Weblate (French) 
Currently translated at 98.2% (738 of 751 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
 2020-08-15 00:32:54 +02:00
Shih-Chan Fan
97fe642ceb Translated using Weblate (Chinese (Traditional)) 
Currently translated at 6.3% (48 of 751 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/zh_Hant/
 2020-08-13 12:16:06 -04:00
Shih-Chan Fan
6ab25d8fb6 Added translation using Weblate (Chinese (Traditional)) 2020-08-13 12:16:06 -04:00
dependabot-preview[bot]
937bb94a0e
Bump maven-resources-plugin from 3.1.0 to 3.2.0 
Bumps [maven-resources-plugin](https://github.com/apache/maven-resources-plugin) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/apache/maven-resources-plugin/releases)
- [Commits](https://github.com/apache/maven-resources-plugin/compare/maven-resources-plugin-3.1.0...maven-resources-plugin-3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-08-12 08:15:08 +00:00
Tom Morris
109aa78cf9
Merge pull request #3051 from OpenRefine/dependabot/maven/commons-validator-commons-validator-1.7 
Bump commons-validator from 1.6 to 1.7
 2020-08-10 13:04:12 -04:00
Tom Morris
b73b480d7d
Remove tests of third party code (#3050) 
Neither of these tests are testing OpenRefine code
(and a negative NotEquals test is useless anyway)
 2020-08-10 12:39:30 +02:00
dependabot-preview[bot]
1060a117ca
Bump commons-validator from 1.6 to 1.7 
Bumps commons-validator from 1.6 to 1.7.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-08-10 08:19:45 +00:00
Rafael Fontenelle
680cfa996d
Translated using Weblate (Portuguese (Brazil)) 
Currently translated at 100.0% (751 of 751 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
 2020-08-09 18:32:49 +02:00
Tom Morris
9c403d59d2
Add separator to zip slip check - fixes #3043 (#3048) 2020-08-09 14:48:55 +02:00
Tom Morris
55edae2b7b
Fix ToDate test failure & inefficiency - fixes #3026 (#3027) 
* Fix ToDate test failure - fixes #3026

Instead of computing offset from UTC at current
point in time, use the offset from the parsed
date so that we're not affected by crossing
a daylight savings time boundary.

* Fix date parsing with locale as first format string

Also refactors for simpicity, restore some dropped tests,
and restores previous behavior of considering a bad
format string an error instead of silently ignoring it.

It does NOT address another issue which was introduced
in May 2018 of treating date/times without timzone
information as UTC instead of local.

* Restore error checking and messages

* Save & restore default timezone for tests

Also add some ToDos for places where LocalDate is being misused.
 2020-08-09 13:53:43 +02:00
Isao Matsunami
2f604e551a
Translated using Weblate (Japanese) 
Currently translated at 100.0% (751 of 751 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-08-08 12:47:41 +02:00
Hosted Weblate
478aeff793
Merge branch 'origin/master' into Weblate. 2020-08-08 02:20:33 +02:00
Tom Morris
c90f0f4cff
Translated using Weblate (French) 
Currently translated at 99.0% (746 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
 2020-08-08 02:20:32 +02:00
Tom Morris
79399691a4
Translated using Weblate (Spanish) 
Currently translated at 99.4% (749 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
 2020-08-08 02:20:32 +02:00
Thad Guidry
f220d6b989 Speed up git commit extraction 
Fixes #3039
Limits only asking Git for 2 properties, branch and commit id abbrev

Also add warning about version of git-commit-id-plug
 2020-08-07 14:16:08 -04:00
Tom Morris
e38d586a0e Revert "Merge pull request #3037 from OpenRefine/dependabot/maven/pl.project13.maven-git-commit-id-plugin-4.0.2" 
This reverts commit ebdb15fc8c, reversing
changes made to 8fb2402432.

git-commit-id plugin doesn't work at 4.0.2
 2020-08-07 13:44:46 -04:00
Tom Morris
ebdb15fc8c
Merge pull request #3037 from OpenRefine/dependabot/maven/pl.project13.maven-git-commit-id-plugin-4.0.2 
Bump git-commit-id-plugin from 4.0.0 to 4.0.2
 2020-08-07 12:13:44 -04:00
dependabot-preview[bot]
72f5f5fde9
Bump mockwebserver from 4.8.0 to 4.8.1 
Bumps [mockwebserver](https://github.com/square/okhttp) from 4.8.0 to 4.8.1.
- [Release notes](https://github.com/square/okhttp/releases)
- [Changelog](https://github.com/square/okhttp/blob/master/CHANGELOG.md)
- [Commits](https://github.com/square/okhttp/compare/parent-4.8.0...parent-4.8.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-08-07 08:06:07 +00:00
dependabot-preview[bot]
6404434333
Bump git-commit-id-plugin from 4.0.0 to 4.0.2 
Bumps git-commit-id-plugin from 4.0.0 to 4.0.2.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-08-07 08:05:39 +00:00
Tom Morris
6095c44cb7
Update to jQuery 1.12.4 and jQuery Migrate 1.4.1 - fixes 2932 (#2933) 
* Refactor module wiring to reduce redundancy

* Update to jQuery 1.12.4 & jQuery Migrate 1.4.1 - fixes #2932

This updates to the latest jQuery 1.x and jQuery Migrate 1.x,
the first step in upgrading to a modern jQuery.

* Add a couple of bug fixes from Google Code SVN

This is an unrelease version from the Google Code freebase-site
repo which only has a few changes from the v4.3 release, but
one of them is removing the `browser.msie` reference that
jQuery Migrate is complaining about.

* Use prop() for 'checked' and 'disabled'

* Update jQuery 'value' property setting code to use val()

* Use prop() instead of attr() to set 'selected'

* Patch for jQuery >1.9
 2020-08-06 13:47:31 +02:00
Tom Morris
05fb4e355f
Replace Javascript string concatenation with i18n parameters - addresses #1858 (#3019) 
* Replace js string concatenation with i18n parameters

refs #1858
Remove Javascript string concatentation and use jquery i18n()
instead so that translators have the needed context and
flexibility to be able to do a good job. Also remove code-based
plurals conditionalization and replace with i18n.

* Update French translation so I can test non-English support

* Add missing localization

* Clean up formatting of service API link
 2020-08-04 10:10:38 +02:00
Tom Morris
2f7a357023
Merge pull request #3025 from OpenRefine/dependabot/maven/org.testng-testng-7.3.0 
Bump testng from 7.1.0 to 7.3.0
 2020-08-03 21:09:01 -04:00
Tom Morris
a0819acbd6 Move ProjectManager initialization to beforeMethod 2020-08-03 20:42:31 -04:00
Tom Morris
52194e1685 Add https for all TestNG DTDs 2020-08-03 12:27:58 -04:00
dependabot-preview[bot]
50b21f0474
Bump signpost-commonshttp4 from 2.0.0 to 2.1.1 (#3024) 
Bumps [signpost-commonshttp4](https://github.com/mttkay/signpost) from 2.0.0 to 2.1.1.
- [Release notes](https://github.com/mttkay/signpost/releases)
- [Changelog](https://github.com/mttkay/signpost/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mttkay/signpost/compare/oauth-signpost-2.0.0...oauth-signpost-2.1.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-08-03 14:44:45 +02:00
dependabot-preview[bot]
807cd4ccf3
Bump signpost-core from 2.0.0 to 2.1.1 (#3023) 
Bumps [signpost-core](https://github.com/mttkay/signpost) from 2.0.0 to 2.1.1.
- [Release notes](https://github.com/mttkay/signpost/releases)
- [Changelog](https://github.com/mttkay/signpost/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mttkay/signpost/compare/oauth-signpost-2.0.0...oauth-signpost-2.1.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-08-03 14:44:16 +02:00
Chetan Verma
04309dcfb4
Add improvement-message for vantage. (#3011) 
Fixed self mistakes

modified line forVantage

Revert "modified line forVantage"

This reverts commit f252bde77cedf2f85fbfaf2059e551078ad62c2c.

modification in one anathor line

Co-authored-by: chetan <you@example.com>
 2020-08-03 14:15:39 +02:00
dependabot-preview[bot]
e081961c1f
Bump testng from 7.1.0 to 7.3.0 
Bumps [testng](https://github.com/cbeust/testng) from 7.1.0 to 7.3.0.
- [Release notes](https://github.com/cbeust/testng/releases)
- [Changelog](https://github.com/cbeust/testng/blob/master/CHANGES.txt)
- [Commits](https://github.com/cbeust/testng/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-08-03 09:01:36 +00:00
Tom Morris
0ebd89c952
Clustering dialog choices limit & performance improvements - fixes #695 (#2996) 
* Clustering dialog choices limit & performance improvements - fixes #695

Fixes #695
- Caps the total number of choices displayed at 10,000 and warns when
  over the limit. Users can use facets to tune which clusters are displayed.
- Doubles the performance of the Javascript processing
- Only displays count of rows for a choice if it's > 1 to DOM elements
- Adds internationalization for row count

For 41K clusters containing 118K choices, processing dropped from
3m20s to 1m20s, but with the 10K choice cap total time is ~10sec.

* Restore even/odd row class

* Updates from review feedback
 2020-08-01 10:59:41 +02:00
Tom Morris
5985f95ce1
Explicitly set SameSite=Lax on cookie - fixes #3007 (#3014) 2020-08-01 10:58:16 +02:00
Lisa Chandra
1dcc83209c
Faster rendering of rows and cells (#2973) 
* changes to rendering of rows

* some cell rendering improvements

* more render row improvements

* fixed jQuery methods on js elements

* added comment for nbsp
 2020-07-28 18:25:32 +02:00
Tom Morris
db42bcab92
Update to vicino 1.2 and drop transitive dependencies - fixes #2959 (#2998) 
Bump to vicino 1.2 with bug fix and real POM.

Drop dependencies on secondstring and arithcode which are just
transitive dependencies from simile-vicino, now that it has a
proper POM. Fixes #2959.
 2020-07-28 08:19:58 +02:00
dependabot-preview[bot]
d258e9bd05
Bump commons-text from 1.8 to 1.9 
Bumps commons-text from 1.8 to 1.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-27 08:30:43 +00:00
Chetan Verma
86ec7e6b40
Give the name to button 'Back' (#2989) 
* Give the name to button 'Back'

* Using DOM to add name of button
 2020-07-26 09:08:50 +02:00
Chetan Verma
602149db6e
Fix Import Project form to check for the presence of a file (#2979) 2020-07-25 09:45:45 +02:00
Tom Morris
a49ce47a87
Merge pull request #2919 from tfmorris/2917-butterfly-1.0.4 
Update to Butterfly 1.0.4 - fixes #2917
 2020-07-23 14:14:37 -04:00
Tom Morris
83ed9ffdaf
Refactor importer APIs - Fixes #2963 (#2978) 
* Make sure data directory is directory, not a file

* Add a test for zip archive import

Also tests the saving of the archive file name and source filename

* Add TODOs - no functional changes

* Cosmetic cleanups

* Revert importer API changes for archive file name parameter

Fixes #2963
- restore binary compatibility to the API
- hoist the handling of both fileSource and archiveFileName from
TabularImportingParserBase and TreeImportingParserBase to
ImportingParserBase so that there's only one copy. These 3 classes are
all part of the internal implementation, so there should be no
compatibility issue.

* Revert weird flow of control for import options metadata

This reverts the very convoluted control flow that was introduced
when adding the input options to the project metadata. Instead
the metadata is all handled in the importer framework rather than
having to change APIs are have individual importers worry about
it.

The feature never had test coverage, so that is still to be added.

* Add test for import options in project metadata & fix bug

Fixes bug where same options object was being reused and overwritten,
so all copies in the list ended up the same.
 2020-07-23 18:36:14 +02:00
Tom Morris
7512f3cb52 Update to Butterfly 1.0.4 - fixes #2917 
Fixes #2917
Update to Butterfly 1.0.4 which catches NoClassDefFound errors
for Butterfly modules (ie OpenRefine extensions) which are missing
Java dependencies (e.g. those built against earlier versions
of OpenRefine)
 2020-07-23 12:21:24 -04:00
Tom Morris
d5abaac6df
Update marc4j to 2.9.1 - Fixes #2962 (#2977) 
* Add a MARC import test

* Make sure data directory is directory, not a file

* Update to marc4j 2.9.1 - fixes #2962
 2020-07-22 22:12:30 +02:00
Tom Morris
8cfdd5747a
Merge pull request #2952 from OpenRefine/dependabot/maven/org.mockito-mockito-core-3.4.2 
Bump mockito-core from 3.3.3 to 3.4.2
 2020-07-17 13:07:42 -04:00
Tom Morris
5336eca63e Remove redundant mockito dependencies 2020-07-17 12:48:06 -04:00
dependabot-preview[bot]
edf8595977
Bump mockito-core from 3.3.3 to 3.4.2 
Bumps [mockito-core](https://github.com/mockito/mockito) from 3.3.3 to 3.4.2.
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](https://github.com/mockito/mockito/compare/v3.3.3...v3.4.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-17 08:17:43 +00:00
dependabot-preview[bot]
0f391b5343
Bump commons-lang3 from 3.10 to 3.11 
Bumps commons-lang3 from 3.10 to 3.11.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-17 08:17:12 +00:00
Antonin Delpeuch
858bd463a4 Revert "Bump git-commit-id-plugin from 4.0.0 to 4.0.1 (#2948)" 
The dependency update broke the snapshot release process on GitHub Actions:
https://github.com/OpenRefine/OpenRefine/runs/876878262

This reverts commit 52bb2c4d38.
 2020-07-16 11:07:54 +02:00
dependabot-preview[bot]
52bb2c4d38
Bump git-commit-id-plugin from 4.0.0 to 4.0.1 (#2948) 
Bumps git-commit-id-plugin from 4.0.0 to 4.0.1.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-07-16 11:01:43 +02:00
Tom Morris
f2e61b6628
Add tests for wide XLS/XLSX export (#2945) 
Refs #2122. Also reenable a couple of disabled tests
 2020-07-16 10:01:17 +02:00
Tom Morris
a3fab26cca
Fix the text format guesser so it doesn't inappropriately guess WikiText (#2924) 
* Fix text guesser so it doesn't guess wikitext

Fixes #2850
- Add simple magic detector for zip & gzip files to keep
  it from attempting to guess binary files
- Add a counter for C0 controls for the same reason
- Tighten wikitable counters to require marker at
  beginning of the line, per the specification
- Refactor to use Apache Commons instead of private
  counting methods
- Add tests for most TextGuesser formats

* Remove misplaced duplicate test data file

* Fix LGTM warning + minor cleanups

* Use BoundedInputStream to prevent runaway lines
 2020-07-15 08:56:00 +02:00
Hosted Weblate
f9d6c2b93b
Merge branch 'origin/master' into Weblate. 2020-07-14 22:41:55 +02:00
Isao Matsunami
a2100f64f7
Translated using Weblate (Japanese) 
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-07-14 22:41:51 +02:00
Tom Morris
561619399c
Fix order dependent NPE in LoadLanguage test (#2922) 
* Ensure ProjectManager is initialized before test - fixes #2895

* Fix indentation (detabify)
 2020-07-14 18:06:04 +02:00
Tom Morris
ed68541988
Remove informational logging from tests that are passing (#2923) 
* Change logging from info to debug

* Make tests less chatty when they're passing
 2020-07-14 17:47:36 +02:00
Urvashi Gupta
f00129b852
fixes service panel toggling (#2915) 2020-07-14 16:46:10 +02:00
Tom Morris
233cb95289
Ignore events which don't change text input - fixes #1134 (#2846) 
* Ignore events which don't change text input - fixes #1134

* Fix bind
 2020-07-14 08:35:46 +02:00
dependabot-preview[bot]
396efc0d1b
Bump mockwebserver from 4.7.2 to 4.8.0 
Bumps [mockwebserver](https://github.com/square/okhttp) from 4.7.2 to 4.8.0.
- [Release notes](https://github.com/square/okhttp/releases)
- [Changelog](https://github.com/square/okhttp/blob/master/CHANGELOG.md)
- [Commits](https://github.com/square/okhttp/compare/parent-4.7.2...parent-4.8.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-13 08:39:23 +00:00
Allan Nordhøy
98b64b7a01
Translated using Weblate (Norwegian Bokmål) 
Currently translated at 51.6% (389 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nb_NO/
 2020-07-12 13:41:50 +02:00
Rafael Fontenelle
f329f5085b
Translated using Weblate (Portuguese (Brazil)) 
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
 2020-07-12 13:41:49 +02:00
Hosted Weblate
6c69525545
Merge branch 'origin/master' into Weblate. 2020-07-11 12:55:18 +02:00
Allan Nordhøy
128a3089ed
Translated using Weblate (Norwegian Bokmål) 
Currently translated at 51.1% (385 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nb_NO/
 2020-07-11 12:55:18 +02:00
Rafael Fontenelle
b0177e6e33
Translated using Weblate (Portuguese (Brazil)) 
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
 2020-07-11 12:55:17 +02:00
Isao Matsunami
1a7ae77431
Translated using Weblate (Japanese) 
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-07-11 12:55:17 +02:00
Tom Morris
306b541c69
Fix Excel date import - Fixes #1908 (#2909) 
* Add utility functions to check/convert dates

* Add date tests and refactor to DRY up

* Fix date import - fixes #1908

Change from java.util.Date to OpenRefine 3.0+'s OffsetDateTime
Fixes #1908

* Centralize date conversion

* Moving utility methods to ParsingUtilities

* Fix tests
 2020-07-09 23:13:44 +02:00
Urvashi Gupta
a0f2d11255
addStandardServiceOnEnter (#2914) 2020-07-09 22:57:24 +02:00
dependabot-preview[bot]
380942d53f
Bump httpmime from 4.5.2 to 4.5.12 (#2904) 
Bumps httpmime from 4.5.2 to 4.5.12.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-07-08 10:29:09 +02:00
Tom Morris
0562638ffa
Use standard text normalization - fixes #2898 (#2900) 
* Use standard text normalization - fixes #2898

Fixes #2898. Fixes #409. Refs #650

Replaces homegrown ISO Latin-1 only character subsitition
with standard Java Normalize to NFD, followed by diacritic
removal and a few custom character expansions/replacements.

* Fix Mac build

* Improve compatibility with previous code

One intentional change is folding O with stroke to
oe instead of o.

- Use more powerful NFKD instead of NFD
- strip punctuation after decomposition since it can generate
  new punctuation
- Add compatibility test for old asciify() method
- Add some graphically similar characters to substitution table

* Add oe character/ligature & more long S forms

* More tests for ligatures and Latin Extended

* Add Latin-1 Supplement tests
 2020-07-07 21:35:41 +02:00
Urvashi Gupta
f62f63706c
Report HTTP error codes to the user when creating a project from a URL (#2870) 
* HTTP Error

* urlImportingTestCompleted
 2020-07-07 11:58:47 +02:00
Tom Morris
e61d50a1aa
Fix NGramFingerprintKeyer to ignore accents - fixes #1161 (#2899) 
Fixes #1161
This change parallels what was done in #1257 1da3c00 to fix
the FingerprintKeyer and moves the diacritic removal before
the deduping. Includes a test.
 2020-07-07 09:02:49 +02:00
morrme
66aeaa4409
Remove incorrect "dates" from guess data type label - fixes #2883 
Fixes #2883.
 2020-07-06 19:55:23 -04:00
Hosted Weblate
f421cfd76f
Merge branch 'origin/master' into Weblate. 2020-07-06 03:42:12 +02:00
Tijs De Schacht
dfcd5a0f25
Translated using Weblate (Dutch) 
Currently translated at 54.4% (410 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/nl/
 2020-07-06 03:42:08 +02:00
Mohamed El ouard Baouche
a6a5935585
Translated using Weblate (Arabic) 
Currently translated at 5.8% (44 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ar/
 2020-07-06 03:41:49 +02:00
Isao Matsunami
948d1acae1
Translated using Weblate (Japanese) 
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-07-06 03:41:49 +02:00
Tom Morris
8a6171432d
Translated using Weblate (French) 
Currently translated at 99.0% (746 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
 2020-07-06 03:41:48 +02:00
Tom Morris
3717111db8
Fix Open Office Spreadsheet (ODS) dates (#2843) 
* Truncate any completely empty columns on the right

Fixes #565
The current versions of Open Office create default spreadsheets
with over 1000 empty columns. Keep track of the rightmost
non-empty column when importing and truncate everything else.

Also adds a basic ODS import test.

* Fix dates in ODS spreadsheets

Fixes #2224
 2020-07-04 08:42:33 +02:00
Antonin Delpeuch
f4692de9e1 Increase maximum wait for testInvalidUrl, follow-up for #2876 #2875 2020-07-03 21:48:43 +02:00
Tom Morris
df8d092132
Micro benchmark harness & ToNumber optimizations (#2859) 
* Performance optimized version of ToNumber

Approximately 5x faster for floats (data dependent)
and about the same speed for integers.

- Instead of blindly trying to parse as Long, do a quick check
  for obvious problems (e.g. decimal point).
- Don't trim. It's already done by called methods.
- Use valueOf() instead of parse() to avoid object creation

* Add Java Microbenchmark Harness

The shaded JAR is missing the OpenRefine classes, for a reason
that I haven't figured out, so requires openrefine-main.jar at runtime.

* Remove old implementations of ToNumber

* Remove unneeded dependencies from main project

* Clean up and reformat
 2020-07-03 21:42:44 +02:00
Tom Morris
5d6af9cb6c
Merge pull request #2865 from tfmorris/2863-tree-column-ordering 
Remove shortest-column-name ordering - fixes #2863
 2020-07-03 15:23:36 -04:00
Tom Morris
f5786afa35
Increase test timeout - fixes #2875 (#2876) 2020-07-03 21:20:01 +02:00
Thad Guidry
49fd21759c
remove English sentence from French translation (#2871) 2020-07-03 16:12:43 +02:00
Tom Morris
139019f6e3
Internationalize clipboard default project name (#2814) 
Fixes #2776
 2020-07-03 14:22:44 +02:00
chetan
3932b23eb6 Fixed the guessing of JSON for .txt(2820) 2020-07-03 10:46:07 +05:30
Tom Morris
d3db73aa67 Remove shortest-column-name ordering 
Refs #2863
The tree importer sorts columns/column groups by how populated
they are, which is of arguable utility, but the tie-breaker
of ordering by shortest column name is completely silly.

This change removes that and, in conjunction with a stable sort
algorithm, will preserve the original order of the columns.
 2020-07-02 16:12:55 -04:00
Tom Morris
28a9f68236
Unit test improvements (#2856) 
* Fix two deprecated methods usages

* Test ToNumber conversions

* Test behavior of all functions when passed 0 or 8 arguments

There are 16 which fail currently on 0 args (return null or
False instead of EvalError), but have been whitelisted until
we can verify whether it's safe to change them without introducing
compatibility issues.

There are 19 which fail to return an error on too many (ie 8) args.
 2020-07-02 20:29:21 +02:00
Tom Morris
54291ef441
Use Apache IO Commons IOUtils instead of homerolled (#2845) 
Probably should remove the funky Gzip support with the
overloaded use of the encoding parameter, but this is
a start.
 2020-06-30 13:49:47 +02:00
Chetan Verma
e2a2dd2a4e
Fix misstatement about supported formats in import project screen (#2841) 
Closes #2753.
 2020-06-30 08:25:15 +02:00
Tom Morris
0f3a6006f3
Add Excel95 import test and improve other importer tests (#2844) 
No issue.
- we don't support Excel95, but make sure that it generates an exception
- move the test data file into the appropriate directory
- for any normal test, consider exceptions a failure
 2020-06-30 08:20:56 +02:00
Tom Morris
421974cc3d
Truncate any completely empty columns on the right (#2842) 
Fixes #565
The current versions of Open Office create default spreadsheets
with over 1000 empty columns. Keep track of the rightmost
non-empty column when importing and truncate everything else.

Also adds a basic ODS import test.
 2020-06-30 08:19:00 +02:00
Tom Morris
83f52d4ba5
Fall back to Apache Jena 3.9.0 (from 3.15.0) (#2826) 
Fixes #2824
Versions up through 3.14.0 appear to work, but since odfdom bundles
Jena 3.9.0, we're going to be conservative and match that.

As an added bonus, includes a blank node test which will trigger
the failure.
 2020-06-27 23:40:21 +02:00
Antoine Beaubien
043e595ea0
Change pref name for ui.browsing.pageSize (#2817) 
Change the preference key name ui.gridPaginationSize for ui.browsing.pageSize.
 2020-06-27 21:58:48 +02:00
Lisa Chandra
7b8f8486f6
Adds a default separator preference for split/join multi valued cells (#2520) 
* default value for split/join

* using the new preference interface

* changed preference name to ui.cell.rowSplitDefaultSeparator
 2020-06-25 14:35:53 +02:00
Tom Morris
cfa1038066
Remove commons-digester dependency (#2798) 2020-06-25 14:16:25 +02:00
Tom Morris
4b146acc6e
Create Project import improvements (#2806) 
* Fix charset encoding & MIME type handling

Character set (ie what we call "encoding") is part of the Content-Type,
*not* the Content-Encoding, which specifies compression (e.g. gzip).

This correctly sets the character set encoding as well as cleaning
the MIME type so that additional parsing doesn't need to be done
downstream (and removes that code).

* Use "text" instead of "text/line-based" as default fallback format

The TextLineBasedGuesser only tries a limited number of
formats (CSV, TSV, fixed), so we can't get out of that hole to
find JSON, XML, etc.

Start with a more general format instead to improve our
guessing odds.

* Support content type Structured Name Syntax Suffixes (+json +xml)

If we can't find a fully specified content type in our lookup,
fall back to just the suffix (which is registered with a leading +)
Fixes #2800 Fixes #2805
 2020-06-25 08:36:57 +02:00
Tom Morris
f9eb819b01
Merge pull request #2737 from OpenRefine/dependabot/maven/org.slf4j-slf4j-log4j12-1.7.30 
Bump slf4j-log4j12 from 1.7.18 to 1.7.30
 2020-06-24 16:00:22 -04:00
Hosted Weblate
07fbc70ada
Merge branch 'origin/master' into Weblate. 2020-06-24 21:41:53 +02:00
Isao Matsunami
1b30d61b2f
Translated using Weblate (Japanese) 
Currently translated at 100.0% (753 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
 2020-06-24 21:41:46 +02:00
Adolfo Jayme Barrientos
cf388fc5f4
Translated using Weblate (Spanish) 
Currently translated at 99.4% (749 of 753 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/es/
 2020-06-24 21:41:46 +02:00
Tom Morris
76d30ee1f0
Merge pull request #2794 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.2.0 
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
 2020-06-23 17:08:40 -04:00
Tom Morris
1849e62234
Better error handling for reconciliation process - fixes #2590 (#2671) 
* Harden reconciliation - Fixes #2590

- check for non-JSON / unparseable JSON returns
- handle malformed results response with no name for candidates
- catch any Exception, not just IOExceptions
- call processManager.onFailedProcess() for cleanup on error

* Add default constructor for Jackson

Jackson complains about needing a default constructor for the
NON_DEFAULT annotation, but I'm not sure why this worked before.

* Clean up indentation and unused variable - no functional changes

Make indentation consistent throughout the module, changing recently
added lines to use the standard all spaces convention.

Remove unused count variable

* Simplify control flow

* Update limit parameter comment. No functional change.

* Replace ternary expression which is causing NPE

* Add reconciliation tests using mock HTTP server
 2020-06-23 21:54:54 +02:00
dependabot-preview[bot]
408b782117
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0 
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-3.1.0...build-helper-maven-plugin-3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-06-23 08:45:07 +00:00
Tom Morris
0bfa3dd68a
Merge pull request #2745 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.1.0 
Bump build-helper-maven-plugin from 1.8 to 3.1.0
 2020-06-22 13:06:02 -04:00
Tom Morris
bf57667a47
Merge pull request #2789 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-resources-plugin-3.1.0 
Bump maven-resources-plugin from 2.6 to 3.1.0
 2020-06-22 12:48:59 -04:00