Commit Graph

922 Commits

Author SHA1 Message Date
Tom Morris
b64cbfea4f
Fix i18n. Fixes #2805 (#2847)
Fix database extensions exporter which is corrupting the dictionary
name with the value of the language.
2020-06-30 08:22:12 +02:00
Ekta Mishra
bc672047f6
Implemented DistinctValueScrutinizer tests using mockito (#2833)
* Implemented DistinctValueScrutinizer tests using mcokito

Added inner class to the scrutinizer and updated the tests using mocks.

* Tests updated-testNoIssue added

* all tests updated & working fine
2020-06-29 16:00:37 +02:00
Ekta Mishra
46c510b5e2
Implemented SingleValue Scrutinizer tests using mocks (#2818)
* Implemented SingleValue Scrutinizer tests using mocks

Updated test class & added inner class to the scrutinizer

* tests updated

* Updated SingleValueConstraint class
2020-06-29 15:59:53 +02:00
Ekta Mishra
f32f6a6ea2
Change return type of getConstraintsByType method (#2838)
changed the return type of getConstraintsByTpye method from Stream<Statement> to List<Statement>
2020-06-29 08:43:38 +02:00
Tom Morris
bc540a880e
Fix update to deprecated Google Drive credential code (#2828)
No issue. Restore missing piece of commit 42354c0 so that Builder
has the method parameter that it needs.
2020-06-28 23:07:06 +02:00
Ekta Mishra
1b04927d12
Add constraint class (#2822)
* Add constraint class

* Add constraint class

* updated names
2020-06-28 10:20:18 +02:00
Ekta Mishra
7ac41b4609
Implemented ConflictsWithScrutinizer tests using Mockito (#2804)
updated test class by creating mocks for ConstraintFetcher

Implemented tests for conflicts-with scrutinizer using mocks

Added testcase for no statementList & multiple constraint.

Implemented tests using mock for conflicts-with scrutinizer

Implemented tests using mock for conflicts-with scrutinizer

Added test case for multiple constraints

Added test case for multiple constraints
2020-06-27 17:17:20 +02:00
Ekta Mishra
8c1d8cdcb7
New implementation for Multivalue Scrutinizer (#2807)
Created inner class for Multivalue & mocks for unit tests

New implementation for multivalue scrutinizer

tests updated
2020-06-26 10:14:34 +02:00
Tom Morris
3aa610d6aa
Improve Google Sheets upload (#2784)
* Support more than 26 columns

Google Sheets default to just 26 columns (A-Z) and we need to
explicitly add more columns if we need them.

Fixes #2760

* Improve Google Sheets upload

- upload in chunks instead of serializing the entire document at once
- Free up resources as we go
- stop if an error occurs
- reduce batch size to try and stay in 10MB request size limit
  (but need a more dynamic way to do this probably for very wide
   sheets or sheets with large values)

* Add basic test and do some cleanup

- add test for columns > 26
- refactor to allow testing and not depend on unnecessary fields
- add i18n TODO for translating spreadsheet description

* Preserve cell data types

Fixes #2785
- integers and floats are sent as Doubles
- bools as Boolean
- DateTimes as Strings
- nulls as the empty string
- anything else as Strings using .toString()

* Fix LGTM-flagged potentially null pointer dereference
2020-06-25 08:18:28 +02:00
dependabot-preview[bot]
3c4712fb43
Bump google-api-services-drive
Bumps google-api-services-drive from v3-rev20200413-1.30.9 to v3-rev20200609-1.30.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-25 03:08:30 +00:00
Hosted Weblate
07fbc70ada
Merge branch 'origin/master' into Weblate. 2020-06-24 21:41:53 +02:00
Adolfo Jayme Barrientos
b581721ede
Translated using Weblate (Spanish)
Currently translated at 94.3% (182 of 193 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/es/
2020-06-24 21:41:50 +02:00
dependabot-preview[bot]
55171a85eb
Bump mariadb-java-client from 2.6.0 to 2.6.1 (#2801)
Bumps [mariadb-java-client](https://github.com/mariadb-corporation/mariadb-connector-j) from 2.6.0 to 2.6.1.
- [Release notes](https://github.com/mariadb-corporation/mariadb-connector-j/releases)
- [Changelog](https://github.com/mariadb-corporation/mariadb-connector-j/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mariadb-corporation/mariadb-connector-j/compare/2.6.0...2.6.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-24 11:59:48 +02:00
Tom Morris
76d30ee1f0
Merge pull request #2794 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.2.0
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
2020-06-23 17:08:40 -04:00
Tom Morris
d97d6c66b8
Update Google API dependencies for GData extension (#2754)
* Update Google API dependencies for Sheets & Drive

Remove unnecessary direct dependencies which are transitive
dependencies of those.

* Fix use of deprecated class
2020-06-23 21:55:46 +02:00
dependabot-preview[bot]
408b782117
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-3.1.0...build-helper-maven-plugin-3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-23 08:45:07 +00:00
Tom Morris
0bfa3dd68a
Merge pull request #2745 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.1.0
Bump build-helper-maven-plugin from 1.8 to 3.1.0
2020-06-22 13:06:02 -04:00
Tom Morris
6b00c7b602
Merge pull request #2782 from tfmorris/2306-gdata-empty-cells
Fix Google Sheets export with empty cells
2020-06-22 13:01:23 -04:00
Tom Morris
bf57667a47
Merge pull request #2789 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-resources-plugin-3.1.0
Bump maven-resources-plugin from 2.6 to 3.1.0
2020-06-22 12:48:59 -04:00
Tom Morris
445395d18d
Merge pull request #2788 from OpenRefine/dependabot/maven/org.xerial-sqlite-jdbc-3.32.3
Bump sqlite-jdbc from 3.31.1 to 3.32.3
2020-06-22 12:36:31 -04:00
Adolfo Jayme Barrientos
c43214203b
Translated using Weblate (Spanish)
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/es/
2020-06-22 12:22:57 +02:00
Adolfo Jayme Barrientos
b94be34b73
Added translation using Weblate (Spanish) 2020-06-22 12:22:54 +02:00
Adolfo Jayme Barrientos
644e3b6499
Added translation using Weblate (Spanish) 2020-06-22 12:03:46 +02:00
dependabot-preview[bot]
a8ae5d37ed
Bump maven-resources-plugin from 2.6 to 3.1.0
Bumps [maven-resources-plugin](https://github.com/apache/maven-resources-plugin) from 2.6 to 3.1.0.
- [Release notes](https://github.com/apache/maven-resources-plugin/releases)
- [Commits](https://github.com/apache/maven-resources-plugin/compare/maven-resources-plugin-2.6...maven-resources-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-22 08:45:55 +00:00
dependabot-preview[bot]
71028eb7ab
Bump sqlite-jdbc from 3.31.1 to 3.32.3
Bumps [sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.31.1 to 3.32.3.
- [Release notes](https://github.com/xerial/sqlite-jdbc/releases)
- [Changelog](https://github.com/xerial/sqlite-jdbc/blob/master/CHANGELOG)
- [Commits](https://github.com/xerial/sqlite-jdbc/compare/3.31.1...3.32.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-22 08:45:54 +00:00
Tom Morris
9b8e750550 Don't skip empty cells on export
Make sure we output at least an empty string as a placeholder.
Fixes #2306
2020-06-21 23:16:46 -04:00
Tom Morris
7a1451f561 Report errors to user
No errors were being reported before.
Also add TODO for progress indicator on long uploads
2020-06-21 23:09:47 -04:00
Isao Matsunami
8451e97fc8
Translated using Weblate (Japanese)
Currently translated at 100.0% (193 of 193 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ja/
2020-06-21 21:41:48 +02:00
Tom Morris
b59228185e
Merge pull request #2756 from OpenRefine/wikidata-extension-oauth
Wikidata extension two-legged OAuth support
2020-06-19 12:49:52 -04:00
Ekta Mishra
45fab05bf6
New implementation for Conflicts-With Scrutinizer (#2693)
part of #2354
2020-06-19 10:18:21 +02:00
afkbrb
ffd92663d7 delete outdated comment 2020-06-19 15:09:23 +08:00
afkbrb
7b237b4d83 call setSecure explicitly & fix HTTP response splitting 2020-06-19 14:38:35 +08:00
Antonin Delpeuch
4fb0ac8082 Fix bad conflict resolution from rebase 2020-06-19 00:06:22 -04:00
afkbrb
cdb02004fd improve frontend 2020-06-18 23:51:22 -04:00
Lu Liu
335e81a26c OAuth support for the Wikidata extension (#2661)
Closes #1612 

Merges @afkbrb work to finish @wetneb protype, including:
* adding support for OAuth in addition to basic auth
* supporting registration of single user Wikidata OAuth consumers.
* adding extensive tests
* cleaning up the login dialog

This depends on the next release of the Wikidata Toolkit, but we're currently publishing our own snapshot that includes the necessary changes (thanks @wetneb!)

Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
2020-06-18 23:51:22 -04:00
Tom Morris
f88c0e3657
Preserve international characters in project/file names on import/export (#2720)
* Preserve international characters on import/export

Fixes #1352. Preserve non-ASCII characters in project names on
project creation and filenames on export.

Uses existing filename cleaner with the addition of a few
more characters from StackOverflow, plus "#" which messes
up the download URL. Also URIencode download URL.

Removes unused I18N-incompatible cleaning function from
Wikidata extension rather than fixing it.

* Use common name cleaner function

Also preview cleaned table name instead of raw name, so user can see it.
Also add a TODO for better preview of column names
2020-06-18 22:06:46 +02:00
dependabot-preview[bot]
6ff800fa76
Bump postgresql from 42.1.4 to 42.2.14 (#2744)
Bumps [postgresql](https://github.com/pgjdbc/pgjdbc) from 42.1.4 to 42.2.14.
- [Release notes](https://github.com/pgjdbc/pgjdbc/releases)
- [Changelog](https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md)
- [Commits](https://github.com/pgjdbc/pgjdbc/compare/REL42.1.4...REL42.2.14)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-17 12:10:41 +02:00
dependabot-preview[bot]
b53d738df8
Bump build-helper-maven-plugin from 1.8 to 3.1.0
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 1.8 to 3.1.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-1.8...build-helper-maven-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-17 08:26:08 +00:00
dependabot-preview[bot]
66c409aec6
Bump mysql-connector-java from 5.1.46 to 8.0.20 (#2726)
* Bump mysql-connector-java from 5.1.46 to 8.0.20

Bumps [mysql-connector-java](https://github.com/mysql/mysql-connector-j) from 5.1.46 to 8.0.20.
- [Release notes](https://github.com/mysql/mysql-connector-j/releases)
- [Changelog](https://github.com/mysql/mysql-connector-j/blob/release/8.0/CHANGES)
- [Commits](https://github.com/mysql/mysql-connector-j/compare/5.1.46...8.0.20)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Remove unneeded references to com.mysql.jdbc.ResultSetMetaData

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Tom Morris <tfmorris@gmail.com>
2020-06-16 15:05:20 +02:00
dependabot-preview[bot]
5be2cf0806
Bump sqlite-jdbc from 3.30.1 to 3.31.1 (#2739)
Bumps [sqlite-jdbc](https://github.com/xerial/sqlite-jdbc) from 3.30.1 to 3.31.1.
- [Release notes](https://github.com/xerial/sqlite-jdbc/releases)
- [Changelog](https://github.com/xerial/sqlite-jdbc/blob/master/CHANGELOG)
- [Commits](https://github.com/xerial/sqlite-jdbc/compare/3.30.1...3.31.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-16 11:43:59 +02:00
Tom Morris
b593306d1c
Merge pull request #2702 from OpenRefine/dependabot/maven/org.mariadb.jdbc-mariadb-java-client-2.6.0
Bump mariadb-java-client from 2.2.6 to 2.6.0
2020-06-15 17:18:31 -04:00
james-cui
04055153a1
add archive column (#2573)
Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
2020-06-15 19:56:00 +02:00
dependabot-preview[bot]
4e9d365fcd
Bump maven-compiler-plugin from 3.1 to 3.8.1 (#2728)
Bumps [maven-compiler-plugin](https://github.com/apache/maven-compiler-plugin) from 3.1 to 3.8.1.
- [Release notes](https://github.com/apache/maven-compiler-plugin/releases)
- [Commits](https://github.com/apache/maven-compiler-plugin/compare/maven-compiler-plugin-3.1...maven-compiler-plugin-3.8.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 11:20:38 +02:00
Antonin Delpeuch
683c00f535
Merge pull request #2718 from weblate/weblate-openrefine-translations
Translations update from Weblate
2020-06-14 10:19:21 +02:00
Tom Morris
3a7812aef7
Load GDrive icon from local resource, not Github (#2689)
Fixes #2688.
2020-06-14 09:46:38 +02:00
Hosted Weblate
a9f7a55793
Merge branch 'origin/master' into Weblate. 2020-06-14 09:21:33 +02:00
Isao Matsunami
451d6c76f1
Translated using Weblate (Japanese)
Currently translated at 100.0% (60 of 60 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/
2020-06-14 09:21:33 +02:00
Biswaranjan Manna
2946e6135c
Added translation using Weblate (Bengali (India)) 2020-06-14 09:21:31 +02:00
Tom Morris
7b41bbe0b0
Merge pull request #2708 from weblate/weblate-openrefine-translations
Translations update from Weblate
2020-06-13 23:07:04 -04:00
Tom Morris
cb65348c95
Merge pull request #2643 from OpenRefine/thadguidry-update-jython-version
Update to latest Jython version 2.7.2
2020-06-13 22:49:09 -04:00