Commit Graph

277 Commits

Author SHA1 Message Date
Tom Morris
aef1716d6a
Merge pull request #2926 from OpenRefine/dependabot/maven/com.google.apis-google-api-services-drive-v3-rev20200618-1.30.10
Bump google-api-services-drive from v3-rev20200618-1.30.9 to v3-rev20200618-1.30.10
2020-07-13 12:50:04 -04:00
dependabot-preview[bot]
498325ded9
Bump google-api-services-sheets
Bumps google-api-services-sheets from v4-rev20200616-1.30.9 to v4-rev20200616-1.30.10.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 08:39:42 +00:00
dependabot-preview[bot]
940c508584
Bump google-api-services-drive
Bumps google-api-services-drive from v3-rev20200618-1.30.9 to v3-rev20200618-1.30.10.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-13 08:38:36 +00:00
dependabot-preview[bot]
a0a889688b
Bump google-api-services-drive (#2911)
Bumps google-api-services-drive from v3-rev20200609-1.30.9 to v3-rev20200618-1.30.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-07-09 10:29:00 +02:00
Tom Morris
a88aeca304
Merge pull request #2854 from OpenRefine/dependabot/maven/com.google.apis-google-api-services-sheets-v4-rev20200616-1.30.9
Bump google-api-services-sheets from v4-rev20200508-1.30.9 to v4-rev20200616-1.30.9
2020-07-03 15:27:21 -04:00
Tom Morris
de2c2aa778
Correct mimetype for Google Drive project exports (#2829)
Fixes #2797. Changes mimetype from zip to gzip
and adds .tar.gz extension to the name.
2020-07-03 14:24:25 +02:00
dependabot-preview[bot]
cd0d4bdda9
Bump google-api-services-sheets
Bumps google-api-services-sheets from v4-rev20200508-1.30.9 to v4-rev20200616-1.30.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-07-01 08:26:36 +00:00
Tom Morris
bc540a880e
Fix update to deprecated Google Drive credential code (#2828)
No issue. Restore missing piece of commit 42354c0 so that Builder
has the method parameter that it needs.
2020-06-28 23:07:06 +02:00
Tom Morris
3aa610d6aa
Improve Google Sheets upload (#2784)
* Support more than 26 columns

Google Sheets default to just 26 columns (A-Z) and we need to
explicitly add more columns if we need them.

Fixes #2760

* Improve Google Sheets upload

- upload in chunks instead of serializing the entire document at once
- Free up resources as we go
- stop if an error occurs
- reduce batch size to try and stay in 10MB request size limit
  (but need a more dynamic way to do this probably for very wide
   sheets or sheets with large values)

* Add basic test and do some cleanup

- add test for columns > 26
- refactor to allow testing and not depend on unnecessary fields
- add i18n TODO for translating spreadsheet description

* Preserve cell data types

Fixes #2785
- integers and floats are sent as Doubles
- bools as Boolean
- DateTimes as Strings
- nulls as the empty string
- anything else as Strings using .toString()

* Fix LGTM-flagged potentially null pointer dereference
2020-06-25 08:18:28 +02:00
dependabot-preview[bot]
3c4712fb43
Bump google-api-services-drive
Bumps google-api-services-drive from v3-rev20200413-1.30.9 to v3-rev20200609-1.30.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-25 03:08:30 +00:00
Tom Morris
76d30ee1f0
Merge pull request #2794 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.2.0
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
2020-06-23 17:08:40 -04:00
Tom Morris
d97d6c66b8
Update Google API dependencies for GData extension (#2754)
* Update Google API dependencies for Sheets & Drive

Remove unnecessary direct dependencies which are transitive
dependencies of those.

* Fix use of deprecated class
2020-06-23 21:55:46 +02:00
dependabot-preview[bot]
408b782117
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-3.1.0...build-helper-maven-plugin-3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-23 08:45:07 +00:00
Tom Morris
0bfa3dd68a
Merge pull request #2745 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.1.0
Bump build-helper-maven-plugin from 1.8 to 3.1.0
2020-06-22 13:06:02 -04:00
Tom Morris
6b00c7b602
Merge pull request #2782 from tfmorris/2306-gdata-empty-cells
Fix Google Sheets export with empty cells
2020-06-22 13:01:23 -04:00
Tom Morris
bf57667a47
Merge pull request #2789 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-resources-plugin-3.1.0
Bump maven-resources-plugin from 2.6 to 3.1.0
2020-06-22 12:48:59 -04:00
Adolfo Jayme Barrientos
c43214203b
Translated using Weblate (Spanish)
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/es/
2020-06-22 12:22:57 +02:00
Adolfo Jayme Barrientos
644e3b6499
Added translation using Weblate (Spanish) 2020-06-22 12:03:46 +02:00
dependabot-preview[bot]
a8ae5d37ed
Bump maven-resources-plugin from 2.6 to 3.1.0
Bumps [maven-resources-plugin](https://github.com/apache/maven-resources-plugin) from 2.6 to 3.1.0.
- [Release notes](https://github.com/apache/maven-resources-plugin/releases)
- [Commits](https://github.com/apache/maven-resources-plugin/compare/maven-resources-plugin-2.6...maven-resources-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-22 08:45:55 +00:00
Tom Morris
9b8e750550 Don't skip empty cells on export
Make sure we output at least an empty string as a placeholder.
Fixes #2306
2020-06-21 23:16:46 -04:00
Tom Morris
7a1451f561 Report errors to user
No errors were being reported before.
Also add TODO for progress indicator on long uploads
2020-06-21 23:09:47 -04:00
dependabot-preview[bot]
b53d738df8
Bump build-helper-maven-plugin from 1.8 to 3.1.0
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 1.8 to 3.1.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-1.8...build-helper-maven-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-17 08:26:08 +00:00
james-cui
04055153a1
add archive column (#2573)
Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
2020-06-15 19:56:00 +02:00
dependabot-preview[bot]
4e9d365fcd
Bump maven-compiler-plugin from 3.1 to 3.8.1 (#2728)
Bumps [maven-compiler-plugin](https://github.com/apache/maven-compiler-plugin) from 3.1 to 3.8.1.
- [Release notes](https://github.com/apache/maven-compiler-plugin/releases)
- [Commits](https://github.com/apache/maven-compiler-plugin/compare/maven-compiler-plugin-3.1...maven-compiler-plugin-3.8.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-15 11:20:38 +02:00
Antonin Delpeuch
683c00f535
Merge pull request #2718 from weblate/weblate-openrefine-translations
Translations update from Weblate
2020-06-14 10:19:21 +02:00
Tom Morris
3a7812aef7
Load GDrive icon from local resource, not Github (#2689)
Fixes #2688.
2020-06-14 09:46:38 +02:00
Biswaranjan Manna
2946e6135c
Added translation using Weblate (Bengali (India)) 2020-06-14 09:21:31 +02:00
Rafael Fontenelle
b8c93832a7
Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/pt_BR/
2020-06-13 21:41:47 +02:00
Hosted Weblate
4a2f3c2b82
Merge branch 'origin/master' into Weblate. 2020-06-12 18:55:36 +02:00
Rafael Fontenelle
fbb3836916
Added translation using Weblate (Portuguese (Brazil)) 2020-06-12 18:55:33 +02:00
dependabot-preview[bot]
2c490e101c
Bump httpclient from 4.5.5 to 4.5.12
Bumps httpclient from 4.5.5 to 4.5.12.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-11 08:22:37 +00:00
dependabot-preview[bot]
56bbb073cd
Bump testng from 6.9.10 to 7.1.0
Bumps [testng](https://github.com/cbeust/testng) from 6.9.10 to 7.1.0.
- [Release notes](https://github.com/cbeust/testng/releases)
- [Changelog](https://github.com/cbeust/testng/blob/master/CHANGES.txt)
- [Commits](https://github.com/cbeust/testng/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-06-03 08:49:47 +00:00
dependabot-preview[bot]
88ab328e93
Bump mockito-core from 2.23.4 to 3.3.3 (#2662)
Bumps [mockito-core](https://github.com/mockito/mockito) from 2.23.4 to 3.3.3.
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](https://github.com/mockito/mockito/compare/v2.23.4...v3.3.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-06-03 07:01:22 +01:00
dependabot-preview[bot]
7058f39aee
Bump maven-dependency-plugin from 3.1.1 to 3.1.2 (#2651)
Bumps [maven-dependency-plugin](https://github.com/apache/maven-dependency-plugin) from 3.1.1 to 3.1.2.
- [Release notes](https://github.com/apache/maven-dependency-plugin/releases)
- [Commits](https://github.com/apache/maven-dependency-plugin/compare/maven-dependency-plugin-3.1.1...maven-dependency-plugin-3.1.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-30 10:49:21 +01:00
Tom Morris
f478356e17
Restore copyrights (#2633)
* Restore copyrights deleted in c758a6b635

* Update copyright notices
2020-05-22 06:01:15 +02:00
Weblate (bot)
1694400fea
Minor Japanese translation updates from Weblate (#2621)
* Translated using Weblate (Japanese)

Currently translated at 100.0% (740 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (171 of 171 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/

Co-authored-by: Isao Matsunami <isao.matsunami@gmail.com>
2020-05-21 18:18:06 -04:00
Antonin Delpeuch
d7d567439e Set version to 3.5-SNAPSHOT 2020-05-13 22:56:33 +02:00
Antonin Delpeuch
5597e1c942 Set version to 3.4-beta 2020-05-13 22:52:25 +02:00
Luca Martinelli
a3b22a1884
Translated using Weblate (Italian)
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/it/
2020-04-29 06:59:20 +02:00
Thad Guidry
009c587437
remove unused imports (#2574) 2020-04-21 15:51:01 +02:00
Jeannette L
d5e3e87ef7
Translated using Weblate (French)
Currently translated at 97.8% (46 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/fr/
2020-04-18 09:45:38 +02:00
Isao Matsunami
b4710c19d5
Translated using Weblate (Japanese)
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/
2020-04-14 11:11:40 +02:00
Allan Nordhøy
45a98c73d2
Translated using Weblate (Norwegian Bokmål)
Currently translated at 82.9% (39 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/nb_NO/
2020-03-27 23:29:10 +01:00
Allan Nordhøy
56f4a1914a
Translated using Weblate (English)
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/en/
2020-03-27 23:29:09 +01:00
Agha Saad Fraz
cff88e6267
Added google sheet feature and moved features to the export drop-down (#2458)
* fixed minor typos

* Added google sheet feature and moved features to the export drop-down menu

* minor change

* removed redundant text and moved code and translations into their respective extensions
2020-03-23 11:14:02 +01:00
Hosted Weblate
439b399ab4
Merge branch 'origin/master' into Weblate. 2020-03-17 13:36:39 +01:00
Bodhisattwa Mandal
204e436eab
Translated using Weblate (Bengali)
Currently translated at 13.6% (6 of 44 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/bn/
2020-03-17 13:36:37 +01:00
Bűn Tamás
9c911275f6
Fixed that can't select a different sheet #2307 (#2390) 2020-03-17 11:00:27 +00:00
Bodhisattwa Mandal
005e4958cc
Added translation using Weblate (Bengali) 2020-03-16 12:53:43 +01:00
Lu Liu
f476f01b37
support configurable credentials for gdata (#2392) 2020-03-12 10:41:04 +00:00
Lu Liu
4477fc15a5
fix Google Sheets importer when URL is missing a trailing slash (#2380) (#2382)
* fix #2380

* update test

* rename test method
2020-03-10 13:48:00 +00:00
Antonin Delpeuch
429f26c2ae Set version to 3.4-SNAPSHOT 2020-01-31 19:06:56 +01:00
Antonin Delpeuch
58b839b9c5 Set version to 3.3 2020-01-31 18:22:18 +01:00
Hosted Weblate
c5b1c434e7
Merge branch 'origin/master' into Weblate. 2020-01-10 18:21:31 +01:00
Luca Martinelli
488a7021ff
Translated using Weblate (Italian)
Currently translated at 100.0% (44 of 44 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/it/
2020-01-10 18:21:27 +01:00
Antonin Delpeuch
faece760f6 Set version to 3.3-SNAPSHOT 2020-01-08 20:56:51 +01:00
Hosted Weblate
69859f4b4a
Merge branch 'origin/master' into Weblate. 2020-01-07 12:21:25 +01:00
Isao Matsunami
685faa304d
Translated using Weblate (Japanese)
Currently translated at 100.0% (44 of 44 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/
2020-01-07 12:21:23 +01:00
Antonin Delpeuch
e62bb7ac0e Set version to 3.3-rc1 2020-01-06 13:30:39 +01:00
Antonin Delpeuch
a4c4a20767 Fix Google Sheets and Google Drive export 2020-01-04 15:56:24 +01:00
Antonin Delpeuch
6dc79d965d Use state to keep redirect URI constant 2019-12-31 10:21:07 +01:00
Antonin Delpeuch
fe5871bd51 Remove Fusion Tables support in gdata extension. Closes #2113. 2019-12-31 07:17:41 +01:00
Allan Nordhøy
b5a7d66ed8
Translated using Weblate (Norwegian Bokmål)
Currently translated at 17.8% (8 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/nb_NO/
2019-11-23 11:04:55 +01:00
Sam Reed
de0b9e17c9
Translated using Weblate (English (United Kingdom))
Currently translated at 8.9% (4 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/en_GB/
2019-11-23 11:04:54 +01:00
Allan Nordhøy
f671ad56c2
Added translation using Weblate (Norwegian Bokmål) 2019-11-22 16:02:10 +01:00
Sam Reed
e3907257f5
Added translation using Weblate (English (United Kingdom)) 2019-11-22 10:31:33 +01:00
Mattias Münster
6a04efdea9
Translated using Weblate (Swedish)
Currently translated at 100.0% (45 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/sv/
2019-10-22 19:53:12 +02:00
Antonin Delpeuch
aa228c43b2 Fix frontend for extensions for CSRF protections 2019-10-17 11:44:57 +01:00
Antonin Delpeuch
24feda600a CSRF protection for gdata extension 2019-10-17 09:54:53 +01:00
Antonin Delpeuch
28c2a6154e
Merge pull request #2181 from OpenRefine/update_jackson
Update Jackson to 2.9.10
2019-10-10 17:21:05 +01:00
Antonin Delpeuch
334147d611 Update Jackson to 2.9.10 2019-10-10 16:55:56 +01:00
Isao Matsunami
2ed94c55d0
Translated using Weblate (Japanese)
Currently translated at 100.0% (45 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/
2019-09-14 00:23:55 +02:00
Antonin Delpeuch
c35b2e154f
Merge pull request #2141 from OpenRefine/issue-1904-mock-data-extension-tests
Mock HTTP calls in data extension tests.
2019-09-12 10:41:47 +01:00
leela
d192cfe8ff
ellipsis, added 2019-09-06 12:59:47 +00:00
Antonin Delpeuch
6c128d6692 Attempt to fix surefire on Appveyor 2019-08-28 10:08:22 +01:00
Antonin Delpeuch
8ab7653e0b Set version to 3.3-SNAPSHOT 2019-07-26 15:52:00 +01:00
Antonin Delpeuch
e3417bff49 Set version to 3.2 2019-07-26 15:29:57 +01:00
Antonin Delpeuch
318696d56c Update Jackson to 2.9.9. Closes #2051. 2019-05-31 08:19:20 +01:00
Stefan Weil
ed04be1c96 extensions: Fix some typos in comments and message texts
All typos were found and fixed using codespell.

Signed-off-by: Stefan Weil <sw@weilnetz.de>
2019-04-02 17:38:47 +02:00
Antonin Delpeuch
af8608e897 Bump version to 3.2-SNAPSHOT 2019-03-01 11:17:28 +00:00
Antonin Delpeuch
2a92726294 Set version to 3.2-beta 2019-03-01 10:55:42 +00:00
Stefan Olsson
6859d9557b
Translated using Weblate (Swedish)
Currently translated at 100.0% (45 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/sv/
2019-02-04 20:57:25 +01:00
Stefan Olsson
3727dbe267
Added translation using Weblate (Swedish) 2019-02-04 20:11:41 +01:00
Antonin Delpeuch
5639f1b2f1
Merge pull request #1755 from OpenRefine/jackson-serialization
Jackson serialization
2018-12-01 23:56:50 +00:00
Myoung Seok Lee
5ff62760db
Translated using Weblate (Korean)
Currently translated at 100.0% (45 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ko/
2018-11-30 20:38:24 +01:00
Myoung Seok Lee
b9594ed768
Added translation using Weblate (Korean) 2018-11-30 17:31:40 +01:00
Flavio Pompermaier
6baf817f4b
Translated using Weblate (Italian)
Currently translated at 100.0% (45 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/it/
2018-11-30 17:08:50 +01:00
Antonin Delpeuch
1df2d15e6d Remove all references to org.json in gdata extension 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
5a4a79028f Revert "data package metadata (#1398)"
This reverts commit c4b0ff6bea.
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
5b153dcfba Migrate gdata extension importers to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
2873035ee2 Migrate TabularExporter to use JsonNode 2018-11-30 19:22:21 +09:00
Antonin Delpeuch
47d80002a8 Migrate GData extension out of JSONWriter 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
36765e7e62 Bump version to 3.2-SNAPSHOT 2018-11-29 11:59:30 +09:00
Antonin Delpeuch
b90e413b40 Set version to 3.1 2018-11-29 10:32:56 +09:00
Antonin Delpeuch
7dd4db1ca1 Fix i18n calls after migration 2018-11-28 23:22:38 +09:00
Antonin Delpeuch
6ac821c844 Migrate dictionary loading in extensions 2018-11-21 17:50:49 +00:00
Antonin Delpeuch
10931e1e4d Migrate js to new localization syntax 2018-11-21 17:30:00 +00:00
Antonin Delpeuch
375839bb22 Update translation files for new format 2018-11-21 15:25:58 +00:00
Antonin Delpeuch
9bf0bb2154 Merge JS i18n strings with slash 2018-11-21 15:24:57 +00:00
Antonin Delpeuch
a2dd6d97e4 Set version to 3.1-SNAPSHOT 2018-11-07 14:01:06 +00:00