s434730/RandomSec
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
5,192 Commits 6 Branches 0 Tags 1.3 GiB
6eea757534
Commit Graph

232 Commits

Author SHA1 Message Date
Tom Morris
83ed9ffdaf
Refactor importer APIs - Fixes #2963 (#2978) 
* Make sure data directory is directory, not a file

* Add a test for zip archive import

Also tests the saving of the archive file name and source filename

* Add TODOs - no functional changes

* Cosmetic cleanups

* Revert importer API changes for archive file name parameter

Fixes #2963
- restore binary compatibility to the API
- hoist the handling of both fileSource and archiveFileName from
TabularImportingParserBase and TreeImportingParserBase to
ImportingParserBase so that there's only one copy. These 3 classes are
all part of the internal implementation, so there should be no
compatibility issue.

* Revert weird flow of control for import options metadata

This reverts the very convoluted control flow that was introduced
when adding the input options to the project metadata. Instead
the metadata is all handled in the importer framework rather than
having to change APIs are have individual importers worry about
it.

The feature never had test coverage, so that is still to be added.

* Add test for import options in project metadata & fix bug

Fixes bug where same options object was being reused and overwritten,
so all copies in the list ended up the same.
 2020-07-23 18:36:14 +02:00
Tom Morris
c22078b2c9
Merge pull request #2953 from OpenRefine/dependabot/maven/com.google.apis-google-api-services-sheets-v4-rev20200707-1.30.10 
Bump google-api-services-sheets from v4-rev20200616-1.30.10 to v4-rev20200707-1.30.10
 2020-07-22 16:11:41 -04:00
dependabot-preview[bot]
fa682d0e22
Bump mockito-core from 3.4.2 to 3.4.4 (#2965) 
Bumps [mockito-core](https://github.com/mockito/mockito) from 3.4.2 to 3.4.4.
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](https://github.com/mockito/mockito/compare/v3.4.2...v3.4.4)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-07-20 14:48:41 +02:00
dependabot-preview[bot]
11600bf4cf
Bump google-api-services-sheets 
Bumps google-api-services-sheets from v4-rev20200616-1.30.10 to v4-rev20200707-1.30.10.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-17 08:18:12 +00:00
dependabot-preview[bot]
edf8595977
Bump mockito-core from 3.3.3 to 3.4.2 
Bumps [mockito-core](https://github.com/mockito/mockito) from 3.3.3 to 3.4.2.
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](https://github.com/mockito/mockito/compare/v3.3.3...v3.4.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-17 08:17:43 +00:00
Tom Morris
aef1716d6a
Merge pull request #2926 from OpenRefine/dependabot/maven/com.google.apis-google-api-services-drive-v3-rev20200618-1.30.10 
Bump google-api-services-drive from v3-rev20200618-1.30.9 to v3-rev20200618-1.30.10
 2020-07-13 12:50:04 -04:00
dependabot-preview[bot]
498325ded9
Bump google-api-services-sheets 
Bumps google-api-services-sheets from v4-rev20200616-1.30.9 to v4-rev20200616-1.30.10.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-13 08:39:42 +00:00
dependabot-preview[bot]
940c508584
Bump google-api-services-drive 
Bumps google-api-services-drive from v3-rev20200618-1.30.9 to v3-rev20200618-1.30.10.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-13 08:38:36 +00:00
dependabot-preview[bot]
a0a889688b
Bump google-api-services-drive (#2911) 
Bumps google-api-services-drive from v3-rev20200609-1.30.9 to v3-rev20200618-1.30.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-07-09 10:29:00 +02:00
Tom Morris
a88aeca304
Merge pull request #2854 from OpenRefine/dependabot/maven/com.google.apis-google-api-services-sheets-v4-rev20200616-1.30.9 
Bump google-api-services-sheets from v4-rev20200508-1.30.9 to v4-rev20200616-1.30.9
 2020-07-03 15:27:21 -04:00
Tom Morris
de2c2aa778
Correct mimetype for Google Drive project exports (#2829) 
Fixes #2797. Changes mimetype from zip to gzip
and adds .tar.gz extension to the name.
 2020-07-03 14:24:25 +02:00
dependabot-preview[bot]
cd0d4bdda9
Bump google-api-services-sheets 
Bumps google-api-services-sheets from v4-rev20200508-1.30.9 to v4-rev20200616-1.30.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-07-01 08:26:36 +00:00
Tom Morris
bc540a880e
Fix update to deprecated Google Drive credential code (#2828) 
No issue. Restore missing piece of commit 42354c0 so that Builder
has the method parameter that it needs.
 2020-06-28 23:07:06 +02:00
Tom Morris
3aa610d6aa
Improve Google Sheets upload (#2784) 
* Support more than 26 columns

Google Sheets default to just 26 columns (A-Z) and we need to
explicitly add more columns if we need them.

Fixes #2760

* Improve Google Sheets upload

- upload in chunks instead of serializing the entire document at once
- Free up resources as we go
- stop if an error occurs
- reduce batch size to try and stay in 10MB request size limit
  (but need a more dynamic way to do this probably for very wide
   sheets or sheets with large values)

* Add basic test and do some cleanup

- add test for columns > 26
- refactor to allow testing and not depend on unnecessary fields
- add i18n TODO for translating spreadsheet description

* Preserve cell data types

Fixes #2785
- integers and floats are sent as Doubles
- bools as Boolean
- DateTimes as Strings
- nulls as the empty string
- anything else as Strings using .toString()

* Fix LGTM-flagged potentially null pointer dereference
 2020-06-25 08:18:28 +02:00
dependabot-preview[bot]
3c4712fb43
Bump google-api-services-drive 
Bumps google-api-services-drive from v3-rev20200413-1.30.9 to v3-rev20200609-1.30.9.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-06-25 03:08:30 +00:00
Tom Morris
76d30ee1f0
Merge pull request #2794 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.2.0 
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0
 2020-06-23 17:08:40 -04:00
Tom Morris
d97d6c66b8
Update Google API dependencies for GData extension (#2754) 
* Update Google API dependencies for Sheets & Drive

Remove unnecessary direct dependencies which are transitive
dependencies of those.

* Fix use of deprecated class
 2020-06-23 21:55:46 +02:00
dependabot-preview[bot]
408b782117
Bump build-helper-maven-plugin from 3.1.0 to 3.2.0 
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 3.1.0 to 3.2.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-3.1.0...build-helper-maven-plugin-3.2.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-06-23 08:45:07 +00:00
Tom Morris
0bfa3dd68a
Merge pull request #2745 from OpenRefine/dependabot/maven/org.codehaus.mojo-build-helper-maven-plugin-3.1.0 
Bump build-helper-maven-plugin from 1.8 to 3.1.0
 2020-06-22 13:06:02 -04:00
Tom Morris
6b00c7b602
Merge pull request #2782 from tfmorris/2306-gdata-empty-cells 
Fix Google Sheets export with empty cells
 2020-06-22 13:01:23 -04:00
Tom Morris
bf57667a47
Merge pull request #2789 from OpenRefine/dependabot/maven/org.apache.maven.plugins-maven-resources-plugin-3.1.0 
Bump maven-resources-plugin from 2.6 to 3.1.0
 2020-06-22 12:48:59 -04:00
Adolfo Jayme Barrientos
c43214203b
Translated using Weblate (Spanish) 
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/es/
 2020-06-22 12:22:57 +02:00
Adolfo Jayme Barrientos
644e3b6499
Added translation using Weblate (Spanish) 2020-06-22 12:03:46 +02:00
dependabot-preview[bot]
a8ae5d37ed
Bump maven-resources-plugin from 2.6 to 3.1.0 
Bumps [maven-resources-plugin](https://github.com/apache/maven-resources-plugin) from 2.6 to 3.1.0.
- [Release notes](https://github.com/apache/maven-resources-plugin/releases)
- [Commits](https://github.com/apache/maven-resources-plugin/compare/maven-resources-plugin-2.6...maven-resources-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-06-22 08:45:55 +00:00
Tom Morris
9b8e750550 Don't skip empty cells on export 
Make sure we output at least an empty string as a placeholder.
Fixes #2306
 2020-06-21 23:16:46 -04:00
Tom Morris
7a1451f561 Report errors to user 
No errors were being reported before.
Also add TODO for progress indicator on long uploads
 2020-06-21 23:09:47 -04:00
dependabot-preview[bot]
b53d738df8
Bump build-helper-maven-plugin from 1.8 to 3.1.0 
Bumps [build-helper-maven-plugin](https://github.com/mojohaus/build-helper-maven-plugin) from 1.8 to 3.1.0.
- [Release notes](https://github.com/mojohaus/build-helper-maven-plugin/releases)
- [Commits](https://github.com/mojohaus/build-helper-maven-plugin/compare/build-helper-maven-plugin-1.8...build-helper-maven-plugin-3.1.0)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-06-17 08:26:08 +00:00
james-cui
04055153a1
add archive column (#2573) 
Co-authored-by: Antonin Delpeuch <antonin@delpeuch.eu>
 2020-06-15 19:56:00 +02:00
dependabot-preview[bot]
4e9d365fcd
Bump maven-compiler-plugin from 3.1 to 3.8.1 (#2728) 
Bumps [maven-compiler-plugin](https://github.com/apache/maven-compiler-plugin) from 3.1 to 3.8.1.
- [Release notes](https://github.com/apache/maven-compiler-plugin/releases)
- [Commits](https://github.com/apache/maven-compiler-plugin/compare/maven-compiler-plugin-3.1...maven-compiler-plugin-3.8.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-06-15 11:20:38 +02:00
Antonin Delpeuch
683c00f535
Merge pull request #2718 from weblate/weblate-openrefine-translations 
Translations update from Weblate
 2020-06-14 10:19:21 +02:00
Tom Morris
3a7812aef7
Load GDrive icon from local resource, not Github (#2689) 
Fixes #2688.
 2020-06-14 09:46:38 +02:00
Biswaranjan Manna
2946e6135c
Added translation using Weblate (Bengali (India)) 2020-06-14 09:21:31 +02:00
Rafael Fontenelle
b8c93832a7
Translated using Weblate (Portuguese (Brazil)) 
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/pt_BR/
 2020-06-13 21:41:47 +02:00
Hosted Weblate
4a2f3c2b82
Merge branch 'origin/master' into Weblate. 2020-06-12 18:55:36 +02:00
Rafael Fontenelle
fbb3836916
Added translation using Weblate (Portuguese (Brazil)) 2020-06-12 18:55:33 +02:00
dependabot-preview[bot]
2c490e101c
Bump httpclient from 4.5.5 to 4.5.12 
Bumps httpclient from 4.5.5 to 4.5.12.

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-06-11 08:22:37 +00:00
dependabot-preview[bot]
56bbb073cd
Bump testng from 6.9.10 to 7.1.0 
Bumps [testng](https://github.com/cbeust/testng) from 6.9.10 to 7.1.0.
- [Release notes](https://github.com/cbeust/testng/releases)
- [Changelog](https://github.com/cbeust/testng/blob/master/CHANGES.txt)
- [Commits](https://github.com/cbeust/testng/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-06-03 08:49:47 +00:00
dependabot-preview[bot]
88ab328e93
Bump mockito-core from 2.23.4 to 3.3.3 (#2662) 
Bumps [mockito-core](https://github.com/mockito/mockito) from 2.23.4 to 3.3.3.
- [Release notes](https://github.com/mockito/mockito/releases)
- [Commits](https://github.com/mockito/mockito/compare/v2.23.4...v3.3.3)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-06-03 07:01:22 +01:00
dependabot-preview[bot]
7058f39aee
Bump maven-dependency-plugin from 3.1.1 to 3.1.2 (#2651) 
Bumps [maven-dependency-plugin](https://github.com/apache/maven-dependency-plugin) from 3.1.1 to 3.1.2.
- [Release notes](https://github.com/apache/maven-dependency-plugin/releases)
- [Commits](https://github.com/apache/maven-dependency-plugin/compare/maven-dependency-plugin-3.1.1...maven-dependency-plugin-3.1.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
 2020-05-30 10:49:21 +01:00
Tom Morris
f478356e17
Restore copyrights (#2633) 
* Restore copyrights deleted in c758a6b635

* Update copyright notices
 2020-05-22 06:01:15 +02:00
Weblate (bot)
1694400fea
Minor Japanese translation updates from Weblate (#2621) 
* Translated using Weblate (Japanese)

Currently translated at 100.0% (740 of 740 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (171 of 171 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ja/

* Translated using Weblate (Japanese)

Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/

Co-authored-by: Isao Matsunami <isao.matsunami@gmail.com>
 2020-05-21 18:18:06 -04:00
Antonin Delpeuch
d7d567439e Set version to 3.5-SNAPSHOT 2020-05-13 22:56:33 +02:00
Antonin Delpeuch
5597e1c942 Set version to 3.4-beta 2020-05-13 22:52:25 +02:00
Luca Martinelli
a3b22a1884
Translated using Weblate (Italian) 
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/it/
 2020-04-29 06:59:20 +02:00
Thad Guidry
009c587437
remove unused imports (#2574) 2020-04-21 15:51:01 +02:00
Jeannette L
d5e3e87ef7
Translated using Weblate (French) 
Currently translated at 97.8% (46 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/fr/
 2020-04-18 09:45:38 +02:00
Isao Matsunami
b4710c19d5
Translated using Weblate (Japanese) 
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/
 2020-04-14 11:11:40 +02:00
Allan Nordhøy
45a98c73d2
Translated using Weblate (Norwegian Bokmål) 
Currently translated at 82.9% (39 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/nb_NO/
 2020-03-27 23:29:10 +01:00
Allan Nordhøy
56f4a1914a
Translated using Weblate (English) 
Currently translated at 100.0% (47 of 47 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/en/
 2020-03-27 23:29:09 +01:00
Agha Saad Fraz
cff88e6267
Added google sheet feature and moved features to the export drop-down (#2458) 
* fixed minor typos

* Added google sheet feature and moved features to the export drop-down menu

* minor change

* removed redundant text and moved code and translations into their respective extensions
 2020-03-23 11:14:02 +01:00