Go to file
Tom Morris 3aa610d6aa
Improve Google Sheets upload (#2784)
* Support more than 26 columns

Google Sheets default to just 26 columns (A-Z) and we need to
explicitly add more columns if we need them.

Fixes #2760

* Improve Google Sheets upload

- upload in chunks instead of serializing the entire document at once
- Free up resources as we go
- stop if an error occurs
- reduce batch size to try and stay in 10MB request size limit
  (but need a more dynamic way to do this probably for very wide
   sheets or sheets with large values)

* Add basic test and do some cleanup

- add test for columns > 26
- refactor to allow testing and not depend on unnecessary fields
- add i18n TODO for translating spreadsheet description

* Preserve cell data types

Fixes #2785
- integers and floats are sent as Doubles
- bools as Boolean
- DateTimes as Strings
- nulls as the empty string
- anything else as Strings using .toString()

* Fix LGTM-flagged potentially null pointer dereference
2020-06-25 08:18:28 +02:00
.github Add new option for deleting tags associated to releases 2020-06-20 12:25:45 -05:00
conf Issue 630: Change branding from Google Refine to OpenRefine 2012-10-18 19:40:31 -04:00
docs Bump websocket-extensions from 0.1.3 to 0.1.4 in /docs (#2682) 2020-06-06 10:13:02 +01:00
extensions Improve Google Sheets upload (#2784) 2020-06-25 08:18:28 +02:00
graphics Update logo for README.md 2018-02-09 22:38:44 +08:00
IDEs/eclipse Cleanup most Eclipse config files 2018-09-18 14:51:27 +01:00
licenses Remove JSON license. OpenRefine can now be used for Evil. 2018-11-30 19:38:52 +09:00
main Merge pull request #2737 from OpenRefine/dependabot/maven/org.slf4j-slf4j-log4j12-1.7.30 2020-06-24 16:00:22 -04:00
packaging Bump plexus-archiver from 4.0.0 to 4.2.2 (#2736) 2020-06-25 08:03:48 +02:00
server Merge pull request #2737 from OpenRefine/dependabot/maven/org.slf4j-slf4j-log4j12-1.7.30 2020-06-24 16:00:22 -04:00
.gitattributes fix the launch4j issue 2018-07-16 19:36:59 -04:00
.gitignore Add .metadata to ignore Eclipse plugins meta 2020-04-16 09:08:12 -05:00
.travis.yml Remove obsolete comment 2020-06-17 16:13:19 -04:00
appveyor.yml Attempt to fix surefire on Appveyor 2019-08-28 10:08:22 +01:00
AUTHORS.md Update AUTHORS.md 2018-11-19 20:22:00 -05:00
CHANGES.txt Fix some typos in documentation 2019-04-02 17:38:47 +02:00
CODE_OF_CONDUCT.md Rename code of conduct to match GitHub's guidelines 2019-07-27 15:35:29 +01:00
CONTRIBUTING.md Fix grammer and links 2020-03-05 08:26:26 -06:00
GOVERNANCE.md Fix some typos in documentation 2019-04-02 17:38:47 +02:00
lgtm.yml Merge .lgtm.yml and lgtm.yml 2020-06-20 21:16:35 -04:00
LICENSE.txt Update LICENSE.txt 2018-02-24 15:24:45 -05:00
pom.xml Merge pull request #2737 from OpenRefine/dependabot/maven/org.slf4j-slf4j-log4j12-1.7.30 2020-06-24 16:00:22 -04:00
README.md Fix Coveralls badge 2020-06-20 15:13:03 -04:00
refine Remove obsolete Google API key reference (#2809) 2020-06-25 07:57:04 +02:00
refine.bat support refine-dev.ini for development (#2497) 2020-04-06 10:53:49 +02:00
refine.ini support refine-dev.ini for development (#2497) 2020-04-06 10:53:49 +02:00
settings.xml Windows package with embedded JRE (#2486) 2020-04-11 11:10:04 +02:00
start.sh Revert "data package metadata (#1398)" 2018-11-30 19:35:31 +09:00
stop.sh Revert "data package metadata (#1398)" 2018-11-30 19:35:31 +09:00
WeLoveOurBackers.md renaming for Google News Initiative as backer 2018-05-10 09:05:07 -05:00

OpenRefine

Join the chat at https://gitter.im/OpenRefine/OpenRefine Build Status Coverage Status Translation progress Total alerts

OpenRefine is a Java-based power tool that allows you to load data, understand it, clean it up, reconcile it, and augment it with data coming from the web. All from a web browser and the comfort and privacy of your own computer.

Download

Run from source

If you have cloned this repository to your computer, you can run OpenRefine with:

  • ./refine on Mac OS and Linux
  • refine.bat on Windows

This requires JDK 8 and Apache Maven.

Documentation and Videos

Contributing to the project

Contact us

OpenRefine is open source software and is licensed under the BSD license located in the LICENSE.txt. See the folder licenses for information on open source libraries that OpenRefine depends on.

Credits

This software was created by Metaweb Technologies, Inc. and originally written and conceived by David Huynh dfhuynh@google.com. Metaweb Technologies, Inc. was acquired by Google, Inc. in July 2010 and the product was renamed Google Refine. In October 2012, it was renamed OpenRefine as it transitioned to a community-supported product.

See AUTHORS.md for the list of OpenRefine contributors and CONTRIBUTING.md for instructions on how to contribute yourself.