Commit Graph

64 Commits

Author SHA1 Message Date
Antonin Delpeuch
2f19900e33 Multi-module maven setup without extensions 2018-09-07 11:27:28 +01:00
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Fadi Maali
0e21c0e594 correct classpath references and java version
- updated classpath references to existing versions of the libraries.
- Java version upgraded to 7 as some Java 7 specific features are used.
- corrected references to old project name (grefine-all) in the launch script
2017-07-18 22:15:46 +01:00
Felix Lohmeier
2557cc5419 bugfix for new option autosave period 2017-06-24 22:42:49 +02:00
Felix Lohmeier
e54199a6f1 added options for initial java heap space and autosave period 2017-06-22 12:27:55 +02:00
jackyq2015
c7aa25ccd3 fix the new line issue 2015-09-26 21:21:31 -04:00
jackyq2015
a0b6be1769 Revert "fix issue #873"
This reverts commit 17e54dce1e.
2015-09-26 21:20:38 -04:00
jackyq2015
17e54dce1e fix issue #873 2015-09-23 10:29:30 -04:00
Tom Morris
71b9c4f5fd Merge pull request #876 from Arcadelia/Apply-operations_Form-too-large
Added system property refine.max_form_content_size
2014-07-03 10:29:28 -04:00
zsxwing
c1685a05c9 Remove vi's swp file 2014-05-30 11:18:01 +08:00
Frank Wennerdahl
a8ccdd0739 Added system property refine.max_form_content_size
To allow configuring the maximum allowed form content size in Jetty.
2014-05-16 14:37:24 +02:00
Pablo Moyano
1a2d97e296 Proposed fix for #814 2014-01-26 02:10:45 -08:00
Tom Morris
d5873c5803 Rename data directory from Google/Refine to OpenRefine - closed #777 2013-08-15 15:28:43 -04:00
Tom Morris
9c04e189cc Improve startup logging to help debug browser window issues like #193
and
#773
2013-08-06 12:18:01 -04:00
Tom Morris
567da6aa9f Normalize line endings
Add .gitattributes & do one-time normalization of line endings
2013-03-23 18:46:20 -04:00
Tom Morris
91d67e2ddc Rename Eclipse project to OpenRefine
- change top level Eclipse project from grefine-all to OpenRefine as
part of #630 rebranding
2012-10-19 10:47:10 -04:00
Tom Morris
0bd2104a16 Issue 630: Change branding from Google Refine to OpenRefine
** The first native Github commit (ie not one converted from SVN **
Change Google Refine to OpenRefine or just Refine.  
Change icon filenames and add some placeholder icons
2012-10-18 19:40:31 -04:00
Tom Morris
dfef391f18 issue 361 - Run AWT headless when we are in headless mode
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2492 7d457c2a-affb-35e4-300a-418c747d4874
2012-04-20 23:09:45 +00:00
Tom Morris
5bde74275b Log JVM max heap size instead of just Refine property
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2322 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 20:21:28 +00:00
David Huynh
a88ccd2c32 Reduced amount of logging.
Suppressed logging for the GetProcessesCommand, which gets ping'ed often while there is a long running operation being executed (e.g., reconciling, fetching URLs).

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2228 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-01 18:26:45 +00:00
Tom Morris
bde63ff417 Last set of indentation cleanups - no functional changes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2211 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-18 17:46:36 +00:00
Tom Morris
31eaea385d Update formatter preferences to match settings in formatter XML file
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2197 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-11 19:18:12 +00:00
Tom Morris
da7347e7b1 Make sure all conditionals and loops are in blocks (too bug-prone otherwise)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2183 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 22:21:47 +00:00
Tom Morris
97a0f2a33e Organize imports. com.google.refine last in a section of its own. Everything alphabetical in its section.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2180 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 21:10:22 +00:00
Tom Morris
fda0360f5b Make tab size the standard value of 8 spaces.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2174 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 20:54:23 +00:00
Tom Morris
123614539d Add missing @Override annotations
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2171 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 19:30:23 +00:00
David Huynh
42ea00d382 Applied patch from http://groups.google.com/group/google-refine-dev/browse_thread/thread/33b8a952fab18f0a#
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2071 7d457c2a-affb-35e4-300a-418c747d4874
2011-05-25 21:54:05 +00:00
Tom Morris
9384d22d85 Add GData extension to the source path for debugging
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2005 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-14 22:23:05 +00:00
Tom Morris
1df3348b52 Include Freebase extension in launch config
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1995 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-03 16:34:11 +00:00
Tom Morris
6a01c345ad Quote paths so they work when there are spaces in them
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1993 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-03 02:57:10 +00:00
David Huynh
d5a742944e Set python.path properly from within the jython extension
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1920 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-21 03:05:28 +00:00
David Huynh
5a17acfd70 Prepended license text to java source
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1613 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-20 20:45:52 +00:00
Tom Morris
7dcd0c073d Revert bad commit r1600
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1601 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 05:19:05 +00:00
Tom Morris
79c00bab36 Incomplete - task 157: Integrate Google Spreadsheet import/export plugin
http://code.google.com/p/google-refine/issues/detail?id=157

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1600 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 04:59:39 +00:00
Tom Morris
987fcacbee Missed this commit - Complete - task 141: Gridworks workspace directory not migrated to new Refine location on Windows or Linux
http://code.google.com/p/google-refine/issues/detail?id=141

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1493 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-13 22:38:37 +00:00
Stefano Mazzocchi
2ba485104f since I can't seem to find a way to preserve that damn space, I'm moving the name in the java source code which does the same thing
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1458 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-08 23:39:45 +00:00
Tom Morris
4c3cdabad2 Add a launch config with some extensions included as a model to follow
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1417 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-30 23:39:17 +00:00
Tom Morris
9c6097a065 Fix working directory reference to match project name
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1371 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-28 03:49:11 +00:00
Stefano Mazzocchi
14d046bb7a silence velocity's logs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1366 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-28 00:01:53 +00:00
Stefano Mazzocchi
565e3b6e90 adding default code style info to eclipse projects
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1356 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-27 22:11:38 +00:00
David Huynh
64727ebd03 Somehow this fell out of a previous checkin.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1302 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-23 00:45:18 +00:00
David Huynh
b45506b787 If refine data dir doesn't exist, try to find and move gridworks data dir over
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1294 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-22 23:30:14 +00:00
David Huynh
1367ce301e More renaming, except for: client-side code, build scripts, anything to do with data loading and QA, workspace path. Refine can still run, and undo/redo on existing projects is working.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1290 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-22 18:36:33 +00:00
David Huynh
e6bc603a11 Renamed Java classes whose names contain 'Gridworks'. Refine is still able to start. But don't check out the code just yet.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1289 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-22 17:46:39 +00:00
David Huynh
edb23eb263 Changed Java packages com.google.gridworks.* to com.google.refine.* and modified other code just enough to start grefine up without error. Much remains to be done. Do not check out the code just yet.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1288 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-22 17:04:10 +00:00
David Huynh
a40a09b391 Renamed sub-projects as they are known to Eclipse
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1287 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-22 16:40:46 +00:00
Stefano Mazzocchi
4af3a4cbf5 allow gridworks to load extensions also from the same place where data is stored (in the 'extension' subfolder')
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1258 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-02 01:17:54 +00:00
David Huynh
dcc3ac8534 Renamed packages com.metaweb.* to com.google.*.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1130 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-03 23:01:18 +00:00
Stefano Mazzocchi
8c56b437fa more fixes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1129 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-03 20:19:48 +00:00
Stefano Mazzocchi
3c09b06393 more work on the broker
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1036 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-25 07:03:41 +00:00