Commit Graph

98 Commits

Author SHA1 Message Date
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Jacky
54e25408fb
Merge pull request #1414 from OpenRefine/issue1377
Expose fields as attributes in Jython
2018-01-26 13:14:10 -05:00
TonyO
a3ac35a296 database extension with classpath fix 2018-01-13 20:24:56 -06:00
Antonin Delpeuch
1b76f789a3 Expose fields as attributes in Jython
Closes #1377
2018-01-13 09:18:48 +00:00
Jacky
91ec02f805 update the .classpath 2017-11-29 19:48:28 -05:00
Jacky
818e139b43 add the import options to metadata 2017-10-21 23:41:11 -04:00
Antonin Delpeuch
00f8e4fc6b Merge pull request #1237.
Conflicts:
	.classpath
	main/webapp/modules/core/langs/translation-en.json
	main/webapp/modules/core/scripts/dialogs/extend-data-preview-dialog.js

Closes #363 and #56.
2017-08-28 16:25:50 +01:00
Antonin Delpeuch
8e7f4ae80c Update Jython to 2.7.1.
Related to #1236.
2017-08-24 09:46:58 +02:00
Antonin Delpeuch
2a3c158696 swc-parser-lazy: Add source JAR and mention the dependencies in LICENSE.txt 2017-08-17 16:37:04 +01:00
Antonin Delpeuch
88aa6f113d Switch to newer version of swc-parser-lazy 2017-08-13 20:14:29 +01:00
jackyq2015
f3463c332e Unit test for issue #137 2017-08-13 12:37:20 -05:00
Antonin Delpeuch
deeed2204b Update Eclipse project with sweble dependency 2017-08-13 11:27:41 +01:00
jackyq2015
6b1f370e9b set right jar for jython 2017-03-26 17:24:36 -04:00
Tom Morris
1222acdc57 Update POI to 3.13 - replaces #1029 2015-09-25 20:06:21 -04:00
Tom Morris
e70a877fb9 Fix leftover merge issue 2015-09-25 19:51:52 -04:00
jackyq2015
3dc31257d9 fix the classpath issue 2015-09-22 20:17:48 -04:00
Thad Guidry
20220f7294 Merge pull request #1068 from RefinePro/issues-freebase-remove
Issues freebase remove
2015-09-21 20:24:06 -05:00
jackyq2015
dc7641196b clean the classpath setting 2015-09-19 16:05:22 -04:00
jackyq2015
e0a0477f79 remove the src of freebase 2015-09-19 15:59:42 -04:00
jackyq2015
6e315853a5 upgrade POI from 3.8 to 3.12 2015-07-11 11:08:29 -04:00
Tom Morris
28eafe7a5b Update Google client libs to current versions. Fix Spreadsheet #996 2015-05-14 20:41:03 -04:00
Tom Morris
cbc3ab78c7 Revert "Update Guava to 18.0"
This reverts commit bfc39d9e8c.
2015-05-14 15:24:59 -04:00
Tom Morris
bfc39d9e8c Update Guava to 18.0 2014-12-21 12:32:50 -05:00
Tom Morris
c68c1bb2b1 Upgrade to Clojure 1.5.1 & switch to clojure-slim JAR - #792 2013-08-26 19:40:37 -04:00
Tom Morris
62b8c476f1 Use Java's built-in Number formatter instead of ICU4J which is
massive - #792
2013-08-26 15:47:12 -04:00
Tom Morris
e98d6037cf Delete obsolete Guava JARS - #792 2013-08-26 15:34:18 -04:00
Tom Morris
25a3de410f Update to patched version of Butterfly - fixes #652 2013-08-18 11:24:33 -04:00
Tom Morris
00dd7f2bdd Merge branch 'master' into fusiontables-migration
Conflicts:
	.classpath
	extensions/gdata/module/MOD-INF/controller.js
	extensions/gdata/src/com/google/refine/extension/gdata/GDataImporter.java
2013-07-25 16:13:04 -04:00
Tom Morris
1353f7f7aa Update Apache HTTP client JARs to 4.2.5 2013-07-10 15:16:21 -04:00
Tom Morris
e1bea25c72 Clean up server tests
- move from shell script to Ant
- update TestNG and Mockito to latest versions
2013-06-11 19:44:58 -04:00
Tom Morris
22a9acd04b Merge branch master 2013-04-13 19:02:20 -04:00
Tom Morris
56389588e3 Update to Jackson 1.9.12 2013-03-23 08:15:08 -04:00
Tom Morris
05968e37fa Switch Add from Freebase to Google APIs - part of #696
- switch to use the Google Java client instead of handrolled requests
2013-03-12 17:38:18 -04:00
Tom Morris
975c6c85dc Replace Jython JAR with one that includes all libraries - fixes #693 2013-03-06 20:36:05 -05:00
Tom Morris
1e9a1c5f15 Merge branch 'master' into fusiontables-migration 2013-02-26 00:05:34 -05:00
Tom Morris
317bf35445 Update to Jython 2.5.3 and package everything in a single JAR 2013-02-21 12:44:47 -05:00
Tom Morris
975d18942f Update to Clojure 1.4. Closes issue #634 2013-02-12 00:15:35 -05:00
Tom Morris
2464421014 Update to rev 17 of Fusion Tables JARs 2013-02-11 12:36:45 -05:00
Tom Morris
5eca6127fc Add OAuth2 JARs to Eclipse classpath 2013-02-10 14:41:46 -05:00
Tom Morris
008df21b33 Update OpenCSV to our fork with multi-character separator support
Built from the openrefine-2.6 branch in the OpenRefine/opencsv repo
2013-01-27 15:21:53 -05:00
Tom Morris
9e92ffcb4a FIXED - task 608: Patch: Update .classpath to export guava lib. Remove deprecated google-collect jar
http://code.google.com/p/google-refine/issues/detail?id=608
Patch supplied by sdeo@google.com

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2545 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-11 23:03:06 +00:00
Tom Morris
b3f5fada95 FIXED - task 578 & 596: Clean up JSON importer
http://code.google.com/p/google-refine/issues/detail?id=578
http://code.google.com/p/google-refine/issues/detail?id=596

Extend tree parser framework to allow any Serializable instead of just Strings. Use this in JSON importer to: Import keywords null, true, false; Import empty strings and don't trim whitespace from strings on import;  Import numbers directly instead of importing them as text and then parsing them ourselves. Add tests to verify all this stuff

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2543 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-08 01:20:25 +00:00
Tom Morris
abc162a0d0 Switch back to old JSON lib for now
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2536 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-21 17:33:17 +00:00
Tom Morris
60c3a31242 Update Jackson and JSON libs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2532 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-18 21:46:49 +00:00
Tom Morris
4bb6c43982 task 604: add Guava to main project so that we're not dependent on an extension
http://code.google.com/p/google-refine/issues/detail?id=604

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2531 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-15 13:33:17 +00:00
Tom Morris
d6e00fb3c7 Add JRDF source jar
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2524 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-05 15:01:55 +00:00
Stefano Mazzocchi
2947ebba0e updating the signpost library and attaching sources for easier inspection
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2517 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-01 21:47:21 +00:00
Stefano Mazzocchi
5dffd249de updating signpost to the latest release
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2514 7d457c2a-affb-35e4-300a-418c747d4874
2012-07-13 06:50:53 +00:00
Tom Morris
1df0dd62ce Issue 566 - export httpclient libs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2494 7d457c2a-affb-35e4-300a-418c747d4874
2012-05-03 15:43:22 +00:00
Tom Morris
166b176ba2 Update to Apache POI 3.8
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2486 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-29 04:41:42 +00:00