Commit Graph

94 Commits

Author SHA1 Message Date
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Antonin Delpeuch
0f03d77178 Enable extension tests in Appveyor 2018-01-03 19:32:22 +01:00
Antonin Delpeuch
4a325c8ff5 Configure testing for the Jython extension 2018-01-03 18:37:16 +01:00
Jacky
3c7e0d1847 set the min jdk to 1.8 2017-11-29 17:50:13 -05:00
Jacky
6bb11a22dd set the java_version to 1.8 2017-11-29 17:42:02 -05:00
jackyq2015
45e3ea5e86 fix testng data path issue 2017-08-13 13:03:19 -05:00
Antonin Delpeuch
fff349439b Cleanup ant build file 2017-08-03 11:29:56 +01:00
Antonin Delpeuch
bf34145591 Submit coverage data to Codacy.com 2017-08-03 11:20:21 +01:00
Antonin Delpeuch
afed8eb28a Generate code coverage reports with Jacoco 2017-08-03 11:07:14 +01:00
Tom Morris
0f49f701d0 Update to Java 7 for build 2015-05-14 20:31:47 -04:00
Matthew Blissett
b817af9145 Convert line endings to LF or CRLF for Linux and Windows distributions.
A distribution built on the opposite OS has the wrong line endings for
refine.ini, refine.bat, refine (important), README.txt and the licenses
(annoying).  This converts them during the build.
2015-01-23 13:38:31 +00:00
Tom Morris
27aa228507 Back the test verbosity down a bit now that we have things working 2014-05-30 01:47:19 -04:00
Tom Morris
23d934a94c Crank up TestNG verbosity to see if we can figure out why Java 6 tests
are failing on TravisCI
2013-09-19 01:00:17 -04:00
Tom Morris
886fb5eee9 Fix ICU4J build exclusion in last commit & exclude another src dir -
#792
2013-08-26 16:43:22 -04:00
Tom Morris
62b8c476f1 Use Java's built-in Number formatter instead of ICU4J which is
massive - #792
2013-08-26 15:47:12 -04:00
Tom Morris
29eb95cba2 Exclude lib-src JARs - #792 2013-08-26 15:36:53 -04:00
Tom Morris
844b8182a4 Fix case of TestNG attribute (docs are wrong) 2013-08-16 18:29:33 -04:00
Tom Morris
3828139ed0 Abort build if tests fail 2013-08-16 18:23:50 -04:00
Mateja Verlic
03029be67e Removed exclude, because extensions' .class files were not included in the app 2013-08-14 09:10:12 +02:00
Mateja Verlic
273ba08d1e Removed extra slash in replacefilter 2013-08-10 12:34:14 +02:00
Tom Morris
840c8979cf Clean up version handling 2013-07-29 18:30:23 -04:00
Tom Morris
fc6d1821ea Remove SVN revision & add OS name for builds 2013-07-29 17:59:00 -04:00
Tom Morris
0cb0269ae8 Build extensions before running tests - another piece of #754 2013-07-10 16:03:41 -04:00
Tom Morris
54a8848bc6 Merge branch 'master' of github.com:tfmorris/OpenRefine 2013-06-11 19:46:30 -04:00
Tom Morris
e1bea25c72 Clean up server tests
- move from shell script to Ant
- update TestNG and Mockito to latest versions
2013-06-11 19:44:58 -04:00
Tom Morris
67fc97ba6c Change product ID to use new domain 2013-06-11 15:53:45 -04:00
Tom Morris
c0fb6be9fe Disable headless mode again since it only effects virtualbox (hopefully) 2013-03-26 18:07:38 -04:00
Tom Morris
3b379ef4ed Run headless on Mac to work around Java Virtualbox crash 2013-03-26 17:25:57 -04:00
Tom Morris
ae30c19f6b Switch to appbundler & specify target Java version on build 2013-03-26 17:05:17 -04:00
Tom Morris
7813439dc8 Merge remote-tracking branch 'upstream/master' 2013-03-26 12:53:32 -04:00
Tom Morris
0bdd3a2d83 Switch to Oracle appbundler for Mac build 2013-03-26 12:52:55 -04:00
Tom Morris
4770772fe6 Update name & ID for Mac OS build 2013-03-26 10:56:54 -04:00
Tom Morris
0bd2104a16 Issue 630: Change branding from Google Refine to OpenRefine
** The first native Github commit (ie not one converted from SVN **
Change Google Refine to OpenRefine or just Refine.  
Change icon filenames and add some placeholder icons
2012-10-18 19:40:31 -04:00
Tom Morris
b582a18cdc Issue 144 - create subdirectory in zip file for Windows distribution
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2437 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-27 21:27:35 +00:00
Stefano Mazzocchi
b413833ca1 fixing a bunch of jslint issues
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2303 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 23:44:11 +00:00
Stefano Mazzocchi
df29c0b281 whitespace (no functional changes)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2300 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 19:33:28 +00:00
David Huynh
6e3989dc0f Updated jarbundler version to 2.2.0
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2086 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 21:18:11 +00:00
Tom Morris
c6c341d568 Add kits target to build all kits. Add build.properties file. Simplify property setting. Make sure dist directory exists.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2082 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 20:22:14 +00:00
Tom Morris
ae6ce2225c Specify character encoding for source files
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2044 7d457c2a-affb-35e4-300a-418c747d4874
2011-04-17 04:24:18 +00:00
David Huynh
3423b4f71e No need to process version.js anymore.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1599 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 04:31:40 +00:00
Stefano Mazzocchi
b62e63306a - make the correct version + revision available also to the java side (thru web.xml)
- add @Override metadata to the commands that were missing it
- make the version information appear even when using trunk (Fixes Issue 136)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@1406 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-29 01:50:57 +00:00
David Huynh
22cbcddd78 Renamed in build scripts. ./refine build, ./refine, and ./refine dist all work.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1292 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-22 21:47:35 +00:00
Stefano Mazzocchi
06e83a66ff Issue-134: make sure the {build.dir} directory actually exist (it normally gets created by the invoking ./gridworks shell file, but only when calling a build, not a dist, so act more defensively here)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1275 7d457c2a-affb-35e4-300a-418c747d4874
2010-09-19 17:08:39 +00:00
Stefano Mazzocchi
6c75b8102e clean up extensions too when cleaning up the code
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1232 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-31 01:14:37 +00:00
Stefano Mazzocchi
1106d07282 - added build extension dependency when creating the distro
- removed and ignore extension classes


git-svn-id: http://google-refine.googlecode.com/svn/trunk@1224 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-24 21:04:59 +00:00
Stefano Mazzocchi
fc4f43e7ec make sure to copy extensions when building the webapp for distribution
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1223 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-24 19:25:10 +00:00
Stefano Mazzocchi
3c90a90f93 fix ./gridworks dist
NOTE: there is a bug in Snow Leopard that prevents the disk images from showing the background
Unfortunately, there is no known workaround: more info at http://lists.apple.com/archives/installer-dev/2010/Mar/msg00040.html

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1177 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-20 22:24:02 +00:00
Stefano Mazzocchi
096caeac7b adding ability to clean extensions as well
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1155 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-10 18:55:31 +00:00
David Huynh
1d87b2e210 Renamed metaweb to google in various top level files
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1132 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-04 17:19:03 +00:00
Stefano Mazzocchi
3c09b06393 more work on the broker
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1036 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-25 07:03:41 +00:00