Commit Graph

276 Commits

Author SHA1 Message Date
Antonin Delpeuch
fcde3d2c7d Add QuickStatements export and preview 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
975542bff1 Restore schema in UI after save 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
decef38f85 Synchronize schema storage and UI behaviour. 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
3fd71965fa Move wikidata-specific dependency to own .classpath 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
e38aeb7ba5 JSON serialization of schema to model 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
82930da4db First draft of the schema alignment dialog 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
5853cdf10d Wikibase schema serialization and related operation 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
ad475849b9 Start schema classes 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
19a1e5e007 Start Wikidata extension based on Wikidata-Toolkit 2018-04-27 09:17:30 +02:00
Jacky
cf573f37de fix the NPE when there is no fusion table exists 2018-03-06 18:16:29 -05:00
Jacky
ac57eb813e changes based on code review 2018-03-06 18:10:54 -05:00
Jacky
6af7e6545c adjust timeout to 3 min 2018-03-01 22:48:14 -05:00
Jacky
77aad7eb05 changes based on the code review 2018-03-01 22:45:14 -05:00
Jacky
c758a6b635 exclude test-out 2018-02-25 12:00:40 -05:00
Jacky
a9a41c074a upgrade the google api client 2018-02-02 13:08:29 -05:00
Jacky
efcbe4b718 upgrade the google api services 2018-02-02 13:04:27 -05:00
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Antonin Delpeuch
0d8659c652 Remove unit_tests.xml and rename others 2018-01-31 08:36:11 +00:00
Antonin Delpeuch
a8ed571f27 Enable Postgres on Appveyor 2018-01-27 18:08:04 +00:00
Antonin Delpeuch
2da07462ba Fix appveyor MySQL password 2018-01-27 17:52:23 +00:00
Antonin Delpeuch
6fdaab7724 Enable MySQL in Appveyor 2018-01-27 17:03:53 +00:00
Antonin Delpeuch
b5ffcd38fa Exclude tests which require a database by default; enable them on Travis 2018-01-27 16:36:33 +00:00
Antonin Delpeuch
b2b9a4bc9a Do not catch exceptions in tests; add database groups
The groups let us enable / disable tests for a specific db,
depending on which one is available on the machine.
2018-01-27 16:20:07 +00:00
Jacky
54e25408fb
Merge pull request #1414 from OpenRefine/issue1377
Expose fields as attributes in Jython
2018-01-26 13:14:10 -05:00
Stuart Kenny
43e62832dd Move context menu function from main script 2018-01-22 10:17:59 +00:00
Stuart Kenny
2c3be12269 Javascript error on project page from database extension 2018-01-22 10:09:59 +00:00
TonyO
a3ac35a296 database extension with classpath fix 2018-01-13 20:24:56 -06:00
Jacky
cc7a72d9db
Revert "OpenRefine Database Import Extension" 2018-01-13 14:36:23 -05:00
Antonin Delpeuch
315b126b23 Cleanup tests for Codacy 2018-01-13 09:18:48 +00:00
Antonin Delpeuch
1b76f789a3 Expose fields as attributes in Jython
Closes #1377
2018-01-13 09:18:48 +00:00
TonyO
524c1a32f9 TR1394-fixed test cases 2018-01-12 22:54:20 -06:00
TonyO
6bd932fd9a unit tests and db integration tests and travis-ci 2018-01-12 22:23:48 -06:00
TonyO
88a3884e34 Merge branch 'master' of https://github.com/OpenRefine/OpenRefine into openrefine-db-extension 2018-01-10 21:07:26 -06:00
TonyO
c1703186e1 new test util class 2018-01-10 21:01:51 -06:00
TonyO
13a34a6f3e added test extra unit test 2018-01-10 21:00:10 -06:00
Antonin Delpeuch
0fb7e79982 Split .gitignore by extension 2018-01-03 22:04:49 +01:00
Antonin Delpeuch
4a325c8ff5 Configure testing for the Jython extension 2018-01-03 18:37:16 +01:00
Isao Matsunami
c75f97b40d
Update translation-jp.json 2017-12-28 17:08:07 +09:00
Isao Matsunami
a72d365b2b
Create translation-jp.json
Added Japanese translation file for Google Data extension
2017-12-28 16:52:11 +09:00
TonyO
cccd722f44 code cleanup with eslint and checkstyle 2017-12-24 00:52:40 -06:00
TonyO
9afd19be0a changed log levels 2017-12-22 23:05:05 -06:00
TonyO
6f793bb9fa database extension code commit 2017-12-22 22:43:02 -06:00
Jacky
818e139b43 add the import options to metadata 2017-10-21 23:41:11 -04:00
Antonin Delpeuch
c9cc4fb262 Update Jackson to 2.9.1
Closes #1262
2017-10-09 17:38:09 +01:00
Antonin Delpeuch
8e7f4ae80c Update Jython to 2.7.1.
Related to #1236.
2017-08-24 09:46:58 +02:00
Antonin Delpeuch
bcdd04d062 Merge branch 'master' of https://github.com/noamoss/OpenRefine into noamoss
Conflicts:
	extensions/freebase/module/langs/translation-he.json
	main/webapp/modules/core/langs/translation-en.json
2017-08-12 09:45:23 +01:00
Antonin Delpeuch
dbb071da30 Merge branch 'default-to-english' of https://github.com/RBGKew/OpenRefine into RBGKew-default-to-english 2017-08-09 14:07:22 +01:00
Fadi Maali
0e21c0e594 correct classpath references and java version
- updated classpath references to existing versions of the libraries.
- Java version upgraded to 7 as some Java 7 specific features are used.
- corrected references to old project name (grefine-all) in the launch script
2017-07-18 22:15:46 +01:00
Thad Guidry
f9323d29c6 Updating to latest Jython 2.7 standalone jar 2017-02-28 14:52:41 -06:00
Tom Morris
8511c6c30d Merge remote-tracking branch 'upstream/master' 2015-09-25 17:14:48 -04:00