Commit Graph

199 Commits

Author SHA1 Message Date
Antonin Delpeuch
aa228c43b2 Fix frontend for extensions for CSRF protections 2019-10-17 11:44:57 +01:00
Antonin Delpeuch
b52c009491 CSRF protection for database extension 2019-10-17 09:10:28 +01:00
Antonin Delpeuch
28c2a6154e
Merge pull request #2181 from OpenRefine/update_jackson
Update Jackson to 2.9.10
2019-10-10 17:21:05 +01:00
Antonin Delpeuch
334147d611 Update Jackson to 2.9.10 2019-10-10 16:55:56 +01:00
Isao Matsunami
dcee3d9719
Translated using Weblate (Japanese)
Currently translated at 100.0% (50 of 50 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/
2019-10-09 10:58:37 +02:00
Hosted Weblate
9a816f191c
Merge branch 'origin/master' into Weblate. 2019-10-08 09:56:29 +02:00
Nicolas @belett VIGNERON
7ed73195ff
Translated using Weblate (French)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/fr/
2019-10-08 09:56:26 +02:00
Antonin Delpeuch
1a79176942
Merge pull request #2151 from tcbuzor/tcbuzor_orefine_xss_tr
Database Extension: input validation for database connection data
2019-09-27 10:37:26 +02:00
Antonin Delpeuch
71e76524e5 Fix database connection list rendering and backend unit test 2019-09-22 18:31:38 +01:00
tcbuzor
dca496aa3b remove debug statements 2019-09-14 23:07:23 -05:00
tcbuzor
575a7d4979 input validation for database connection data 2019-09-08 23:22:22 -05:00
Antonin Delpeuch
6c128d6692 Attempt to fix surefire on Appveyor 2019-08-28 10:08:22 +01:00
Antonin Delpeuch
8ab7653e0b Set version to 3.3-SNAPSHOT 2019-07-26 15:52:00 +01:00
Antonin Delpeuch
e3417bff49 Set version to 3.2 2019-07-26 15:29:57 +01:00
Antonin Delpeuch
d7156a1ea3 Enable MySQL tests 2019-06-13 13:51:03 +01:00
Antonin Delpeuch
318696d56c Update Jackson to 2.9.9. Closes #2051. 2019-05-31 08:19:20 +01:00
Antonin Delpeuch
29f2a98a7e Exclude MariaDB tests as well, for #2043 2019-05-15 10:24:17 +01:00
Antonin Delpeuch
a6424e53a0 Temporarily disable MySQL, #2043 2019-05-15 10:17:42 +01:00
Stefan Weil
ed04be1c96 extensions: Fix some typos in comments and message texts
All typos were found and fixed using codespell.

Signed-off-by: Stefan Weil <sw@weilnetz.de>
2019-04-02 17:38:47 +02:00
Antonin Delpeuch
af8608e897 Bump version to 3.2-SNAPSHOT 2019-03-01 11:17:28 +00:00
Antonin Delpeuch
2a92726294 Set version to 3.2-beta 2019-03-01 10:55:42 +00:00
Antonin Delpeuch
3c2cec161d Update Jackson to 2.9.8 per CVE-2018-19360 2019-02-19 22:26:03 +00:00
Stefan Olsson
29e4fad17e
Translated using Weblate (Swedish)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/sv/
2019-02-04 20:56:30 +01:00
Stefan Olsson
95db88db85
Added translation using Weblate (Swedish) 2019-02-04 20:29:56 +01:00
Estébastien Robespi
8856cf20a4
Translated using Weblate (French)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/fr/
2019-01-10 09:08:16 +01:00
Luca Martinelli
bd48ea3c69
Translated using Weblate (Italian)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/it/
2018-12-16 03:09:18 +01:00
Jacky
150ee12058
Merge pull request #1902 from OpenRefine/cleanup
Tidy up various things
2018-12-11 20:59:50 -05:00
Hosted Weblate
84f3b0e793
Merge branch 'origin/master' into Weblate. 2018-12-09 14:47:26 +01:00
Antonin Delpeuch
dd0fa967d0
Merge pull request #1898 from OpenRefine/issue/1890
support both jdk 8, oracle jdk9 and openjdk11
2018-12-09 22:47:20 +09:00
Antonin Delpeuch
98bd03e5f4 Reorganize Java imports 2018-12-09 11:19:39 +09:00
Antonin Delpeuch
7ab00366fc Database extension logging cleanup 2018-12-09 11:15:04 +09:00
jackyq2015
a8cf844f9c fix issue #1900 2018-12-08 20:57:16 -05:00
Isao Matsunami
cac83e9132
Translated using Weblate (Japanese)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/
2018-12-08 20:08:58 +01:00
Allan Nordhøy
a6d3d7504e
Translated using Weblate (Norwegian Bokmål)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/nb_NO/
2018-12-07 17:54:32 +01:00
Hosted Weblate
32806ce5a7
Merge branch 'origin/master' into Weblate 2018-12-07 07:15:47 +01:00
Allan Nordhøy
39a8ba3eaa
Translated using Weblate (Norwegian Bokmål)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/nb_NO/
2018-12-07 07:15:46 +01:00
Allan Nordhøy
e6ed452ef2
Regularcase, Form, ellipsis, -successfully 2018-12-07 03:39:32 +01:00
Antonin Delpeuch
5639f1b2f1
Merge pull request #1755 from OpenRefine/jackson-serialization
Jackson serialization
2018-12-01 23:56:50 +00:00
Antonin Delpeuch
1939af343d Update to Jackson 2.9.7 2018-12-01 22:30:30 +00:00
Myoung Seok Lee
948af451ec
Translated using Weblate (Korean)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ko/
2018-11-30 20:38:22 +01:00
Myoung Seok Lee
d236e23c95
Added translation using Weblate (Korean) 2018-11-30 17:31:03 +01:00
Flavio Pompermaier
0984267ebb
Translated using Weblate (Italian)
Currently translated at 93.5% (43 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/it/
2018-11-30 17:08:49 +01:00
Antonin Delpeuch
8853e72ab9 Migrate database extension to newer Jackson 2018-11-30 19:39:42 +09:00
Antonin Delpeuch
916ede440b Remove all mentions of org.json in database extension 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
5a4a79028f Revert "data package metadata (#1398)"
This reverts commit c4b0ff6bea.
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
1eaadc30b7 Migrate database extension importers to Jackson 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
be9ebdcad9 Migrate database extension out of JSONWriter 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
c9620a5d9a Add missing .flush(); .close() on JsonGenerator 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
1790799bfe Remove Jsonizable interface and write methods 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
36765e7e62 Bump version to 3.2-SNAPSHOT 2018-11-29 11:59:30 +09:00
Antonin Delpeuch
b90e413b40 Set version to 3.1 2018-11-29 10:32:56 +09:00
Jacky
83019e74d9
fix typo 2018-11-25 23:24:41 -05:00
jackyq2015
d9df1b63d9 fix UT 2018-11-25 16:40:41 -05:00
Jacky
992a19f2dd
Merge branch 'master' into issue/1819 2018-11-25 16:30:28 -05:00
jackyq2015
7db3af74f8 fix issue #1819 2018-11-25 16:25:51 -05:00
Antonin Delpeuch
6ac821c844 Migrate dictionary loading in extensions 2018-11-21 17:50:49 +00:00
Antonin Delpeuch
10931e1e4d Migrate js to new localization syntax 2018-11-21 17:30:00 +00:00
Antonin Delpeuch
b46c5a7b4e Flatten remaining messages 2018-11-21 17:26:53 +00:00
Antonin Delpeuch
375839bb22 Update translation files for new format 2018-11-21 15:25:58 +00:00
Antonin Delpeuch
9bf0bb2154 Merge JS i18n strings with slash 2018-11-21 15:24:57 +00:00
Jon Harald Søby
4ed27f9a50
Translated using Weblate (Norwegian Bokmål)
Currently translated at 93.5% (43 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/nb_NO/
2018-11-17 09:56:48 +01:00
Jon Harald Søby
f41dd5680e
Added translation using Weblate (Norwegian Bokmål) 2018-11-17 01:52:53 +01:00
Antonin Delpeuch
a2dd6d97e4 Set version to 3.1-SNAPSHOT 2018-11-07 14:01:06 +00:00
Antonin Delpeuch
3ad7d9e19d Set version to 3.1-beta 2018-11-07 12:46:15 +00:00
Hosted Weblate
1a26cab747
Merge branch 'origin/master' into Weblate 2018-11-06 14:55:01 +01:00
Antonin Delpeuch
53aef139a3 Apply fixes to pom.xml files suggested by Eclipse 2018-11-05 17:27:17 +00:00
Mathieu Saby
4b8ff58713
Translated using Weblate (French)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/fr/
2018-11-04 00:24:11 +01:00
Mathieu Saby
399bc2befe
Translated using Weblate (French)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/fr/
2018-11-01 23:07:48 +01:00
Antonin Delpeuch
f094c7e23a Exclude redundant jars from database and gdata extensions 2018-09-22 18:04:02 +01:00
Antonin Delpeuch
efddca61af Revert Jackson upgrade on database extension 2018-09-22 14:04:23 +01:00
Antonin Delpeuch
0321e19fef Unify google library versions 2018-09-22 10:43:12 +01:00
Antonin Delpeuch
fc70852183 Update version to 3.1-SNAPSHOT 2018-09-21 12:28:13 +01:00
Antonin Delpeuch
c812b6118c Cleanup most Eclipse config files 2018-09-18 14:51:27 +01:00
Antonin Delpeuch
782ae4e788 Revert "Revert "Migrate to Maven""
This reverts commit c20918b73d.
2018-09-16 15:34:47 +01:00
Jacky
c20918b73d
Revert "Migrate to Maven" 2018-09-16 10:16:50 -04:00
Jacky
e3813d9820
Merge pull request #1725 from OpenRefine/maven
Migrate to Maven
2018-09-15 21:45:12 -04:00
Antonin Delpeuch
9b659c618c Cleanup classpath generation in Maven config files 2018-09-11 15:18:03 +01:00
Antonin Delpeuch
6c42a2aba9 Cleanup copied libs along with class files 2018-09-11 11:14:15 +01:00
Antonin Delpeuch
c12502aaae Use dependency plugin to copy runtime lib to MOD-INF dirs 2018-09-11 10:55:29 +01:00
Antonin Delpeuch
1c20242d40 Replace version and groupId by variables in submodules 2018-09-10 15:33:30 +01:00
Antonin Delpeuch
e589697171 Remove Ant configuration files 2018-09-10 15:13:26 +01:00
Antonin Delpeuch
9b54ac2bd2 Remove jars of dependencies 2018-09-10 15:11:21 +01:00
Antonin Delpeuch
1184528098 Fix Database extension testing for Maven 2018-09-10 13:37:51 +01:00
Antonin Delpeuch
94220ad880 Maven configuration for the database extension 2018-09-07 11:27:28 +01:00
Antonin Delpeuch
a2c0ac9bcc Drop Jsonizable for DatabaseModuleImpl, not needed 2018-09-01 12:42:05 +02:00
Isao Matsunami
96045f0c19
Translated using Weblate (Japanese)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/
2018-08-29 12:39:37 +02:00
Jacky
5a6c9d72f0 fix the template load issue and package typo 2018-06-16 15:43:29 -04:00
Isao Matsunami
3b0902204a
Update translation-jp.json 2018-05-19 02:46:18 +09:00
Isao Matsunami
c65daabcf4
updated a file for Japanese 2018-05-19 02:04:40 +09:00
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Antonin Delpeuch
0d8659c652 Remove unit_tests.xml and rename others 2018-01-31 08:36:11 +00:00
Antonin Delpeuch
a8ed571f27 Enable Postgres on Appveyor 2018-01-27 18:08:04 +00:00
Antonin Delpeuch
2da07462ba Fix appveyor MySQL password 2018-01-27 17:52:23 +00:00
Antonin Delpeuch
6fdaab7724 Enable MySQL in Appveyor 2018-01-27 17:03:53 +00:00
Antonin Delpeuch
b5ffcd38fa Exclude tests which require a database by default; enable them on Travis 2018-01-27 16:36:33 +00:00
Antonin Delpeuch
b2b9a4bc9a Do not catch exceptions in tests; add database groups
The groups let us enable / disable tests for a specific db,
depending on which one is available on the machine.
2018-01-27 16:20:07 +00:00
Stuart Kenny
43e62832dd Move context menu function from main script 2018-01-22 10:17:59 +00:00
Stuart Kenny
2c3be12269 Javascript error on project page from database extension 2018-01-22 10:09:59 +00:00
TonyO
a3ac35a296 database extension with classpath fix 2018-01-13 20:24:56 -06:00