Commit Graph

1385 Commits

Author SHA1 Message Date
Owen Stephens
d2687cc58a Treat null and empty string as different values when doing transforms 2018-02-18 23:19:28 +00:00
Owen Stephens
566f2b792b Use white-space: pre-wrap style to ensure whitespace in cells, facets and transformation previews shows exactly as in the underlying data 2018-02-17 15:08:44 +00:00
Owen Stephens
8dec08aad3 Changed label of 'blank out cells' to 'set cells to null' where English label is used 2018-02-16 23:40:44 +00:00
Joanne
e0d87c3d94 Update tests to match updated range function 2018-02-16 15:13:37 +00:00
Joanne
41e8c0beee Update range function to return Integer arrays 2018-02-16 15:13:37 +00:00
Joanne
01d8e458f4 Update tests to match updated range function 2018-02-16 15:13:37 +00:00
Joanne
35c991d9c2 Update range function to follow Python's range function 2018-02-16 15:13:37 +00:00
Joanne
e2793daf54 Update tests for improved range function 2018-02-16 15:13:37 +00:00
Joanne
03d80598aa Update range function to include step ability 2018-02-16 15:13:37 +00:00
Joanne
d95f5985b9 Add tests for range function 2018-02-16 15:13:37 +00:00
Joanne
bd2c4348fe Implement main logic for range function 2018-02-16 15:13:37 +00:00
Joanne
41f2a27a66 Register range function 2018-02-16 15:13:37 +00:00
Joanne
6cc2a1d353 Implement main logic behind range function 2018-02-16 15:13:37 +00:00
Isao Matsunami
95d50fb010 Translated using Weblate (Japanese)
Currently translated at 100.0% (676 of 676 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2018-02-12 13:27:20 +00:00
Flavio Pompermaier
45de36901e Translated using Weblate (Italian)
Currently translated at 97.6% (660 of 676 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/it/
2018-02-12 13:27:20 +00:00
John Carl Saducas
5c16248a81 Translated using Weblate (Filipino)
Currently translated at 100.0% (676 of 676 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fil/
2018-02-12 13:27:20 +00:00
John Carl Saducas
0615066140 Translated using Weblate (Filipino)
Currently translated at 0.1% (1 of 676 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fil/
2018-02-12 13:27:20 +00:00
Martin Magdinier
9b453eb504 Added translation using Weblate (Filipino) 2018-02-12 13:27:20 +00:00
Isao Matsunami
cef32365be Translated using Weblate (Japanese)
Currently translated at 100.0% (676 of 676 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2018-02-12 13:27:20 +00:00
Antonin Delpeuch
2e96a54fa2 Translated using Weblate (French)
Currently translated at 97.6% (659 of 675 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/fr/
2018-02-12 13:27:20 +00:00
Thad Guidry
d5b589fb1b
Merge pull request #1454 from joanneong/update-logo
Update OpenRefine logo
2018-02-09 09:29:28 -06:00
isaomatsunami
91c6c6c791 fix layout 2018-02-09 03:53:11 +09:00
Joanne
b02404d308 Delete old logos and rename new logos 2018-02-08 13:04:35 +08:00
Joanne
56a455b6be Rename new OpenRefine logo files 2018-02-08 11:23:03 +08:00
Joanne
8acca669ce Update OpenRefine logos for UI 2018-02-08 11:22:20 +08:00
Joanne
712aa37499 Delete unwanted new logos 2018-02-08 11:08:59 +08:00
Owen Stephens
0d04a25cf1
Merge pull request #1450 from OpenRefine/issue1448
Make Wikitext importer more robust
2018-02-07 17:41:23 +00:00
Joanne
653ea60dbc Update favicon for OpenRefine 2018-02-06 19:56:25 +08:00
Joanne
ee96bf62ff Add new favicon image 2018-02-06 19:56:11 +08:00
Joanne
8a89cb6dfc Add new logo images to OpenRefine 2018-02-06 19:52:06 +08:00
Joanne
3e27182090 Update logo for error page 2018-02-06 19:51:51 +08:00
Joanne
6ea582eb9b Update logo for preferences 2018-02-06 19:51:33 +08:00
Joanne
0cdd101ca0 Update logo for about page 2018-02-06 19:48:07 +08:00
Joanne
a46f28b596 Update logo for project page 2018-02-06 19:45:16 +08:00
Joanne
5b65b0927f Update logo for sidebar 2018-02-06 19:42:10 +08:00
Joanne
591a7db416 Update logos on index page 2018-02-06 19:18:47 +08:00
Antonin Delpeuch
f5ff5565ff Cleanup for Codacy and better parsing of quote character 2018-02-03 16:37:15 +00:00
Antonin Delpeuch
a89bbcbbe2 Add missing method removed during merge 2018-02-03 14:29:24 +00:00
Thad Guidry
a191d13b14
adding missing StringUtils import 2018-02-03 07:26:47 -06:00
Thad Guidry
c83dbe3b23
Merge branch 'master' into stundzig-develop/1086-quotecharacter 2018-02-03 07:20:45 -06:00
Antonin Delpeuch
86be1c12e8 Expose quote character setting in UI 2018-02-03 09:01:07 +00:00
Antonin Delpeuch
dc4815ba7b Fix initial options for the quote character 2018-02-03 09:00:53 +00:00
Antonin Delpeuch
c9395d564c Merge branch 'develop/1086-quotecharacter' of https://github.com/stundzig/OpenRefine into stundzig-develop/1086-quotecharacter 2018-02-03 07:56:30 +00:00
Isao Matsunami
adf015c9ed Translated using Weblate (Japanese)
Currently translated at 100.0% (675 of 675 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2018-02-02 15:24:40 +01:00
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Antonin Delpeuch
47f44b06c4 Make Codacy happy 2018-02-02 11:57:20 +00:00
Antonin Delpeuch
1f87a26f4c Include image file names like templates in Wikitable importer 2018-02-02 11:22:15 +00:00
Antonin Delpeuch
843641ca74 Parse headers just like other cells in Wikitable importer
This makes the column names a bit less meaningful,
but this is necessary to handle cases where headers
are inserted anywhere in the table.
2018-02-02 10:48:31 +00:00
Owen Stephens
cd58557424
Merge pull request #1428 from OpenRefine/issue1351
Fix overflow issue in data extension dialog
2018-01-31 13:17:51 +00:00
Antonin Delpeuch
0426704938 Add helper createProjectWithColumns 2018-01-27 13:58:06 +00:00
Antonin Delpeuch
feae25a5ff Migrate more tests to the createCSVProject helper 2018-01-27 13:45:44 +00:00
Antonin Delpeuch
8f9fc61046 Migrate TextSearchFacetTests.java to use the helpers 2018-01-27 13:45:44 +00:00
Antonin Delpeuch
5278e929a2 Refactor CrossFunctionTests' project creating logic into RefineTest 2018-01-27 13:45:44 +00:00
Isao Matsunami
b6521e91e5 Translated using Weblate (Japanese)
Currently translated at 100.0% (671 of 671 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2018-01-26 19:45:51 +01:00
Owen Stephens
c0fda7de8c Removed h3 tag and related styling 2018-01-17 09:56:11 +00:00
Owen Stephens
af3aa44e6c Tidy up for codacy 2018-01-16 18:27:13 +00:00
Owen Stephens
9cf379e625 Add show/hide toggle and some style adjustments 2018-01-16 17:43:55 +00:00
Owen Stephens
a9be18d9df Remove div no longer needed 2018-01-16 17:43:55 +00:00
Owen Stephens
91edc810a7 Removed unused code 2018-01-16 17:43:55 +00:00
Owen Stephens
f1d23f9e3b Add/update text strings 2018-01-16 17:43:55 +00:00
Owen Stephens
4320ef8c10 Resolved merge conflict 2018-01-16 17:41:56 +00:00
Owen Stephens
5acdb1429c Fix tests - Include new httpHeaders JSON array when creating new ColumnAdditionByFetchingURLsOperation 2018-01-16 17:22:48 +00:00
Owen Stephens
7464e83766 Get and set any http headers submitted when using Add Column by Fetching URLs 2018-01-16 16:54:11 +00:00
Owen Stephens
4fb1867980 Option to add http headers in Add column by fetching URLs - support adding list of headers in backend, and exposing these in UI for user to edit and use 2018-01-16 16:54:11 +00:00
Owen Stephens
34e83fa98c Initial work to add option to set http headers in Add column by fetching URLs 2018-01-16 16:54:11 +00:00
Jacky
9ab897cb72 remove copyright and put more clear description 2018-01-15 20:27:25 -05:00
Jacky
3c25647f05 add find function. issue 1296 2018-01-14 22:04:26 -05:00
José Hisse
ee6edeaf2b Translated using Weblate (Portuguese (Brazil))
Currently translated at 98.6% (660 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2018-01-13 14:39:19 +01:00
Antonin Delpeuch
6f895b9873 Fix overflow issue in data extension dialog.
Closes #1351.
2018-01-12 09:38:45 +00:00
Thad Guidry
ca35d0d657
Merge pull request #1426 from olleolleolle/fix/spelling-in-test-data-nobel-prize-winners
Nobel prize winners CSV data typos
2018-01-07 14:38:39 -06:00
Olle Jonsson
76fa942490 Nobel prize winners CSV data typos 2018-01-07 21:28:07 +01:00
Olle Jonsson
5e075b09a4 Reconciliation panel: spelling of JS property 2018-01-07 21:16:33 +01:00
José Hisse
9bdbb60e27 Translated using Weblate (Portuguese (Brazil))
Currently translated at 99.1% (663 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2018-01-07 10:55:43 +01:00
Weblate
6a63bdb235 Merge remote-tracking branch 'origin/master' 2018-01-07 01:50:11 +01:00
José Hisse
0199e1a93c Translated using Weblate (Portuguese (Brazil))
Currently translated at 99.1% (663 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2018-01-07 01:50:10 +01:00
Olle Jonsson
6e45ee4af1
about page: closing LI tags 2018-01-07 00:21:32 +01:00
José Hisse
be312e3457 Translated using Weblate (Portuguese (Brazil))
Currently translated at 99.7% (667 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2018-01-05 18:16:05 +01:00
José Hisse
669159cae2 Translated using Weblate (Portuguese (Brazil))
Currently translated at 100.0% (669 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/pt_BR/
2018-01-05 16:47:34 +01:00
Jacky
9cbbbc6ca1
Merge pull request #1415 from OpenRefine/issue1381
Fix URI encoding of flyout parameters
2018-01-03 20:18:50 -05:00
Antonin Delpeuch
7459a00171 Fix js warning in data extension 2018-01-04 01:40:24 +01:00
Antonin Delpeuch
45ccd0e1c0 Change HTTP error detection in URL fetching test 2018-01-03 22:44:32 +01:00
Antonin Delpeuch
c9c9ee7509 Fix URI encoding of flyout parameters
Closes #1381
2018-01-03 21:36:19 +01:00
Antonin Delpeuch
dae4ac1ce4 Simpler way to pass the test when there are 503 errors 2018-01-03 19:03:26 +01:00
Antonin Delpeuch
32b7d2fa74 Looser check for 403 and 503 errors in URL caching test 2018-01-03 18:57:34 +01:00
Antonin Delpeuch
f14543bfca Fix URL caching test on Appveyor 2018-01-03 18:52:12 +01:00
Isao Matsunami
a056b1c750 Translated using Weblate (Japanese)
Currently translated at 100.0% (669 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2017-12-27 20:23:47 +01:00
anonymous
f864964ecb Translated using Weblate (Japanese)
Currently translated at 100.0% (669 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2017-12-27 09:54:09 +01:00
Isao Matsunami
eaf1b34361 Translated using Weblate (Japanese)
Currently translated at 100.0% (669 of 669 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2017-12-27 09:52:08 +01:00
Antonin Delpeuch
61f18c20cd
Merge pull request #1399 from isaomatsunami/patch-1
Update translation-jp.json for 2.8
2017-12-27 09:44:35 +01:00
Antonin Delpeuch
94b9d57528
Merge pull request #1397 from tiagofernandez/save-import-options
Revert 278f24c1 and adapt 0001d9f7 (ref. PR #1387)
2017-12-27 09:44:19 +01:00
Isao Matsunami
7ee97083d1
Update translation-jp.json
Reconcileを「照合」に統一。一部で英語を併記。
2017-12-26 20:50:46 +09:00
Isao Matsunami
8d118d7027
Update translation-jp.json
Reconcileの訳語を「照合」に統一
2017-12-26 19:43:32 +09:00
Isao Matsunami
33e107d4eb
Update translation-jp.json
Some items are added for 2.8. Some are changed not to break the original layout.
The following 2 pages are hard-coded in English?
1) import from Google Data
2) parse type for PC-AXIS text files
2017-12-26 14:00:32 +09:00
Tiago Fernandez
00faf2a179 Revert 278f24c1 and adapt 0001d9f7 (ref. PR #1387) 2017-12-24 12:48:23 +01:00
Jacky
e5709efd46 fix issue #1341 2017-12-24 00:04:16 -05:00
Jacky
fb3620b3d9
Merge pull request #1388 from jackyq2015/issue/1386
Fix Issue #1386
2017-12-21 08:26:29 -05:00
Jacky
6c06424183
Merge pull request #1390 from jackyq2015/issue/1389
fix Issue #1389
2017-12-21 08:26:09 -05:00
Jacky
9107a0eb91 remove commented code 2017-12-21 08:24:29 -05:00
Jacky
add2eb936c Merge branch 'issue/1386' of https://github.com/jackyq2015/openrefine into issue/1386 2017-12-21 08:23:01 -05:00
Jacky
e1a494aabd remove the print 2017-12-21 08:22:44 -05:00