Commit Graph

450 Commits

Author SHA1 Message Date
Antonin Delpeuch
4352e2b1ec Improve facet expression for type match. Closes #1667. 2018-08-15 11:48:47 +01:00
Jacky
5f4f2861de
Merge branch 'master' into fix/allow/nonnumerical/exportname 2018-07-07 14:18:04 -04:00
Sylvain Machefert
680221cff4
Total number of operations for Undo / Redo
Currently, if you revert to the first operation in your project history, you will see Undo / Redo 0. Opening an old project this morning I was confused and thought it was a new one because of this, but in fact I already had many operations on this project, it was just that before closing it I had viewed the file at first operation.

This PR proposes to change the display to Undo / Redo 1/n with n the total number of operations available.
2018-05-18 08:51:50 +02:00
Jacky
a103e1fb90 merge the translation 2018-05-16 15:40:05 -04:00
Antonin Delpeuch
c0e39f507a
Merge pull request #1530 from OpenRefine/wikidata-extension
Wikidata extension
2018-05-06 08:46:53 +02:00
Antonin Delpeuch
34941ce632
Merge pull request #1581 from OpenRefine/issue1376
Migrate "Match all filtered cells" to use standard reconciliation services
2018-05-06 08:46:03 +02:00
Antonin Delpeuch
41eb14f3c0 Move the schema and issues to their own tabs in the main UI 2018-04-27 09:17:33 +02:00
TonyO
0eb7b4082f added null and default value options 2018-04-26 20:50:46 -05:00
Antonin Delpeuch
b55d66b8f3 Forward types supplied by reconciliation service when matching filtered cells 2018-04-25 10:12:36 +02:00
Antonin Delpeuch
3fcde510f9 Migrate "Match all filtered cells" to use standard reconciliation services
Closes #1376.
2018-04-23 17:33:04 +02:00
Antonin Delpeuch
c77882ee3f Remove MQLWrite and Triple Loader exporters in the UI.
Closes #206.
2018-04-23 15:38:43 +02:00
Vern1erCa11per
38877f1449 fix #1578 enable export with filename composed of non-alphanumerical characters 2018-04-23 21:09:09 +09:00
TonyO
c7c0d8884a check empty cells 2018-04-22 00:39:11 -05:00
Owen Stephens
4c19a3170e Fixed syntax error 2018-04-19 14:45:14 +01:00
Owen Stephens
9c05326573 Added option to toggle show/hide null values in cells in data-table 2018-04-19 12:00:38 +01:00
Vern1erCa11per
a27a23196c fix #1565 fix reorder with rows mode 2018-04-13 19:32:46 +09:00
Antonin Delpeuch
eeef6055a0
Merge pull request #1525 from OpenRefine/google-api
Google api
2018-04-07 20:28:44 +02:00
Antonin Delpeuch
8943ef9390 Merge branch 'facet-by-null-and-empty-string' of https://github.com/joanneong/OpenRefine into joanneong-facet-by-null-and-empty-string 2018-04-04 17:37:51 +02:00
TonyO
223d16db39 added ignore facet and trim column name options 2018-03-25 21:01:53 -05:00
TonyO
3834c27c8f SQL Export Code Commit 2018-03-24 22:41:07 -05:00
Antonin Delpeuch
ced1316579
Merge pull request #1535 from OpenRefine/suggest-description
Tweak the suggest dialog to display descriptions
2018-03-21 08:46:11 +00:00
Owen Stephens
b220354284 Added display of null in data table view 2018-03-17 16:55:46 +00:00
Joanne
0b64f9d232 Update facet by blank 2018-03-17 22:28:38 +08:00
Joanne
64b01a2319 Add logic for new customized facets 2018-03-16 23:05:00 +08:00
Antonin Delpeuch
6b34af5042 Tweak the suggest dialog to display suggestions 2018-03-12 15:30:01 +00:00
Jacky
1866f9691d pass the limit as int from javascript 2018-03-04 00:49:55 +00:00
Antonin Delpeuch
b373ab6d0d
Revert "pass the limit as int from javascript" 2018-03-02 23:46:41 +00:00
Jacky
973b7b5f21 pass the limit as int from javascript 2018-03-02 17:09:33 -05:00
Jacky
c758a6b635 exclude test-out 2018-02-25 12:00:40 -05:00
Antonin Delpeuch
d798e4b071
Merge pull request #1465 from isaomatsunami/master
fixing layout
2018-02-22 09:48:23 +00:00
Owen Stephens
a8b5052b00 Add "Blank out cells (empty string)" to common transformations menu 2018-02-18 23:35:00 +00:00
isaomatsunami
91c6c6c791 fix layout 2018-02-09 03:53:11 +09:00
Owen Stephens
0d04a25cf1
Merge pull request #1450 from OpenRefine/issue1448
Make Wikitext importer more robust
2018-02-07 17:41:23 +00:00
Thad Guidry
c83dbe3b23
Merge branch 'master' into stundzig-develop/1086-quotecharacter 2018-02-03 07:20:45 -06:00
Antonin Delpeuch
86be1c12e8 Expose quote character setting in UI 2018-02-03 09:01:07 +00:00
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Antonin Delpeuch
843641ca74 Parse headers just like other cells in Wikitable importer
This makes the column names a bit less meaningful,
but this is necessary to handle cases where headers
are inserted anywhere in the table.
2018-02-02 10:48:31 +00:00
Owen Stephens
cd58557424
Merge pull request #1428 from OpenRefine/issue1351
Fix overflow issue in data extension dialog
2018-01-31 13:17:51 +00:00
Owen Stephens
c0fda7de8c Removed h3 tag and related styling 2018-01-17 09:56:11 +00:00
Owen Stephens
9cf379e625 Add show/hide toggle and some style adjustments 2018-01-16 17:43:55 +00:00
Owen Stephens
a9be18d9df Remove div no longer needed 2018-01-16 17:43:55 +00:00
Owen Stephens
91edc810a7 Removed unused code 2018-01-16 17:43:55 +00:00
Owen Stephens
4fb1867980 Option to add http headers in Add column by fetching URLs - support adding list of headers in backend, and exposing these in UI for user to edit and use 2018-01-16 16:54:11 +00:00
Owen Stephens
34e83fa98c Initial work to add option to set http headers in Add column by fetching URLs 2018-01-16 16:54:11 +00:00
Olle Jonsson
5e075b09a4 Reconciliation panel: spelling of JS property 2018-01-07 21:16:33 +01:00
Antonin Delpeuch
7459a00171 Fix js warning in data extension 2018-01-04 01:40:24 +01:00
Antonin Delpeuch
3c5a9b0754
Merge pull request #1357 from xseris/master
Tag system
2017-12-16 01:55:46 +00:00
xseris
ee8ed8f563 Refresh tag cell 2017-12-08 00:46:59 +01:00
xseris
b16941777e Modified tags in metadata dialog and moved column right to name 2017-12-07 23:45:36 +01:00
Owen Stephens
9a4cf5ca0a Re-organise reconcile menu, removing qaResult 2017-12-04 09:45:50 +00:00