Commit Graph

174 Commits

Author SHA1 Message Date
Mathieu Saby
f0616eff79 Remove all columns at once and escape input 2019-08-09 02:03:58 +02:00
Mathieu Saby
7836e5b2db Fix grammar and use callbacks 2019-08-07 23:20:28 +02:00
Mathieu Saby
27d5fb88fa Init commit 2019-08-04 15:32:36 +02:00
Felix Lohmeier
2c266d3f20 renamed new facets in menu All 2019-03-11 20:33:51 +01:00
Felix Lohmeier
9c55c7e121 fix facet by blank (switched true/false) 2019-03-08 20:51:14 +01:00
Felix Lohmeier
2db567ab0f added facet "Count non-blank records/column" to menu All 2019-03-08 20:26:18 +01:00
Felix Lohmeier
229b049f23 added facet "Count non-blank values/column" to menu All 2019-03-08 20:25:38 +01:00
Felix Lohmeier
4bdc0b6fb3 added facet by blank to menu All 2019-03-08 20:22:36 +01:00
Antonin Delpeuch
79394b9c0e
Merge pull request #1959 from OpenRefine/issue1943
Show reconciliation previews on hover of reconciliation candidates
2019-02-27 10:57:18 +00:00
Antonin Delpeuch
7f6831523e
Merge pull request #1969 from OpenRefine/revert-1888-fix-reconcile-facets
Revert "Fix Reconcile facets affected by change to list facet boolean handling"
2019-02-27 10:33:21 +00:00
Antonin Delpeuch
5dcd4a2f38 Add cell-ui.previewMatchCells=false preference to disable hover 2019-02-27 10:32:57 +00:00
Antonin Delpeuch
70094f68b2
Merge pull request #1958 from OpenRefine/issue1934
Make suggest items clickable with the middle button.
2019-02-25 10:30:31 +00:00
Antonin Delpeuch
9cc481dcdc Make hover more stable on reconciliation candidates 2019-02-23 09:18:18 +00:00
Antonin Delpeuch
2bfc268e69 Revert "Merge pull request #1666 from ostephens/list-facet-changes"
This reverts commit 29a818f7b4, reversing
changes made to 1189cdb4f9.
2019-02-22 18:38:45 +00:00
Antonin Delpeuch
7205da734a
Revert "Fix Reconcile facets affected by change to list facet boolean handling" 2019-02-22 18:28:40 +00:00
Antonin Delpeuch
4344b2474c Remove buttons when previewing a matched cell 2019-02-19 16:56:07 +00:00
Antonin Delpeuch
c509dd3847 Show reconciliation previews on hover of reconciliation candidates and matches.
Closes #1943.
2019-02-19 16:46:24 +00:00
Antonin Delpeuch
b068e18ada Make suggest items clickable with the middle button.
Clicking on an item with the middle button leads the user to the page
for this item. This lets users inspect items without selecting them.
Closes #1934.
2019-02-19 14:37:11 +00:00
Antonin Delpeuch
9ff27b7861 Fix untranslated string in UI. Closes #1942. 2019-02-19 12:45:21 +00:00
Owen Stephens
700850a5f7 Add Common transform which replaces smart quotes with ascii equivalent 2018-12-09 11:03:11 +00:00
Owen Stephens
8e247b83e0 Fix Reconcile facets affected by change to list facet boolean handling 2018-12-05 15:22:28 +00:00
Antonin Delpeuch
5a4a79028f Revert "data package metadata (#1398)"
This reverts commit c4b0ff6bea.
2018-11-30 19:35:31 +09:00
Antonin Delpeuch
29a818f7b4
Merge pull request #1666 from ostephens/list-facet-changes
List facet changes
2018-11-22 20:10:41 +00:00
Antonin Delpeuch
ccde661a27
Merge pull request #1835 from msaby/fixreplace
Fix regular expression option in replace menu. Closes #1834
2018-11-22 16:09:34 +00:00
Owen Stephens
90cd3dadd0 Ensure Facet by Star/Flag still work as expected 2018-11-22 15:07:41 +00:00
Owen Stephens
795d7232aa Update Custom facets that output a boolean to convert to string 2018-11-22 12:36:37 +00:00
Antonin Delpeuch
10931e1e4d Migrate js to new localization syntax 2018-11-21 17:30:00 +00:00
Antonin Delpeuch
9bf0bb2154 Merge JS i18n strings with slash 2018-11-21 15:24:57 +00:00
Mathieu Saby
2be4365550 Fix regex search in replace menu 2018-11-18 12:27:55 +01:00
Antonin Delpeuch
726960b410
Merge branch 'master' into replaceGUI 2018-10-14 22:12:25 +01:00
Mathieu Saby
5ff1b995ef Option for matching whole words
Replace Textareas with text Inputs and add labels.
Add an option for matching whole words
Change the behavior of escape option for replacement text:
if checked, \n and \t have a special meaning (newline and tab),
and \\n and \\t must be used for "backslash and n" and "backslash and t"
but other character are escaped : \ means \, \\ means \\, \r means \r etc.
2018-10-14 22:40:31 +02:00
Antonin Delpeuch
61928a671b Codacy cleanup 2018-10-05 10:27:09 +01:00
Antonin Delpeuch
610a8b3100 UI for UseValuesAsIdentifiers operation 2018-10-02 12:32:46 +01:00
Mathieu Saby
4a49691a4e Deplace menu and simplifiy UI 2018-09-25 08:14:32 +02:00
Mathieu Saby
338fa585d3 Add menu for searching and replacing
Add a new menu "Replace" in "Edit Cells" > "Common Transforms" and a new interaction box for entering parameters.
Under the hood this is a wrapper around GREL replace() function.
The behavior is the same as replace() except the automatic backslah escaping of "Replace with" parameter.
The 2 main parameters in the box are 2 textaras : "Find" and "Replace with"
2 cumulative options are available for "Find" parameter : "Case insensitive" and "Regular Expression"
1 option is available for "Replace with" parameter : "Do not escape backslash automatically"
A validity control of the pattern is made when "Regular expression" is checked.
2018-09-23 22:12:12 +02:00
Antonin Delpeuch
4352e2b1ec Improve facet expression for type match. Closes #1667. 2018-08-15 11:48:47 +01:00
Antonin Delpeuch
b55d66b8f3 Forward types supplied by reconciliation service when matching filtered cells 2018-04-25 10:12:36 +02:00
Antonin Delpeuch
3fcde510f9 Migrate "Match all filtered cells" to use standard reconciliation services
Closes #1376.
2018-04-23 17:33:04 +02:00
Owen Stephens
4c19a3170e Fixed syntax error 2018-04-19 14:45:14 +01:00
Owen Stephens
9c05326573 Added option to toggle show/hide null values in cells in data-table 2018-04-19 12:00:38 +01:00
Vern1erCa11per
a27a23196c fix #1565 fix reorder with rows mode 2018-04-13 19:32:46 +09:00
Antonin Delpeuch
8943ef9390 Merge branch 'facet-by-null-and-empty-string' of https://github.com/joanneong/OpenRefine into joanneong-facet-by-null-and-empty-string 2018-04-04 17:37:51 +02:00
Owen Stephens
b220354284 Added display of null in data table view 2018-03-17 16:55:46 +00:00
Joanne
0b64f9d232 Update facet by blank 2018-03-17 22:28:38 +08:00
Joanne
64b01a2319 Add logic for new customized facets 2018-03-16 23:05:00 +08:00
Owen Stephens
a8b5052b00 Add "Blank out cells (empty string)" to common transformations menu 2018-02-18 23:35:00 +00:00
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Owen Stephens
c0fda7de8c Removed h3 tag and related styling 2018-01-17 09:56:11 +00:00
Owen Stephens
9cf379e625 Add show/hide toggle and some style adjustments 2018-01-16 17:43:55 +00:00
Owen Stephens
4fb1867980 Option to add http headers in Add column by fetching URLs - support adding list of headers in backend, and exposing these in UI for user to edit and use 2018-01-16 16:54:11 +00:00