Commit Graph

699 Commits

Author SHA1 Message Date
Antonin Delpeuch
b6e9ace597 Temporary fix for HTTP 500 errors from Wikibase. Closes #1746 2018-09-25 19:37:40 +01:00
Antonin Delpeuch
f094c7e23a Exclude redundant jars from database and gdata extensions 2018-09-22 18:04:02 +01:00
Antonin Delpeuch
efddca61af Revert Jackson upgrade on database extension 2018-09-22 14:04:23 +01:00
Antonin Delpeuch
0321e19fef Unify google library versions 2018-09-22 10:43:12 +01:00
Antonin Delpeuch
fc70852183 Update version to 3.1-SNAPSHOT 2018-09-21 12:28:13 +01:00
Antonin Delpeuch
ed1db2242a Exclude local libraries from packages to save space 2018-09-21 10:02:45 +01:00
Antonin Delpeuch
c812b6118c Cleanup most Eclipse config files 2018-09-18 14:51:27 +01:00
Antonin Delpeuch
8a9022c631 Merge Jacoco coverage reports into one unique report. 2018-09-16 20:31:02 +01:00
Antonin Delpeuch
d421fd7fbf
Merge pull request #1729 from OpenRefine/json-engineconfig
Store engine configuration in dedicated class
2018-09-16 18:51:41 +01:00
Antonin Delpeuch
782ae4e788 Revert "Revert "Migrate to Maven""
This reverts commit c20918b73d.
2018-09-16 15:34:47 +01:00
Jacky
c20918b73d
Revert "Migrate to Maven" 2018-09-16 10:16:50 -04:00
Jacky
e3813d9820
Merge pull request #1725 from OpenRefine/maven
Migrate to Maven
2018-09-15 21:45:12 -04:00
Antonin Delpeuch
9b659c618c Cleanup classpath generation in Maven config files 2018-09-11 15:18:03 +01:00
Antonin Delpeuch
df53cf9117 Exclude javax.servlet in Gdata extension, conflicts with existing version 2018-09-11 11:30:18 +01:00
Antonin Delpeuch
6c42a2aba9 Cleanup copied libs along with class files 2018-09-11 11:14:15 +01:00
Antonin Delpeuch
c12502aaae Use dependency plugin to copy runtime lib to MOD-INF dirs 2018-09-11 10:55:29 +01:00
Antonin Delpeuch
5a0304f363
Merge pull request #1722 from OpenRefine/json-testing
Add serialization tests for most Jsonizable classes
2018-09-10 15:35:25 +01:00
Antonin Delpeuch
1c20242d40 Replace version and groupId by variables in submodules 2018-09-10 15:33:30 +01:00
Antonin Delpeuch
e589697171 Remove Ant configuration files 2018-09-10 15:13:26 +01:00
Antonin Delpeuch
9b54ac2bd2 Remove jars of dependencies 2018-09-10 15:11:21 +01:00
Antonin Delpeuch
aa5088d7bf Disable tests for pc-axis and gdata extensions 2018-09-10 13:48:52 +01:00
Antonin Delpeuch
1184528098 Fix Database extension testing for Maven 2018-09-10 13:37:51 +01:00
Antonin Delpeuch
2f2fa86800 Fix Wikidata extension testing for Maven 2018-09-10 11:27:14 +01:00
Antonin Delpeuch
60d4656176 Add missing mockito dependency and fix maven invocation 2018-09-10 09:50:44 +01:00
Antonin Delpeuch
72639fdd71 Fix classpath generation 2018-09-09 19:31:33 +01:00
Antonin Delpeuch
e846df0b9d Migrate custom jars to install-plugin 2018-09-09 17:30:28 +01:00
Antonin Delpeuch
ed76375a01 Add Maven configuration for the sample extension 2018-09-07 11:27:28 +01:00
Antonin Delpeuch
86d9a91db1 Add Maven configuration for pc-axis extension 2018-09-07 11:27:28 +01:00
Antonin Delpeuch
f14bd18a7b Add Maven configuration for gdata extension 2018-09-07 11:27:28 +01:00
Antonin Delpeuch
94220ad880 Maven configuration for the database extension 2018-09-07 11:27:28 +01:00
Antonin Delpeuch
3e0efc47fd Add Maven configuration for Jython extension 2018-09-07 11:27:28 +01:00
Antonin Delpeuch
25e14cfe87 Working Maven config for the Wikidata extension 2018-09-07 11:27:28 +01:00
Antonin Delpeuch
fbc9b27640 Store engine configuration as EngineConfig rather than JSONObject 2018-09-05 14:49:39 +01:00
Antonin Delpeuch
a2c0ac9bcc Drop Jsonizable for DatabaseModuleImpl, not needed 2018-09-01 12:42:05 +02:00
Antonin Delpeuch
f15052676f
Translated using Weblate (French)
Currently translated at 99.3% (143 of 144 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/fr/
2018-08-31 15:16:45 +02:00
Antonin Delpeuch
e8c2a16b85
Added translation using Weblate (French) 2018-08-30 11:43:19 +02:00
Isao Matsunami
f16bee8642
Translated using Weblate (Japanese)
Currently translated at 100.0% (144 of 144 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ja/
2018-08-30 00:34:33 +02:00
Isao Matsunami
6dbb51679c
Translated using Weblate (Japanese)
Currently translated at 100.0% (45 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/
2018-08-29 12:39:48 +02:00
Isao Matsunami
96045f0c19
Translated using Weblate (Japanese)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/
2018-08-29 12:39:37 +02:00
Isao Matsunami
0a2952e446
Translated using Weblate (Japanese)
Currently translated at 100.0% (144 of 144 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/ja/
2018-08-29 05:04:35 +02:00
Isao Matsunami
ccfa51cee3
Translated using Weblate (Japanese)
Currently translated at 100.0% (45 of 45 strings)

Translation: OpenRefine/gdata
Translate-URL: https://hosted.weblate.org/projects/openrefine/gdata/ja/
2018-08-28 11:38:25 +02:00
Antonin Delpeuch
0b9c4b6abb
Merge pull request #1682 from OpenRefine/issue1680
Fix snak grouping for qualifiers and references in Wikidata extension.
2018-07-29 16:23:26 +01:00
Owen Stephens
fd69149dbe
Merge pull request #1685 from OpenRefine/issue1683
Fix aliases rendering in Wikidata schema
2018-07-29 11:54:13 +01:00
Antonin Delpeuch
f9fd26ab6e Fix aliases rendering. Closes 1683. 2018-07-20 09:15:26 +01:00
Antonin Delpeuch
cb43ca2454 Fix snak grouping for qualifiers and references in Wikidata extension.
Closes #1680.
2018-07-17 16:35:12 +01:00
Antonin Delpeuch
492a42a3c3 Save the schema before exporting to QuickStatements. Closes #1659. 2018-07-13 18:21:38 +01:00
Antonin Delpeuch
bd2865585d
Merge pull request #1647 from OpenRefine/fix-date-precision
Change default precision of Wikibase dates to match the UI's defaults.
2018-06-22 12:22:32 +02:00
Antonin Delpeuch
b3ee80d504
Merge pull request #1655 from OpenRefine/new-scope-constraint
Migrate to new scope constraint format
2018-06-22 12:22:08 +02:00
Antonin Delpeuch
35b08bf254
Merge pull request #1644 from OpenRefine/more-constraints
Add support for new Wikidata constraints
2018-06-22 12:21:29 +02:00
Jacky
5a6c9d72f0 fix the template load issue and package typo 2018-06-16 15:43:29 -04:00
Antonin Delpeuch
8469728bb5 Update tests and localization 2018-06-15 11:07:59 +01:00
Antonin Delpeuch
bbc5936da6 Migrate to new scope constraint format 2018-06-15 10:54:26 +01:00
Antonin Delpeuch
d7564a4690 Change default precision of Wikibase dates to match the UI's defaults. 2018-06-13 15:37:51 +01:00
Antonin Delpeuch
b87a52195c Cleanup for Codacy 2018-06-11 09:19:34 +01:00
Antonin Delpeuch
ab3adc0329 Remove empty tests 2018-06-10 09:30:06 +01:00
Antonin Delpeuch
1910833ad8 Add entity type constraint check 2018-06-10 09:24:22 +01:00
Antonin Delpeuch
e2ae09f5be Add support for Wikidata single best value constraint 2018-06-10 08:17:42 +01:00
Antonin Delpeuch
ddbe4fe2a2 Fix unit checking with novalue claims 2018-06-10 08:17:39 +01:00
Antonin Delpeuch
4bb3505aa5 Add English descriptions of new issues 2018-06-10 08:17:36 +01:00
Antonin Delpeuch
48c2b90a93 Add constraint checks for one-of and none-of constraints 2018-06-10 08:17:33 +01:00
Antonin Delpeuch
3c181c9070 Add support for symmetric constraint 2018-06-10 08:17:30 +01:00
Antonin Delpeuch
9cb4a46277 Add support for quantity-related constraints in Wikidata QA 2018-06-10 08:17:24 +01:00
Jacky
9a469fce17 add timeout support 2018-05-28 23:21:44 -04:00
Antonin Delpeuch
c84f2e35c7
Merge pull request #1615 from isaomatsunami/master
Added Japanese files for 3 extentions
2018-05-22 23:56:45 +02:00
Antonin Delpeuch
1d6226b095
Merge pull request #1594 from OpenRefine/wikidata/better-format-feedback
Give better feedback when values with invalid formats are provided.
2018-05-22 23:56:24 +02:00
Isao Matsunami
3b0902204a
Update translation-jp.json 2018-05-19 02:46:18 +09:00
Isao Matsunami
21c31d5c50
updated a file for Japanese 2018-05-19 02:05:10 +09:00
Isao Matsunami
c65daabcf4
updated a file for Japanese 2018-05-19 02:04:40 +09:00
Isao Matsunami
5bdcfddc95
added a file for Japanese 2018-05-19 02:04:10 +09:00
Antonin Delpeuch
844e288955 Fix inverse constraint test for Wikidata extension.
The inverse constraint on the part of property was removed.
2018-05-18 10:52:48 +02:00
Antonin Delpeuch
811b96551c Fix failing test in WbDateVariable 2018-05-06 18:29:07 +02:00
Antonin Delpeuch
484ae48c95 Give better feedback when values with invalid formats are provided. 2018-05-06 18:03:28 +02:00
Antonin Delpeuch
ee59a5037c Add test for numeric cells in Wikibase date parsing 2018-04-28 11:26:22 +02:00
Antonin Delpeuch
97e16d6e8e Add number of edits in preview and upload dialog 2018-04-28 11:25:49 +02:00
Antonin Delpeuch
f9a1a5ba18 Cleanup vocabulary for export (perform -> upload) in Wikidata extension 2018-04-28 10:56:51 +02:00
Antonin Delpeuch
68d9f448c6 Style tweaks to the Wikidata schema UI 2018-04-28 10:55:15 +02:00
Antonin Delpeuch
ff59ed7bb6 Parse dates in UTC in Wikidata extension 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
adfa60ef14 Fix scrolling in Wikidata schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
60db2828a8 Add spinner to indicate that Wikidata preview is in progress 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
5fda43a5c7 Make edit summaries mandatory 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
2d549b79f1 Prevent double clicks with e.preventDefault in Wikidata schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
c71bc9096c Cache results in datavalue rendering 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
3bf3f84ca6 Cap number of terms and statements displayed in the preview 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
cb81da0923 Fix display of column variables in the schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
30defdd2c4 Add save and discard buttons on the Wikidata schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
0c21d6d171 Refuse reconciled cells with invalid space 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
d6232efd95 Refresh the column variables when changes are made 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
02f908b827 Fix appearance of inputs in Firefox for Wikidata schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
eed1049df3 Add schema unsaved warning 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
d8d7e82be1 Restore preview tab 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
41eb14f3c0 Move the schema and issues to their own tabs in the main UI 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
21436340cd Add more client-side field validation 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
0961ff2949 Refuse empty strings in Wikidata schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
b1e368e7a8 Infer precision from engineering notation of quantity values 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
ec6d0eec64 Add workaround for issue in QuantityValue serialization.
https://github.com/Wikidata/Wikidata-Toolkit/issues/341
2018-04-27 09:17:33 +02:00
Antonin Delpeuch
81a18777cb Replace QS preview by visual preview of the edits 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
2779eb97da Add colors to signal when a suggest input has been validated or not 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
a4ece8ef6a Prettify the schema UI 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
6e4dfe67af Fix bug conflating new items 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
112f3f9308 Fix tests 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
8fab42ce8f Add error message when saving an incomplete schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
1d5ffddf90 Cleanup console.log 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
7ded62d78e Fix UI for quantity values 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
9583053b1b Fix Codacy issues 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
2b8ef7a9ae Improve rendering of suggest fields in Firefox 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
761f885348 Fix missing label for QS export 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
54b25d714b Speed up parsing and tweak edit comment 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
1eaaa00824 Fix typo 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
e9ce0fa59c Flatten scrutinizer hierarchy, optimize schema deserialization 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
46964862bc Change format of edit batch id 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
68e0a899b8 Use logger for JSON exception 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
7f1cfd2db7 Address review comments 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
580c0bed80 Fix ConnectionManager and add test for LoginCommand 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
3a58c6824d Prettify the UI and add a token to the edit summaries 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
999b1d4920 Update snapshot of WDTK 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
0b14a1a627 Add license headers, general cleanups on Java files 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
d6b229f25e Add support for all Wikibase datatypes 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
03c7674858 Fix siteIRI of new item ids (switch to SITE_LOCAL) 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
975c3529cb Add UI support for quantity values and tidy up interface 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
15ba7fbdde Schema editing cleanup 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
6cb4386e64 Tweak the schema alignment UI 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
6b658fe87e Some rudimentary testing of operations and changes 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
a002468e7d Better testing of the editing process 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
773be2e161 Introduce a rewriter to update references to new items after creation 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
7cb8757028 Test the commands 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
973a28cc90 Test the scrutinizers 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
fd7462f749 Testing for QuickStatements exporter 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
bb044612e0 Introduce a scheduler package to reorganize item updates 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
88178d7c04 Refactor ItemUpdate and introduce ItemUpdateBuilder 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
e0cdb91520 Better testing for the schema package 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
6f9636176b Add a lot of tests in the schema 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
7cae9455da Test (and fix) ReconEntityIdValue 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
b48c78a617 Refactor and test QS value printing 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
1837926cb1 Add quantity expressions in the backend 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
487547bd27 Finish localization of the wikidata extension 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
d3023008e9 Localize perform edits dialog 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
9489cc95f0 Split js files for issues rendering 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
9513807a83 Display issues in perform edits dialog 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
1c51b32458 Fix storage of Wikibase credentials, to be updated with better serialization later on 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
ab642a52a1 Explicitly add server tests dir in classpath 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
056d0d18b0 Update JSONWriter constructor for the newer version 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
305c3a7bb9 Update WDTK jars with latest features 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
708ff44f2f Check for language code validity in WbLanguageVariable 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
75b1863c1c Testing for variables which generate wikibase values 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
fffd31382e Ignore unknown fields in schema JSON deserialization 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
8b1869414d Improve styling of schema alignment dialog 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
c845105a39 Cleanup JSON serialization and rename WbValueExpr to WbExpression 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
b99b72b071 Refactor schema expressions 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
a476b2bf0a Restore progress computation 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
0a18d61372 Request items by batches instead of one-by-one 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
54acac491d Fix EntityIdValue generation from Recon: discard nones 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
22c1d5dd9b Edit as bot by default 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
8cc282a502 Fix null pointer exception in NewItemLibrary 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
ad9d7f9f0e Update wdtk to newer snapshot 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
699ec16082 Report duplicate items in DistinctValuesScrutinizer 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
212b1b3dd3 Fix siteIRI of ReconEntityIdValues 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
784e866b4e Add scrutinizer for whitespace issues 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
42d9ca0393 Add explicit @JsonProperty decorators in schema classes 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
93883fd777 Add warning for monolingual exprs without language 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
69bfad6a47 Change architecture of custom EntityIdVales 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
43f0348ee9 Fix TermedEntityIdValue hashing 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
30ce8680c5 Add architecture to emit warnings during evaluation too 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
2687741263 Fix exceptions when constraints are not or incorrectly provided 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
6c6151ca43 Skip empty strings as values in the schema 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
bf7000e601 Move exceptions to own package 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
5d9aa9cae5 Add distinct values scrutinizer 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
7518d194f0 Display the number of issues in the tab header 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
1cf9378523 Add explanations on remaining scrutinizers 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
024c8cd6a5 Fix equality check on custom EntityIdValues 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
45bc328675 Add issue details on inverses and qualifier checks 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
e920c0f421 Add info issues for empty edits and no warnings 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
5891f8c270 Fix ItemIdValue generation from project to pass on terms 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
d4cb64cdfd Fix EntityCache so that it actually caches stuff 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
63d488d74f Add properties to format scrutinizer 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
abc51235c6 Add infrastructure to let scrutinizers report more details 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
c844742395 Introduce custom EntityIdValues to store localized labels 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
1ea1377734 Simply the scrutinizer architecture 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
132af25b4a Add single value scrutinizer 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
46b3e41bb7 Update tests to use PropertyIdValue 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
0a0aacb0cd Move pids from Strings to PropertyIdValues, cleaner 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
fea53aa900 Add wikidata tests to extensions/build.xml 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
316ee86e1a Add scrutinizer for allowed and mandatory qualifiers 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
283661956b Add support for snak location constraints 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
142eeabfeb Add unsourced scrutinizer 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
665585add9 Add self-referential scrutinizer 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
d347e5091f Add cached constraint fetcher and tests 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
508e9d22ad Add inverse constraint scrutinizer 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
0d5875b35b Add format scrutinizer 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
b5f2085038 Reorganize scrutinizers to simplify the methods 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
2795a54ea2 Start localization of the Wikidata extension 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
af4df335de Draft of warnings UI 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
990a404c76 Foundations of the edit inspector backend 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
38176189e4 gitignore for wikidata extension 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
9a3093b045 Fix terms serialization 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
497505eef1 Add serialization tests for Wikidata schema 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
a609d3786d Fix tests setup for Wikidata extension 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
a3db1898c6 Set up tests for wikidata extension 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
de224bb89a Add JacksonJsonizable 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
955bb409bc Migrate schema expressions to Jackson 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
989263d212 Improve Wikidata login screen 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
f6eceefd8e Improve support for terms in schema 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
5e99e0d2e3 Let the user specify an edit summary 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
5faa432aa6 Start storing user credentials in OpenRefine's preferences 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
7a6e4f49b1 Update Wikidata Toolkit 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
34568ca9b1 Initial support for creation of new items in Wikidata 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
4076f088f3 Update Wikidata-Toolkit to include new features 2018-04-27 09:17:31 +02:00
Antonin Delpeuch
72939711e8 Restrict suggested languages for Wikidata monolingual texts 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
9f955c40ae Add support for names and descriptions 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
07e2a8d982 Add support for monolingual text in Wikibase schema 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
b326346fa3 Fix order of qualifiers in SnakGroup generation 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
ddceec4d27 Cleanup and UI tweaks 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
165ff41469 Support for dates and coordinates in Wikibase schema 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
8f4d998e21 Support for Wikidata editing from OpenRefine 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
67e5bcd504 Some UI cleanup for the schema alignment interface 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
23355eb472 Add reference support in Wikibase schema editor 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
68122b2b27 Fix qualifier addition ànd serialization 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
a1018dba6b Fix extensions/build.xml 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
66b3ddf76b Add support for qualifiers 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
c0f2468236 Restrict QS export to filtered rows 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
9fcdbc31e9 Initial support for item creations 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
f763e8c6ad Shorter QuickStatements preview and better export UI 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
035e7b82bc Add missing build and config files for Wikidata extension 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
781c3b0467 Support for properties with varying target datatype 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
fcde3d2c7d Add QuickStatements export and preview 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
975542bff1 Restore schema in UI after save 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
decef38f85 Synchronize schema storage and UI behaviour. 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
3fd71965fa Move wikidata-specific dependency to own .classpath 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
e38aeb7ba5 JSON serialization of schema to model 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
82930da4db First draft of the schema alignment dialog 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
5853cdf10d Wikibase schema serialization and related operation 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
ad475849b9 Start schema classes 2018-04-27 09:17:30 +02:00
Antonin Delpeuch
19a1e5e007 Start Wikidata extension based on Wikidata-Toolkit 2018-04-27 09:17:30 +02:00
Jacky
cf573f37de fix the NPE when there is no fusion table exists 2018-03-06 18:16:29 -05:00
Jacky
ac57eb813e changes based on code review 2018-03-06 18:10:54 -05:00
Jacky
6af7e6545c adjust timeout to 3 min 2018-03-01 22:48:14 -05:00
Jacky
77aad7eb05 changes based on the code review 2018-03-01 22:45:14 -05:00
Jacky
c758a6b635 exclude test-out 2018-02-25 12:00:40 -05:00
Jacky
a9a41c074a upgrade the google api client 2018-02-02 13:08:29 -05:00
Jacky
efcbe4b718 upgrade the google api services 2018-02-02 13:04:27 -05:00
Jacky
c4b0ff6bea data package metadata (#1398)
* fix the appbundle issue #1209

* fix #1162

allow the JRE 9

* fix the package declarations

* remove the _ from the method name

* use the explicit scoping

* remote extra ;

* fix issued from codacy

* fix issued from codacy

* add preferences link to the index page

* handle the empty user metadata

* fix 'last modified' sorting issue #1307

* prevent overflow of the table. issue #1306

* add isoDateParser to sort the date

* prevent overflow of the project index

* remove sorter arrow for action columns

* disable editing the internal metadata

* adjust the width of the table

* change MetaData to Metadata

* change the filed name from rowNumber to rowCount

* put back the incidently deleted gitignore

* add double quote to prevent word splitting

* UI improvement on metadata view and project list view

* remove the date field in metadata

* message notification of the free RAM. Issue #1295

* UI tuning for metadata view

* shorten the ISO date to locale date format

* Added translation using Weblate (Portuguese (Brazil))

* remove the rename link

* Ignore empty language files introduced by Weblate

* Add UI for Invert text filter

* Backend support for Inverting Text search facets

* Fix reset on text search facet

* More succinct return statements

* add tests for SetProjectMetadataCommand

* Tidying up for Codacy

* Added Tests for TextSearchFilter

* Corrections for Codacy

* More code tidy up

* let the browser auto fit the table cell when resizing/zooming

* fix import multiple excel with mulitple sheets issue #1328

* check if the project has the userMetadata

* fix the unit test
support multi files with multi tables for open office

* prevent the same key for user metadata

* replace _ with variable for exception

* fix the no-undef issue

* to adjust the width of transform dialog. issue #1332

* fix the row count refresh issue

* extract method

* move the log message

* cosmatic changes for codacy

* fix typo

* bump to version 2.8

* .gitignore is now working

* preview stage won't have the metadata populated, so protect NPE

* Update README.md

No more direct link to the last version tag, which will avoid having to think of updating the readme

* refacotring the ProjectMetadata class

* introduce the IMetadata interface

* create submodule of dataschema

* add back

* setup lib for dataschema; upgrade the apache lang to lang3

* replace escape* functions from apache lang3

* replace the ProjectMetadata with IMetadata interface

* add missing jars

* set the IMetadata a field of Project

* remove PreferenceStore out of Project model

* fix test SetProjectMetadataCommandTests by casting

* introdcue the AbstractMetadata

* introdcue the AbstractMetadata

* reorganize the metadata package

* allow have mulitiple metadata for a project

* support for mulitple metadata format

* remove jdk7 since 'table schema' java implmentation only support jdk8+

* set execute permission for script

* fix the Unit Test after Metadata refactoring

* restore the apache lang2.5 since jetty 6.1.22 depend on it

* add commons lang 2.5 jar

* git submodule add  https://github.com/frictionlessdata/datapackage-java

* remove the metadata parameter from the ProjectManager.registerProject method

* remove hashmap _projectsMetadata field from the ProjectManager and FileProjectManager

* init the Project.metadataMap

* fix Unit Test

* restore the ProjectMetaData map to ProjectManager

* put the ProjectMetaDta in place for ProjectManager and Project object

* check null of singleton instead of create a constructor just for test

* load the data package metadata

* importing data package

* importing data package

* encapsulate the Package class into DataPackageMetadata

* user _ to indicate the class fields

* introduce base URL in order to download the data files

* import data package UI and draft backend

* import data package UI

* fix typo

* download the data set pointed from metadata resource

* save and load the data package metadata

* avoid magic string

* package cleanup

* set the java_version to 1.8

* set the min jdk to 1.8

* add the 3rd party src in the build.xml

* skip the file selection page if only 1 DATA file

* add files structure for json editor

* seperate out the metadata file from the retrival file list

* rename the OKF_METADATA to DATAPACKAGE_METADATA

* clean up

* implement GetMetadateCommand class

* display the metadata in json format

* git submodule update --remote --merge

* adjust the setting after pulling from datapackage origin

* fix the failed UT DateExtensionTests.testFetchCounts due to new json jar json-20160810.jar will complain: JSONObject["float"] not a string.

* clean up the weird loop array syntax get complained

* remove the unused constant

* export in data package format

* interface cleanup

* fix UT

* edit the metadata

* add UT for SetMetadataCommand

* fix UT for SetMetadataCommand

* display the data package metadata link on the project index page

* update submodule

* log the exceptions

* Ajv does not work properly, use the back end validation instead

* enable the validation for jsoneditor

* first draft of the data validation

* create a map to hold the constraint and its handler

* rename

* support for minLength and maxLength from spec

* add validate command

* test the opeation instead of validate command

* rename the UT

* format the error message and push to the report

* fix row number

* add resource bundle for validator

* inject the code of the constrains

* make the StrSubstitutor works

* extract the type and format information

* add the customizedFormat to interface to allow format properly

* get rid of magic string

* take care of missing parts of the data package

* implement RequiredConstraint

* patch for number type

* add max/min constraints

* get the constrains directly from field

* implement the PatternConstraint

* suppress warning

* fix the broken UT when expecting 2 digits fraction

* handle the cast and type properly

* fix the missing resource files for data package when run from command line

* use the copy instead of copydir

* add script for appveyor

* update script for appveyor

* do recursive clone

* correct the git url

* fix clone path

* clone folder option does not work

* will put another PR for this. delete for now

* revert the interface method name

* lazy loading the project data

* disable the validate menu for now

* add UT

* assert UTs

* add UT

* fix #1386

* remove import

* test the thread

* Revert "test the thread"

This reverts commit 779214160055afe3ccdcc18c57b0c7c72e87c824.

* fix the URLCachingTest UT

* define the template data package

* tidy up the metadata interface

* check the http response code

* fix the package

* display user friendly message when URL path is not reachable

* populate the data package schema

* Delete hs_err_pid15194.log

* populate data package info

* add username  preference and it will be pulled as the creator of the metadata

* undo the project.updateColumnChange() and start to introduce the fields into the existing core model

* tightly integrate the data package metadata

* tightly integrate the data package metadata for project level

* remove the submodule

* move the edit botton

* clean up build

* load the new property

* load the project metadata

* fix issues from codacy

* remove unused fields and annotation

* check the http response code firstly

* import zipped data package

* allow without keywords

* process the zip data package from url

* merge the tags

* check store firstly

* remove the table schema src

* move the json schema files to schema dir

* add comment

* add comment

* remove git moduels

* add incidently deleted file

* fix typo

* remove SetMetadataCommand

* revert change

* merge from master
2018-02-02 13:24:19 +00:00
Antonin Delpeuch
0d8659c652 Remove unit_tests.xml and rename others 2018-01-31 08:36:11 +00:00
Antonin Delpeuch
a8ed571f27 Enable Postgres on Appveyor 2018-01-27 18:08:04 +00:00
Antonin Delpeuch
2da07462ba Fix appveyor MySQL password 2018-01-27 17:52:23 +00:00
Antonin Delpeuch
6fdaab7724 Enable MySQL in Appveyor 2018-01-27 17:03:53 +00:00
Antonin Delpeuch
b5ffcd38fa Exclude tests which require a database by default; enable them on Travis 2018-01-27 16:36:33 +00:00
Antonin Delpeuch
b2b9a4bc9a Do not catch exceptions in tests; add database groups
The groups let us enable / disable tests for a specific db,
depending on which one is available on the machine.
2018-01-27 16:20:07 +00:00
Jacky
54e25408fb
Merge pull request #1414 from OpenRefine/issue1377
Expose fields as attributes in Jython
2018-01-26 13:14:10 -05:00
Stuart Kenny
43e62832dd Move context menu function from main script 2018-01-22 10:17:59 +00:00
Stuart Kenny
2c3be12269 Javascript error on project page from database extension 2018-01-22 10:09:59 +00:00
TonyO
a3ac35a296 database extension with classpath fix 2018-01-13 20:24:56 -06:00