Commit Graph

159 Commits

Author SHA1 Message Date
Antonin Delpeuch
ae41348e00 Fix bug with TODAY in Wikidata schema 2020-01-06 11:40:14 +01:00
Antonin Delpeuch
fe57897e8e Fix Wikidata login CSRF issue. Closes #2228. 2019-12-25 11:02:19 +01:00
Antonin Delpeuch
1355a373c9 Mock HTTP calls in EntityCache 2019-12-21 19:09:03 +01:00
Antonin Delpeuch
1f708637b6 Fix overflow error for quantities stored as doubles. Closes #2244. 2019-12-13 15:23:24 +01:00
Antonin Delpeuch
b19e8a9a74
Update Wikidata-Toolkit to solve various issues (#2215)
Updates Wikidata-Toolkit to 0.11.0

This enables the following improvements:
- https://github.com/Wikidata/Wikidata-Toolkit/issues/431
- https://github.com/Wikidata/Wikidata-Toolkit/issues/456

This closes #2196 although the feature will not be enabled until 3.4 for technical reasons
(the openrefine-3.3 tag on Wikidata can only be applied by an AbuseFilter, not manually through
the API).

* Update WDTK and add timeouts to Wikidata editing, closes #2211.

* Explicitly add wdtk-util as a dependency

* Catch MediaWikiApiError following change of interface
2019-11-21 21:47:49 +01:00
Antonin Delpeuch
de6dedb43d Skip update if rewriting failed 2019-11-05 17:49:47 +00:00
Antonin Delpeuch
ec5c9cd418 Fix duplicate creations, closes #2206 2019-11-04 21:17:18 +00:00
Antonin Delpeuch
1ee5068f0d CSRF protection for Wikidata extension 2019-10-17 10:42:05 +01:00
Antonin Delpeuch
c35b2e154f
Merge pull request #2141 from OpenRefine/issue-1904-mock-data-extension-tests
Mock HTTP calls in data extension tests.
2019-09-12 10:41:47 +01:00
Antonin Delpeuch
fdf742b052 Unlink wikidata extension from RefineTest 2019-09-12 10:24:25 +01:00
Antonin Delpeuch
29f6d1d14b
Merge pull request #2137 from OpenRefine/issue-2136-wikidata-calendar
Improved support for Wikidata dates
2019-09-11 17:16:49 +01:00
Antonin Delpeuch
80eea8635b Add support for TODAY constant in Wikidata schemas 2019-08-25 13:42:28 +01:00
Antonin Delpeuch
43980e69dd Add support for custom calendar in Wikidata date parsing 2019-08-25 13:26:09 +01:00
Antonin Delpeuch
001dc584f0 Add warning for early Gregorian dates in Wikidata schema (#2136) 2019-08-25 13:03:41 +01:00
Antonin Delpeuch
29f3cef3ec Remove uses of junit, closes #2133 2019-08-23 14:09:27 +01:00
Antonin Delpeuch
2b03efd84f Rename test packages to match tested ones, for #2133 2019-08-23 11:55:31 +01:00
Antonin Delpeuch
74f351f265 Temporarily disable test as bug is not critical. 2019-07-03 10:22:11 +02:00
Antonin Delpeuch
214efc73b4 Add regression test for serialization of statement groups 2019-07-03 10:22:11 +02:00
Antonin Delpeuch
8ae4c8fe94 Update to Wikidata-Toolkit 0.10.0. Closes #2064. 2019-07-03 10:22:11 +02:00
Antonin Delpeuch
09a42fd2f5
Merge pull request #2065 from OpenRefine/issue-2063-overriding-terms
Wikidata: Add labels or descriptions without overriding existing ones
2019-07-02 10:18:56 +02:00
Antonin Delpeuch
f7a8085bab Update UI to allow for non-overriding terms. Closes #2063 2019-06-13 09:21:30 +01:00
Antonin Delpeuch
05839b1bbf Add support for conditional label and term updates, for issue #2063. 2019-06-12 18:59:10 +01:00
Antonin Delpeuch
03fef3d7b4 Switch to own language code validation in backend, for #1933 2019-06-06 21:00:03 +01:00
Antonin Delpeuch
6d820dfea5 Update frontend date validation and format 2019-02-19 22:46:33 +00:00
Antonin Delpeuch
b157651e9e Fix Wikidata date parsing tests 2019-02-19 22:32:50 +00:00
Antonin Delpeuch
5534e84b29 Refine implementation thanks to the tests 2019-02-19 22:20:11 +00:00
Antonin Delpeuch
6bc9a6ea8e Do not represent time values with precision > 11. Closes #1944. 2019-02-19 22:08:20 +00:00
Antonin Delpeuch
6dd9f41639
Merge pull request #1925 from OpenRefine/issue1887
Compute reconciliation features when creating new items
2019-01-10 04:44:45 +01:00
Antonin Delpeuch
b1a84da1da Recompute features when creating new items. Closes #1887. 2018-12-31 17:38:19 +01:00
Antonin Delpeuch
13aec40b88 Index terms by language code in ItemUpdate. Fixes #1917. 2018-12-30 19:12:44 +01:00
Antonin Delpeuch
98bd03e5f4 Reorganize Java imports 2018-12-09 11:19:39 +09:00
Antonin Delpeuch
f667a78657 Migrate recent PRs to Jackson 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
142a2d8beb Remove all mentions of org.json in Wikidata extension 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
a4fa1dca77 Update Wikidata extension after removal of org.json from core 2018-11-30 19:38:52 +09:00
Antonin Delpeuch
ebfa591190 Fix WikibaseSchemaTest 2018-11-30 19:23:08 +09:00
Antonin Delpeuch
1c34b237e4 Unify JSON testing in Wikidata extension 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
0698b9c84e Unify JSON testing in Wikidata extension 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
bd5a8f9ece Fix serialization issues in Wikidata extension 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
1790799bfe Remove Jsonizable interface and write methods 2018-11-30 19:21:21 +09:00
Antonin Delpeuch
bb79125829 Add support for sub-year precisions in Wikidata schema, for #1816 2018-11-24 15:46:24 +00:00
Antonin Delpeuch
9b111952fe
Merge pull request #1795 from OpenRefine/issue1776
Add import and export for Wikidata schema
2018-11-07 10:31:51 +00:00
Antonin Delpeuch
e5061cc44c
Merge pull request #1794 from OpenRefine/issue1781
Trim strings automatically in Wikibase schema.
2018-11-05 17:32:50 +00:00
Antonin Delpeuch
04ed08c2c5 Revert "Bump Wikidata-Toolkit to 0.9.0"
This reverts commit 44bbdcc83d.
2018-11-01 22:27:42 +00:00
Antonin Delpeuch
b83044d5fd
Merge branch 'master' into issue1781 2018-11-01 18:05:52 +00:00
Antonin Delpeuch
b030346926 Fix trimming tests. 2018-11-01 17:56:03 +00:00
Antonin Delpeuch
604666ed6a Also trim monolingual text values. 2018-11-01 15:33:26 +00:00
Antonin Delpeuch
8b4cf84bfd Trim strings automatically in Wikibase schema. Closes #1781. 2018-11-01 15:29:57 +00:00
Antonin Delpeuch
96e3015882
Merge pull request #1791 from OpenRefine/issue1701
Bump Wikidata-Toolkit to 0.9.0
2018-11-01 12:04:49 +00:00
Antonin Delpeuch
e85f7d36e0 Add Wikibase schema exporter, for issue #1776 2018-10-28 15:19:22 +01:00
Antonin Delpeuch
44bbdcc83d Bump Wikidata-Toolkit to 0.9.0 2018-10-28 11:20:48 +01:00
Antonin Delpeuch
e1014bfeed Fix rendering of integers in Wikidata extension. Closes #1775 2018-10-27 21:43:22 +02:00
Antonin Delpeuch
47323a9e75
Merge pull request #1736 from OpenRefine/maven2
Migrate to Maven, take 2
2018-10-22 14:41:48 +01:00
Antonin Delpeuch
782ae4e788 Revert "Revert "Migrate to Maven""
This reverts commit c20918b73d.
2018-09-16 15:34:47 +01:00
Jacky
c20918b73d
Revert "Migrate to Maven" 2018-09-16 10:16:50 -04:00
Antonin Delpeuch
2f2fa86800 Fix Wikidata extension testing for Maven 2018-09-10 11:27:14 +01:00
Antonin Delpeuch
fbc9b27640 Store engine configuration as EngineConfig rather than JSONObject 2018-09-05 14:49:39 +01:00
Antonin Delpeuch
cb43ca2454 Fix snak grouping for qualifiers and references in Wikidata extension.
Closes #1680.
2018-07-17 16:35:12 +01:00
Antonin Delpeuch
bd2865585d
Merge pull request #1647 from OpenRefine/fix-date-precision
Change default precision of Wikibase dates to match the UI's defaults.
2018-06-22 12:22:32 +02:00
Antonin Delpeuch
b3ee80d504
Merge pull request #1655 from OpenRefine/new-scope-constraint
Migrate to new scope constraint format
2018-06-22 12:22:08 +02:00
Antonin Delpeuch
8469728bb5 Update tests and localization 2018-06-15 11:07:59 +01:00
Antonin Delpeuch
bbc5936da6 Migrate to new scope constraint format 2018-06-15 10:54:26 +01:00
Antonin Delpeuch
d7564a4690 Change default precision of Wikibase dates to match the UI's defaults. 2018-06-13 15:37:51 +01:00
Antonin Delpeuch
ab3adc0329 Remove empty tests 2018-06-10 09:30:06 +01:00
Antonin Delpeuch
1910833ad8 Add entity type constraint check 2018-06-10 09:24:22 +01:00
Antonin Delpeuch
e2ae09f5be Add support for Wikidata single best value constraint 2018-06-10 08:17:42 +01:00
Antonin Delpeuch
48c2b90a93 Add constraint checks for one-of and none-of constraints 2018-06-10 08:17:33 +01:00
Antonin Delpeuch
3c181c9070 Add support for symmetric constraint 2018-06-10 08:17:30 +01:00
Antonin Delpeuch
9cb4a46277 Add support for quantity-related constraints in Wikidata QA 2018-06-10 08:17:24 +01:00
Antonin Delpeuch
1d6226b095
Merge pull request #1594 from OpenRefine/wikidata/better-format-feedback
Give better feedback when values with invalid formats are provided.
2018-05-22 23:56:24 +02:00
Antonin Delpeuch
844e288955 Fix inverse constraint test for Wikidata extension.
The inverse constraint on the part of property was removed.
2018-05-18 10:52:48 +02:00
Antonin Delpeuch
811b96551c Fix failing test in WbDateVariable 2018-05-06 18:29:07 +02:00
Antonin Delpeuch
484ae48c95 Give better feedback when values with invalid formats are provided. 2018-05-06 18:03:28 +02:00
Antonin Delpeuch
ee59a5037c Add test for numeric cells in Wikibase date parsing 2018-04-28 11:26:22 +02:00
Antonin Delpeuch
5fda43a5c7 Make edit summaries mandatory 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
0c21d6d171 Refuse reconciled cells with invalid space 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
0961ff2949 Refuse empty strings in Wikidata schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
b1e368e7a8 Infer precision from engineering notation of quantity values 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
ec6d0eec64 Add workaround for issue in QuantityValue serialization.
https://github.com/Wikidata/Wikidata-Toolkit/issues/341
2018-04-27 09:17:33 +02:00
Antonin Delpeuch
81a18777cb Replace QS preview by visual preview of the edits 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
6e4dfe67af Fix bug conflating new items 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
112f3f9308 Fix tests 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
8fab42ce8f Add error message when saving an incomplete schema 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
e9ce0fa59c Flatten scrutinizer hierarchy, optimize schema deserialization 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
580c0bed80 Fix ConnectionManager and add test for LoginCommand 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
0b14a1a627 Add license headers, general cleanups on Java files 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
03c7674858 Fix siteIRI of new item ids (switch to SITE_LOCAL) 2018-04-27 09:17:33 +02:00
Antonin Delpeuch
15ba7fbdde Schema editing cleanup 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
6b658fe87e Some rudimentary testing of operations and changes 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
a002468e7d Better testing of the editing process 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
773be2e161 Introduce a rewriter to update references to new items after creation 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
7cb8757028 Test the commands 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
973a28cc90 Test the scrutinizers 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
fd7462f749 Testing for QuickStatements exporter 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
bb044612e0 Introduce a scheduler package to reorganize item updates 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
88178d7c04 Refactor ItemUpdate and introduce ItemUpdateBuilder 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
e0cdb91520 Better testing for the schema package 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
6f9636176b Add a lot of tests in the schema 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
7cae9455da Test (and fix) ReconEntityIdValue 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
b48c78a617 Refactor and test QS value printing 2018-04-27 09:17:32 +02:00
Antonin Delpeuch
1837926cb1 Add quantity expressions in the backend 2018-04-27 09:17:32 +02:00