Commit Graph

4068 Commits

Author SHA1 Message Date
Antonin Delpeuch
75a0fac71f Split BM encoding, better tests. 2018-12-31 14:24:35 +01:00
Antonin Delpeuch
ddd9bf9aa8
Merge pull request #1906 from OpenRefine/issue1893
Make clustering extensible
2018-12-31 14:13:46 +01:00
Antonin Delpeuch
1c90129829 Add a phonetic clustering extension
Closes #926. Closes #927.
2018-12-30 23:11:00 +01:00
Antonin Delpeuch
4984837c9f Update XLS exporter to Apache POI 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
d0eff4c5a8 Update Apache POI to 4.0.1 2018-12-30 22:25:33 +01:00
Antonin Delpeuch
79ec6988d6 Fix GetCLusteringFunctionANdDistancesCommandTest 2018-12-30 22:22:50 +01:00
Antonin Delpeuch
626c17c649 Disable keyers that are super-seeded by others. 2018-12-30 21:20:17 +01:00
Antonin Delpeuch
074765f816 Add test to ensure sort is stable. 2018-12-30 20:49:18 +01:00
Antonin Delpeuch
b03dbf2446 Reorder reconciliation results by decreasing score. Fixes #1913. 2018-12-30 20:47:12 +01:00
Antonin Delpeuch
13aec40b88 Index terms by language code in ItemUpdate. Fixes #1917. 2018-12-30 19:12:44 +01:00
Antonin Delpeuch
56fcad6784
Merge pull request #1918 from weblate/weblate-openrefine-translations
Update from Weblate
2018-12-30 11:39:47 +01:00
Hosted Weblate
434c14a50a
Merge branch 'origin/master' into Weblate. 2018-12-30 11:38:51 +01:00
Antonin Delpeuch
234ca8486a
Merge pull request #1889 from OpenRefine/issue1882
Update Butterfly to 1.0.2.
2018-12-30 11:38:36 +01:00
Luca Martinelli
e706447b4f
Translated using Weblate (Italian)
Currently translated at 100.0% (147 of 147 strings)

Translation: OpenRefine/wikidata
Translate-URL: https://hosted.weblate.org/projects/openrefine/wikidata/it/
2018-12-16 03:09:22 +01:00
Luca Martinelli
bd48ea3c69
Translated using Weblate (Italian)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/it/
2018-12-16 03:09:18 +01:00
Isao Matsunami
e0a07d2480
Translated using Weblate (Japanese)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/ja/
2018-12-16 03:09:16 +01:00
Luca Martinelli
0203a9b8ef
Translated using Weblate (Italian)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/it/
2018-12-16 03:09:15 +01:00
ssantos
074a80b297
Translated using Weblate (German)
Currently translated at 100.0% (711 of 711 strings)

Translation: OpenRefine/Translations
Translate-URL: https://hosted.weblate.org/projects/openrefine/translations/de/
2018-12-16 03:09:14 +01:00
Antonin Delpeuch
9656ea3f8c
Merge pull request #1903 from ostephens/replace-smart-quotes
Add Common transform which replaces smart quotes with ascii equivalent
2018-12-12 12:09:49 +00:00
Jacky
150ee12058
Merge pull request #1902 from OpenRefine/cleanup
Tidy up various things
2018-12-11 20:59:50 -05:00
Antonin Delpeuch
22cf0517b9 Better fallback for non-localized keyers and distances 2018-12-11 12:16:58 +00:00
Antonin Delpeuch
8063ca63d9 Add license headers 2018-12-11 12:10:11 +00:00
Antonin Delpeuch
a57082ef3e Hook the new command to the UI to expose all clusterers 2018-12-11 11:59:37 +00:00
Antonin Delpeuch
7ae71470ef Add new command to expose known clustering functions and distances 2018-12-11 10:51:29 +00:00
Antonin Delpeuch
d9af48a49a Expose own interface for similarity distances, isolating from Vicino 2018-12-11 09:57:26 +00:00
Antonin Delpeuch
72d76ee22a Separate distance and keyer registration in dedicated factories 2018-12-11 09:27:04 +00:00
Jacky
8eb08f3985
Merge pull request #1905 from OpenRefine/remove_broker
Remove broker, not used anymore
2018-12-10 17:21:01 -05:00
Antonin Delpeuch
6ef0577df4 Remove broker, not used anymore 2018-12-10 06:17:13 +09:00
Antonin Delpeuch
e05d032890 Remove unsign script, not neded 2018-12-10 06:15:37 +09:00
Jacky
7f7b71459c
Merge pull request #1901 from OpenRefine/issue1840
Fix zip slip vulnerability
2018-12-09 12:05:16 -05:00
Antonin Delpeuch
3f9189c5a7
Merge pull request #1896 from weblate/weblate-openrefine-translations
Update from Weblate
2018-12-09 22:48:14 +09:00
Hosted Weblate
20c86cdd5c
Merge branch 'origin/master' into Weblate. 2018-12-09 14:47:43 +01:00
Antonin Delpeuch
d4222c05ef
Merge pull request #1877 from OpenRefine/issue1876
Fix reconciliation result deserialization
2018-12-09 22:47:40 +09:00
Hosted Weblate
84f3b0e793
Merge branch 'origin/master' into Weblate. 2018-12-09 14:47:26 +01:00
Antonin Delpeuch
dd0fa967d0
Merge pull request #1898 from OpenRefine/issue/1890
support both jdk 8, oracle jdk9 and openjdk11
2018-12-09 22:47:20 +09:00
Owen Stephens
700850a5f7 Add Common transform which replaces smart quotes with ascii equivalent 2018-12-09 11:03:11 +00:00
Antonin Delpeuch
caf2b4d915 Add missing license headers 2018-12-09 12:22:40 +09:00
Antonin Delpeuch
98bd03e5f4 Reorganize Java imports 2018-12-09 11:19:39 +09:00
Antonin Delpeuch
7ab00366fc Database extension logging cleanup 2018-12-09 11:15:04 +09:00
Antonin Delpeuch
79994e86da Create dedicated temporary dir for zip slip test 2018-12-09 11:01:58 +09:00
jackyq2015
a8cf844f9c fix issue #1900 2018-12-08 20:57:16 -05:00
Antonin Delpeuch
e243e73e40 Fix zip slip vulnerability. Closes #1840. 2018-12-09 10:41:33 +09:00
Jacky
a8addbbe39
Attempt to fix issue #1990 travis fork issue 2018-12-08 19:50:57 -05:00
Jacky
54c7e28d8f
openjdk 9 was superseded by the 11 version
http://jdk.java.net/9/
2018-12-08 17:09:51 -05:00
Jacky
b796f63c04
fix issue when migrating to JDK9 as below
$ mvn process-resources
[INFO] Scanning for projects...
Downloading from sonatype-snapshots: https://oss.sonatype.org/content/repositories/snapshots/org/openrefine/openrefine/3.1-SNAPSHOT/maven-metadata.xml
Downloading from apache-snapshots: https://repository.apache.org/snapshots/org/openrefine/openrefine/3.1-SNAPSHOT/maven-metadata.xml
Downloading from sonatype-snapshots: https://oss.sonatype.org/content/repositories/snapshots/org/openrefine/openrefine/3.1-SNAPSHOT/openrefine-3.1-SNAPSHOT.pom
Downloading from apache-snapshots: https://repository.apache.org/snapshots/org/openrefine/openrefine/3.1-SNAPSHOT/openrefine-3.1-SNAPSHOT.pom
[ERROR] [ERROR] Some problems were encountered while processing the POMs:
[FATAL] Non-resolvable parent POM for org.openrefine:packaging:3.0: Could not find artifact org.openrefine:openrefine:pom:3.1-SNAPSHOT in sonatype-snapshots (https://oss.sonatype.org/content/repositories/snapshots/) and 'parent.relativePath' points at wrong local POM @ line 14, column 11
 @ 
[ERROR] The build could not read 1 project -> [Help 1]
[ERROR]   
[ERROR]   The project org.openrefine:packaging:3.0 (/home/travis/build/OpenRefine/OpenRefine/packaging/pom.xml) has 1 error
[ERROR]     Non-resolvable parent POM for org.openrefine:packaging:3.0: Could not find artifact org.openrefine:openrefine:pom:3.1-SNAPSHOT in sonatype-snapshots (https://oss.sonatype.org/content/repositories/snapshots/) and 'parent.relativePath' points at wrong local POM @ line 14, column 11 -> [Help 2]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException
[ERROR] [Help 2] http://cwiki.apache.org/confluence/display/MAVEN/UnresolvableModelException
The command "mvn process-resources" failed and exited with 1 during .
2018-12-08 16:48:24 -05:00
jackyq2015
d1ed842f02 support both jdk 8 and 9 2018-12-08 15:31:01 -05:00
Isao Matsunami
cac83e9132
Translated using Weblate (Japanese)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/ja/
2018-12-08 20:08:58 +01:00
Antonin Delpeuch
db3a878c78 Remove spurious println 2018-12-08 18:17:03 +09:00
Hosted Weblate
431f64a52a
Merge branch 'origin/master' into Weblate. 2018-12-07 17:54:33 +01:00
Allan Nordhøy
a6d3d7504e
Translated using Weblate (Norwegian Bokmål)
Currently translated at 100.0% (46 of 46 strings)

Translation: OpenRefine/database
Translate-URL: https://hosted.weblate.org/projects/openrefine/database/nb_NO/
2018-12-07 17:54:32 +01:00