Commit Graph

2571 Commits

Author SHA1 Message Date
Tom Morris
6a91b5d75b Use InputStream instead of Reader for JSON import - fixes #698 2013-03-23 18:36:05 -04:00
Tom Morris
6b3592982e Remove O(n^2) issue in tree importers - fixes #699
- Add sparse/based list implementation for ImportRecord
2013-03-23 12:02:51 -04:00
Tom Morris
f78dfadcf3 Clean up tree import utilities for #699
- lazy allocate objects
- conditionalize logging to prevent calls to StringBuilder & toString()

These are secondary issues, but still worth cleaning up.
2013-03-23 11:56:58 -04:00
Tom Morris
0a2ba1b1ae Switch from LinkedList to ArrayList
Just a simple list.  No need for extra overhead..
2013-03-23 08:16:23 -04:00
Tom Morris
56389588e3 Update to Jackson 1.9.12 2013-03-23 08:15:08 -04:00
Tom Morris
bfa7c34d17 Merge pull request #659 - closes #659 2013-03-18 21:24:01 -04:00
Tom Morris
31cffa1181 Merge remote-tracking branch 'upstream/master' 2013-03-18 21:16:55 -04:00
Tom Morris
8a61cf731b Merge pull request #664 from Arcadelia/Preserve_Quotes
Quotes should not be removed from values
2013-03-18 18:12:51 -07:00
Tom Morris
af947d66f6 Add JavaScript nature
- make cross referencing easier
- flag syntax errors
- for the time being, exclude controller.js which uses for each
2013-03-18 20:25:13 -04:00
Tom Morris
fe943fe3ea Flag English specific stopwords for cleanupp 2013-03-18 20:20:46 -04:00
Tom Morris
6b69427cbb Clean up commented out code 2013-03-18 20:20:23 -04:00
Tom Morris
9852aa1b1a Resolve merge conflicts with David 2013-03-18 18:28:58 -04:00
Tom Morris
c91a377eed Merge David's API key changes
- support both API key storage mechanisms for the interim
2013-03-18 17:47:50 -04:00
David Huynh
8fb450769b Resolved conflicts 2013-03-14 18:22:43 -07:00
David Huynh
fef773bae0 Allow specification of a Google API key. 2013-03-14 18:18:56 -07:00
Tom Morris
8a8639f7aa Bump up batch size for simple recon jobs
Change GUID from 10 to 50 and keys & IDs from 10 to 40
2013-03-13 16:49:47 -04:00
Tom Morris
4074d3267c Refactor to use common mqlread code and eliminate clones 2013-03-13 16:45:37 -04:00
Tom Morris
01de9e65c0 Fix reference to really old API endpoint
switch from www.freebase.com to api.freebase.com
needs to be updated to Google API, but is unused, so low priority
2013-03-12 17:48:05 -04:00
Tom Morris
a06e16a9e5 Update some Javascript uses to new Freebase API - part of #696 2013-03-12 17:46:18 -04:00
Tom Morris
05968e37fa Switch Add from Freebase to Google APIs - part of #696
- switch to use the Google Java client instead of handrolled requests
2013-03-12 17:38:18 -04:00
Tom Morris
757c3e32ff Centralize Google API key 2013-03-12 17:34:06 -04:00
Tom Morris
054ea643c3 Replace Google API key for Suggest - fixes #679 2013-03-12 17:27:58 -04:00
Tom Morris
7b9f6836e1 Update key & id recon to new Freebase APIs - part of #696 2013-03-12 16:50:23 -04:00
Tom Morris
7578d3375f Add logger and logging
- fix exception printing that goes nowhere
- make logger available for subclasses to use
2013-03-11 13:14:20 -04:00
Tom Morris
a2a8f4af2e Patch applied - closed #315 2013-03-06 21:45:54 -05:00
Tom Morris
d8d82bf8b7 Clean up a couple more format guessing issues left over from #685 2013-03-06 20:39:39 -05:00
Tom Morris
ca09ae6f90 Report Jython errors to user - addresses #694
- may need to work on the format a bit more
2013-03-06 20:38:07 -05:00
Tom Morris
975c6c85dc Replace Jython JAR with one that includes all libraries - fixes #693 2013-03-06 20:36:05 -05:00
Tom Morris
369bfffb2f Don't guess field widths unless we have at least 3 lines
- Investigation of #685 showed that single line files were being guessed
as fixed field width
2013-03-04 17:47:06 -05:00
Tom Morris
6b676f7513 Handle MIME media types which have charset param - fixes #685 2013-03-04 17:45:34 -05:00
Tom Morris
a3b4950b78 Have curl fail on all HTTP errors - fixes #481 2013-03-03 18:19:31 -05:00
Tom Morris
10bd7e3b75 Make upper bound of time facet inclusive - fixes issue #648 2013-03-03 16:06:20 -05:00
Tom Morris
5778a18b05 Switch to new reconcile service for namespaced lookups 2013-03-03 15:42:48 -05:00
Tom Morris
c2f2db52ab Fix issue #691 - include /common/topic properties
- Switch to new openrefine-helper app which includes /common/topic
properties in list
- Fix Suggest setup to allow /common/topic properties
2013-03-03 15:42:06 -05:00
Tom Morris
eba03fc69e Protect joins map with mutex - fixes issue #652 2013-03-03 09:36:43 -05:00
Tom Morris
0dfd7d7112 Blacklist /common/resource in Suggest - extends fix for issue #632 2013-03-03 09:17:48 -05:00
Tom Morris
23cc319fd7 Switch to released version of reconciliation service - fixes issue #629 2013-03-02 16:00:56 -05:00
Tom Morris
a2711e4f59 Correct Suggest property filter - fixes issue 689 2013-03-01 22:26:05 -05:00
Tom Morris
38a88db58d Patch Suggest to accept type param for Search 2013-03-01 18:57:11 -05:00
Tom Morris
7b3379afc7 fix range check in getFields - fixes issue 687 2013-02-26 16:35:21 -05:00
Tom Morris
1e9a1c5f15 Merge branch 'master' into fusiontables-migration 2013-02-26 00:05:34 -05:00
Tom Morris
389e762251 Merge remote-tracking branch 'upstream/master' 2013-02-26 00:01:06 -05:00
Tom Morris
95e13eac50 Improve recon error handling 2013-02-26 00:00:03 -05:00
Tom Morris
a2b60d3d4b Fix filter to blacklist documents correctly 2013-02-25 19:45:25 -05:00
Tom Morris
ed07a4d489 Revert "Black list /type/content in Suggest. Closes issue #632"
This reverts commit 98c64201ef.
2013-02-21 12:45:49 -05:00
Tom Morris
317bf35445 Update to Jython 2.5.3 and package everything in a single JAR 2013-02-21 12:44:47 -05:00
Tom Morris
975d18942f Update to Clojure 1.4. Closes issue #634 2013-02-12 00:15:35 -05:00
Tom Morris
2837db2f51 Merge remote-tracking branch 'upstream/master' 2013-02-11 23:32:43 -05:00
Tom Morris
50888c6f2e Merge pull request #666 from Arcadelia/Temp-file_removal
Fixed removal of upload temp files
2013-02-11 15:11:24 -08:00
Tom Morris
98c64201ef Black list /type/content in Suggest. Closes issue #632 2013-02-11 17:43:58 -05:00