Commit Graph

862 Commits

Author SHA1 Message Date
Tom Morris
4fd20f1b4e Update to Suggest 4.3 - fixes #762 2013-08-10 17:56:09 -04:00
Tom Morris
1d8784e059 Make workspace saving and loading more robust - fixes #528
- don't overwrite old files if we get an error writing new ones
- don't write unchanged data
- keep backup files around until next write rather than deleting
immediately
- attempt to recreate missing metadata as best as possible
2013-08-09 19:53:53 -04:00
Tom Morris
c4bd5d7392 Fix typo in Best candidates type match label - fixes #775 2013-08-08 13:34:05 -04:00
Tom Morris
b1e56a4dab Fix display of HTML encoded NBSP characters - fixes #766 2013-08-08 11:49:13 -04:00
Tom Morris
579d71b7eb Switch back to NUL character for quote now that OpenCSV handles it -
fixes #653
2013-08-07 17:07:17 -04:00
Tom Morris
cf6e855bf5 Update to latest patched OpenCSV 2013-08-07 16:18:48 -04:00
Tom Morris
71a9d2e0af Switch from encodeURIComponent to encodeURI - revised fix for #290 2013-08-06 13:35:34 -04:00
Tom Morris
0c483fa9f6 Correct I18N code for progress display - really fix #767 this time 2013-08-06 12:20:23 -04:00
Tom Morris
7b5b549113 More project saving changes for #528
- reduce project retention in memory from 1 hr to 15 min.
- free all unmodified projects if we get an error on save (we could be
running low on memory)
- make sure exceptions propagate up to where they can be usefully
handled
2013-08-05 14:13:56 -04:00
Tom Morris
190a031a8a Comments only. No code changes. 2013-08-05 14:11:06 -04:00
Tom Morris
3500f20e47 Save all modified projects before importing new one - hopefully helps
#528
2013-08-05 14:10:26 -04:00
Tom Morris
57f5e9873d Add Javadoc. No code changes. 2013-08-05 13:08:30 -04:00
Tom Morris
c3cab0524a Narrow exceptions thrown and let them propagate up so we know
workspace file isn't valid - first step for #528
2013-08-05 13:08:02 -04:00
Tom Morris
94936d7374 Fix variable name typo - fixes #767 2013-08-03 15:55:47 -04:00
Tom Morris
36e4fd1ef5 URI encode IDs before replacing them in URL. Fixes #290 2013-08-03 13:50:37 -04:00
Tom Morris
a7273625d7 Add support for Basic Authentication over HTTPS - addresses #217 2013-08-02 19:15:24 -04:00
Tom Morris
4f7da9d18e Switch to Apache HTTP client for downloads - fixes #748 2013-08-02 18:13:41 -04:00
Tom Morris
d7531bbbd8 Handle quoted fields with embedded new lines. Sort separators by score
rather than just standard deviation
2013-08-02 17:59:09 -04:00
Tom Morris
f4ff227340 Clean up localization - fixes #760, modifies pull request #755
- make all file loading relative to module base
- move core language files into appropriate place
- eliminate all SetLanguage commands and use SetPreference instead
- eliminate all LoadLanguage commands except for core's
- fix duplicate keys in JSON language files
- remove BOM from JSON language files

OPEN - task 760: Translations not being loaded from built kit 
http://github.com/OpenRefine/OpenRefine/issues/issue/760
2013-07-31 00:31:31 -04:00
Tom Morris
9450d483ce Fix up line endings 2013-07-29 15:49:20 -04:00
Tom Morris
3003c1a709 Make importers more robust to preview errors when someone selects the
wrong importer/parser
2013-07-27 13:35:12 -04:00
Tom Morris
57ca70132c Turn all import conversions off by default - fixes #478 2013-07-27 13:32:26 -04:00
Tom Morris
5123dad6a8 More conservative approach for locking of jobs table 2013-07-26 18:51:08 -04:00
Tom Morris
0dc14af1aa Fix bug in refactoring of ImportingJob from commit
1e5f89e84c
2013-07-26 18:50:03 -04:00
Tom Morris
46a1e198d8 Recompute max cell index when rebuiling maps in ColumnModel - fixes #406 2013-07-26 18:48:20 -04:00
Tom Morris
7edc550618 Give a reasonable error message on Excel 95 import failure - fixes #564 2013-07-26 16:24:56 -04:00
Tom Morris
ff4eeb549a Fix typo 2013-07-26 15:35:18 -04:00
Tom Morris
dc4d04c132 Allow arrays containing null in Filter & ForEach - fixes #741 2013-07-26 15:20:44 -04:00
Tom Morris
c8f0e88bd4 Replace retired Freebase Topic Blocks with Freebase Suggest flyout -
part of
#696
2013-07-26 10:55:42 -04:00
Tom Morris
559e0124ca Switch to patched (& non-minified) Suggest 4.2 2013-07-26 10:52:49 -04:00
Tom Morris
d16e8404b4 Patch Freebase Suggest 4.2 to deal with Freebase Search changes. 2013-07-26 10:50:22 -04:00
Tom Morris
1e5f89e84c Centralize handling of import job config object & synchronize to allow
multiple accessors
2013-07-25 15:41:08 -04:00
Tom Morris
dc206e1889 Switch to ConcurrentHashMap for jobs table to allow multiple accessors 2013-07-25 15:36:54 -04:00
Tom Morris
0ff2d7ed9f Simplify implementation from pull request #728 2013-07-25 13:45:44 -04:00
Tom Morris
6dd4b8ea23 Add tests for boolean functions and tighten up error handling 2013-07-25 13:45:04 -04:00
Tom Morris
2c2c0d3d68 Merge pull request #728 from jmcastagnetto/master
Implements Xor operation
2013-07-25 10:00:11 -07:00
Tom Morris
70d4229a2f Restore code mistakenly removed in
109138366b
 Put it where Eclipse doesn't get confused about it being unreferenced
2013-07-25 12:43:05 -04:00
Tom Morris
218ea46a4d Merge remote-tracking branch 'blakko/internationalization' - close #755
Conflicts:
	extensions/freebase/module/scripts/dialogs/schema-alignment/schema-alignment-dialog.html
	main/webapp/modules/core/index.vt
	main/webapp/modules/core/project.vt
	main/webapp/modules/core/scripts/project/browsing-engine.js
	main/webapp/modules/core/scripts/project/history-panel.html
2013-07-25 10:53:25 -04:00
Tom Morris
78bf52ff69 Add hyphens to camel case wiki links. Use https everywhere. fixes #757 2013-07-25 10:29:41 -04:00
Blakko
6e90bc41f6 Merge remote-tracking branch 'origin/master' into internationalization
Conflicts:
	extensions/freebase/module/scripts/dialogs/schema-alignment/schema-alignment-dialog.html
	main/webapp/modules/core/index.vt
	main/webapp/modules/core/project.vt
	main/webapp/modules/core/scripts/project/browsing-engine.js
	main/webapp/modules/core/scripts/project/history-panel.html
2013-07-25 11:07:59 +02:00
Tom Morris
109138366b Range check column move. Delete dead code. Fixes #602 2013-07-24 18:25:21 -04:00
Blakko
e6e6c8c002 Added a "Language Settings" menu at index
Now the language manually set has priority over the browser lang
Update translations
2013-07-12 11:12:33 +02:00
Blakko
13722c467b Added default translation file 2013-07-11 16:50:27 +02:00
Blakko
75277c18c9 added italian translation 2013-07-11 15:05:01 +02:00
Blakko
9f9e75400e Added internationalization for some missing labels 2013-07-11 15:01:45 +02:00
Blakko
d9ccaf53ad More small bugfixes 2013-07-11 11:05:13 +02:00
Tom Morris
1353f7f7aa Update Apache HTTP client JARs to 4.2.5 2013-07-10 15:16:21 -04:00
Tom Morris
92e4427c39 Adding a TODO 2013-07-10 15:13:22 -04:00
Tom Morris
32773122c4 Fix CollationKey creation - fixes #753 2013-07-10 15:12:49 -04:00
Tom Morris
163546de94 Remove update JARs 2013-07-09 14:17:40 -04:00
Blakko
8a0f23be3b Internationalization of the data-table part 2013-07-09 15:57:25 +02:00
Blakko
5e10a91175 Internationalization of the util part 2013-07-08 12:33:05 +02:00
Blakko
eb3eba9c5e Internationalization of the reconciliation part 2013-07-08 11:40:11 +02:00
Blakko
4492ca3bed Internationalization of the project part 2013-07-05 16:32:12 +02:00
Blakko
19b91bd282 Internationalization of the facets part 2013-07-05 09:30:37 +02:00
Blakko
5a6bef4162 Internationalization of the dialog part 2013-07-04 11:51:04 +02:00
Blakko
552b0bf94b Internationalization of the index part (create/open/update) of refine 2013-07-02 13:40:50 +02:00
Tom Morris
5b6bc888f7 Fix template escape processing. Fixes #752. 2013-06-30 12:21:26 -04:00
Blakko
817c6cc8d4 Added jquery i18n plugin to Open Refine 2013-06-27 12:01:47 +02:00
Tom Morris
a015b4e184 Update help links to point to new wiki. Fixes #716. 2013-06-23 15:34:47 -04:00
Tom Morris
8cb1dc05f8 Really restore Java 6 compatibilty 2013-06-23 14:42:05 -04:00
Tom Morris
3b835fabad Restore Java 6 compatibility 2013-06-23 14:11:30 -04:00
Charles Pritchard
d68351f93e FIXED: #731 Undo History Extract panel needs max width 2013-06-23 13:42:02 -04:00
Charles Pritchard
05389aa099 Fixed checkbox restore in custom tabular exporter dialog box when applying saved JSON 2013-06-23 13:40:36 -04:00
Tom Morris
bad5bc37b2 Watch paste events on input fields. Fixes #730. 2013-06-23 13:37:29 -04:00
Tom Morris
a3b4b45e4e Support non-string types in facetCount() - fixes #591 2013-06-23 12:04:48 -04:00
Tom Morris
51c1bc4a2f Refactor default toString with date support into separate utility 2013-06-23 12:02:13 -04:00
Tom Morris
a42925f3c8 Remove unused code 2013-06-23 11:21:48 -04:00
Tom Morris
c961bb64de Flush all column caches on row removals/changes. Fixes issue 567. 2013-06-22 18:44:26 -04:00
Tom Morris
fd58bd3327 Move documentation to Javadoc where it's visible 2013-06-22 16:27:18 -04:00
Tom Morris
6e88d068ee Throw a narrower exception 2013-06-22 16:26:45 -04:00
Tom Morris
43b2d89703 Remove dead code 2013-06-22 16:23:14 -04:00
Jesus M. Castagnetto
0795bd8422 resolved .gitignore conflict 2013-06-19 12:10:32 -05:00
Jesus M. Castagnetto
b09bb4463e fix error in index caught by thadguidry 2013-06-19 11:21:26 -05:00
Tom Morris
b91fc8a2b1 Use CollationKeys when sorting text. Fixes issue 738 2013-06-17 15:51:29 -04:00
Tom Morris
e1bea25c72 Clean up server tests
- move from shell script to Ant
- update TestNG and Mockito to latest versions
2013-06-11 19:44:58 -04:00
Tom Morris
067fcacec7 Clean up to pass tests:
- don't include TAB in control characters which get stripped so we can
use it for splitting
- remove trailing space from normalize strings
2013-05-31 17:06:03 -04:00
Tom Morris
1907bcd8dc Disable tests for character decomposition 2013-05-31 17:04:09 -04:00
Tom Morris
000c0a38a8 Compute delay from request issue, not response return. Fixes #721 2013-05-26 10:13:16 -04:00
Tom Morris
4a5d3d4662 Convert dates to ISO 8601 for reconciliation. Fixes #688. 2013-05-26 10:08:55 -04:00
Tom Morris
7615db97cf Add Javadoc clean up variable naming. No functional change. 2013-05-26 10:07:37 -04:00
Tom Morris
bf837e82ba Add TODO 2013-05-26 08:01:38 -04:00
Tom Morris
36dd95c263 Add TODO for record mode operation 2013-05-26 07:54:33 -04:00
Tom Morris
3bc36a997e Reapply patch to pass "type" parameter through to Search 2013-05-26 07:48:51 -04:00
Tom Morris
02b0816cc9 Update to Suggest 4.2 2013-05-26 07:47:14 -04:00
Tom Morris
d1b2dc3fe9 Add type to text input field - fixes #706
Even though type="text" is the default, the find won't work without it
explicitly included
2013-04-13 17:04:03 -04:00
Tom Morris
0d2881dac6 Update link to help
Switch from Google Code to Github
2013-04-13 16:50:56 -04:00
Tom Morris
567da6aa9f Normalize line endings
Add .gitattributes & do one-time normalization of line endings
2013-03-23 18:46:20 -04:00
Tom Morris
6a91b5d75b Use InputStream instead of Reader for JSON import - fixes #698 2013-03-23 18:36:05 -04:00
Tom Morris
6b3592982e Remove O(n^2) issue in tree importers - fixes #699
- Add sparse/based list implementation for ImportRecord
2013-03-23 12:02:51 -04:00
Tom Morris
f78dfadcf3 Clean up tree import utilities for #699
- lazy allocate objects
- conditionalize logging to prevent calls to StringBuilder & toString()

These are secondary issues, but still worth cleaning up.
2013-03-23 11:56:58 -04:00
Tom Morris
0a2ba1b1ae Switch from LinkedList to ArrayList
Just a simple list.  No need for extra overhead..
2013-03-23 08:16:23 -04:00
Tom Morris
56389588e3 Update to Jackson 1.9.12 2013-03-23 08:15:08 -04:00
Tom Morris
bfa7c34d17 Merge pull request #659 - closes #659 2013-03-18 21:24:01 -04:00
Tom Morris
31cffa1181 Merge remote-tracking branch 'upstream/master' 2013-03-18 21:16:55 -04:00
Tom Morris
8a61cf731b Merge pull request #664 from Arcadelia/Preserve_Quotes
Quotes should not be removed from values
2013-03-18 18:12:51 -07:00
Tom Morris
fe943fe3ea Flag English specific stopwords for cleanupp 2013-03-18 20:20:46 -04:00
Tom Morris
a06e16a9e5 Update some Javascript uses to new Freebase API - part of #696 2013-03-12 17:46:18 -04:00
Tom Morris
054ea643c3 Replace Google API key for Suggest - fixes #679 2013-03-12 17:27:58 -04:00
Tom Morris
7b9f6836e1 Update key & id recon to new Freebase APIs - part of #696 2013-03-12 16:50:23 -04:00
Tom Morris
7578d3375f Add logger and logging
- fix exception printing that goes nowhere
- make logger available for subclasses to use
2013-03-11 13:14:20 -04:00
Tom Morris
a2a8f4af2e Patch applied - closed #315 2013-03-06 21:45:54 -05:00
Tom Morris
d8d82bf8b7 Clean up a couple more format guessing issues left over from #685 2013-03-06 20:39:39 -05:00
Tom Morris
369bfffb2f Don't guess field widths unless we have at least 3 lines
- Investigation of #685 showed that single line files were being guessed
as fixed field width
2013-03-04 17:47:06 -05:00
Tom Morris
6b676f7513 Handle MIME media types which have charset param - fixes #685 2013-03-04 17:45:34 -05:00
Tom Morris
10bd7e3b75 Make upper bound of time facet inclusive - fixes issue #648 2013-03-03 16:06:20 -05:00
Tom Morris
5778a18b05 Switch to new reconcile service for namespaced lookups 2013-03-03 15:42:48 -05:00
Tom Morris
c2f2db52ab Fix issue #691 - include /common/topic properties
- Switch to new openrefine-helper app which includes /common/topic
properties in list
- Fix Suggest setup to allow /common/topic properties
2013-03-03 15:42:06 -05:00
Tom Morris
eba03fc69e Protect joins map with mutex - fixes issue #652 2013-03-03 09:36:43 -05:00
Tom Morris
0dfd7d7112 Blacklist /common/resource in Suggest - extends fix for issue #632 2013-03-03 09:17:48 -05:00
Tom Morris
23cc319fd7 Switch to released version of reconciliation service - fixes issue #629 2013-03-02 16:00:56 -05:00
Tom Morris
a2711e4f59 Correct Suggest property filter - fixes issue 689 2013-03-01 22:26:05 -05:00
Tom Morris
38a88db58d Patch Suggest to accept type param for Search 2013-03-01 18:57:11 -05:00
Tom Morris
7b3379afc7 fix range check in getFields - fixes issue 687 2013-02-26 16:35:21 -05:00
Tom Morris
389e762251 Merge remote-tracking branch 'upstream/master' 2013-02-26 00:01:06 -05:00
Tom Morris
95e13eac50 Improve recon error handling 2013-02-26 00:00:03 -05:00
Tom Morris
a2b60d3d4b Fix filter to blacklist documents correctly 2013-02-25 19:45:25 -05:00
Tom Morris
ed07a4d489 Revert "Black list /type/content in Suggest. Closes issue #632"
This reverts commit 98c64201ef.
2013-02-21 12:45:49 -05:00
Tom Morris
975d18942f Update to Clojure 1.4. Closes issue #634 2013-02-12 00:15:35 -05:00
Tom Morris
50888c6f2e Merge pull request #666 from Arcadelia/Temp-file_removal
Fixed removal of upload temp files
2013-02-11 15:11:24 -08:00
Tom Morris
98c64201ef Black list /type/content in Suggest. Closes issue #632 2013-02-11 17:43:58 -05:00
Tom Morris
ab14198899 Fix last page calculation. Closes #660. 2013-02-11 16:51:34 -05:00
Tom Morris
1033ce973e TODO about memory usage 2013-02-03 15:56:54 -05:00
Jesus M. Castagnetto
71f3196048 added comment on implementation 2013-02-01 23:45:43 -05:00
Jesus M. Castagnetto
36d2c4ac44 Added full text of BSD 2-clause 2013-02-01 23:44:35 -05:00
Jesus M. Castagnetto
df450b20f7 Registering new XOR command 2013-02-01 22:42:01 -05:00
Jesus Castagnetto
fec35a8bc6 Update main/src/com/google/refine/expr/functions/booleans/Xor.java 2013-02-01 21:07:42 -05:00
Jesus Castagnetto
ebec459cfd indentation change 2013-02-01 21:00:36 -05:00
Jesus Castagnetto
473e2f367f Implementing Xor operation 2013-02-01 17:59:16 -08:00
Tom Morris
0da4214f88 Add some tests before working on #640 and #409 2013-02-01 17:14:46 -05:00
Tom Morris
c0347225b8 Switch escape character from NUL to DEL in hopes that it's rarer. 2013-02-01 17:12:07 -05:00
Tom Morris
008df21b33 Update OpenCSV to our fork with multi-character separator support
Built from the openrefine-2.6 branch in the OpenRefine/opencsv repo
2013-01-27 15:21:53 -05:00
Tom Morris
b24b291251 Merge pull request #665 from Arcadelia/IE_Cache-fixes
Fixed history and header update in IE by setting "Cache-Control", "no-cache" in HTTP headers
2013-01-25 16:17:54 -08:00
Mateja Verlic
3b06060597 Tooltip is updated after changing facet expression - fixed #649 2013-01-25 21:56:24 +01:00
Mateja Verlic
7dc7bc0ad1 Updated logos with new ones - part of #630 rebranding 2013-01-25 19:57:10 +01:00
Frank Wennerdahl
2c59a0059f Fixed removal of upload temp files
Fixed an issue with an unclosed stream preventing upload temp files from
being removed after use. Also removed the use of FileCleaningTracker and
instead added manual removal of all tempfiles. By doing this the reaper
threads in FileCleaningTracker are avoided and files are removed
directly after use.
2013-01-24 09:59:09 +01:00
Frank Wennerdahl
64cf62e081 Fixed history and header update in IE
Due to Internet Explorer caching GET requests the Undo/Redo list and
column headers were not updated, leaving essential parts of the user
interface crippled even if Google Frame is installed. Adding
Cache-Control headers to the responses fixes this.
2013-01-24 09:39:12 +01:00
Frank Wennerdahl
1f7ab046c7 Quotes should not be removed from values
Leading quotation marks should not be removed from values. If they have
been left by the importing parser they should be considered part of the
value.
2013-01-24 09:04:17 +01:00
Frank Wennerdahl
ebdc40ad71 Added CSV quote options
Added two additional CSV options, one for parsing and one for export.

Specifying strict quotes when parsing will ignore all data not quoted.
Specifying quote all when exporting will enclose all values in quotes.

No front-end changes made, just added the support for the options in the
requests.
2013-01-21 08:21:16 +01:00
Frank Wennerdahl
f837643f1e Support for multi-char-separators in CSV
This change requires that the following patch is applied to OpenCSV:

http://sourceforge.net/tracker/index.php?func=detail&aid=3599477&group_id=148905&atid=773543
2013-01-18 16:28:27 +01:00
Tom Morris
33aa1132d7 Clarify wording/naming of blank rows export option - fixes issue #651
- clarify that it refers to all non-null cells
- rename variables without compatibility constraints to match actual
function
2013-01-14 16:36:09 -05:00
Tom Morris
d4cef3e2c5 Update to Freebase Suggest 4.1 - Closes #645
- change log for Suggest http://markmail.org/message/ycggcybvtyxep6ne
- most visible fix for Refine is display of /common/topic/article when
/common/topic/description is missing
2013-01-05 15:24:52 -05:00
Tom Morris
3b85ad7a7f Fix up a couple more absolute (or wrong) paths 2012-11-20 16:02:20 -05:00
Tom Morris
04668eb720 Blacklist /common/document in Suggest - fixes #632 2012-11-20 15:15:52 -05:00
Tom Morris
6315036c82 Don't assume notable types are returned by Suggest
Freebase Suggest doesn't always return a notable key in its dictionary,
so we need to check whether it exits.  Fixes issue #636
2012-11-20 14:03:35 -05:00
Tom Morris
2279fe86d7 Merge remote-tracking branch 'upstream/master' 2012-11-20 12:32:02 -05:00
Tom Morris
6e50347c77 Delete unused bad JSON jar 2012-11-18 11:06:35 -05:00
Tom Morris
390ac944aa Revert debug alert accidently committed 2012-11-06 19:15:28 -05:00
Tom Morris
91d67e2ddc Rename Eclipse project to OpenRefine
- change top level Eclipse project from grefine-all to OpenRefine as
part of #630 rebranding
2012-10-19 10:47:10 -04:00
Tom Morris
0bd2104a16 Issue 630: Change branding from Google Refine to OpenRefine
** The first native Github commit (ie not one converted from SVN **
Change Google Refine to OpenRefine or just Refine.  
Change icon filenames and add some placeholder icons
2012-10-18 19:40:31 -04:00