Commit Graph

1357 Commits

Author SHA1 Message Date
Frank Wennerdahl
a0d4eb0058 Job id duplicate fix
Changed how job id's are created to avoid the same id to be assigned to
two concurrent jobs.
2014-02-05 12:21:50 +01:00
Frank Wennerdahl
6dedae37a1 Fixed too frequent job cleanups
The ImportingManager cleans up jobs that has not been touched in 60ms.
According to comment this should be 60 minutes but was changed in
4529310237.
2014-02-05 11:07:41 +01:00
Tom Morris
c2cadab475 Merge pull request #840 from ultraklon/modification3
Adapt to deal with changed jQuery name - fixes #839
2014-02-02 09:19:36 -08:00
Pablo Moyano
cbcb257f7d Proposed fix for #844 2014-01-26 03:01:39 -08:00
Pablo Moyano
23be77ef14 fixing bug #839 2013-12-28 04:19:32 -03:00
Tom Morris
ae56e98522 Merge pull request #827 from Blakko/small-fixes
Tweak: previewCandidate window width
2013-12-22 08:47:01 -08:00
Pablo Moyano
f45ea488cd Correcting typo that was breaking one UI test 2013-12-17 01:40:45 -03:00
Blakko
5aa23d002d The width of the previewCandidate window is set with the one declared in
the reconciliation service
2013-10-15 17:37:31 +02:00
Tom Morris
84c20af185 Switching more big Ys to little ys for java 6 2013-09-19 01:38:09 -04:00
Tom Morris
891f7125d3 One more try at a passing Java 6 test 2013-09-19 01:29:17 -04:00
Tom Morris
a95a3a78d7 Make test Java 6 compatible for TravisCI (hopefully) 2013-09-19 01:16:26 -04:00
Tom Morris
952443c38c Create a HistoryManagerStub to go with ProjectManagerStub for testing 2013-09-18 18:45:45 -04:00
Tom Morris
bc801546cc Remove references to obsolete splitIntoColumns option 2013-09-18 18:44:58 -04:00
Tom Morris
1fb25fcd7c Fix jQuery UI links, fall back to jQuery 1.9.1 as bundled with UI 2013-09-18 18:43:19 -04:00
Tom Morris
0abe663ec0 Fix some deprecated uses of attr(). Backward compatible to jQuery 1.6 2013-09-18 15:38:12 -04:00
Tom Morris
094562e54b Update to latest JQuery and JQuery UI - closes #817
- also remove our custom ESC key handler and its eventstack plugin
dependency since this is handled by default by jQuery
2013-09-18 15:23:07 -04:00
Tom Morris
4f2ebed676 Make localization language list dynamic - fixes #807
- refactor LoadLanguageCommand so language loading can be reused
- add GetLanguagesCommand for the server
- change GUI to fetch language list and update selection list with it
2013-09-18 13:16:24 -04:00
Tom Morris
ab0e36ab87 Remove invalid comments (no comments in JSON!) and add language name
proeprty
2013-09-18 13:13:15 -04:00
Tom Morris
7212b3e726 Tweak wording for change language UI 2013-09-18 11:39:23 -04:00
Tom Morris
1261734f15 Partial solution for #816 plus improved conversion test coverage 2013-09-18 11:14:48 -04:00
Tom Morris
d84f897ae0 Improve help message to specify an integer is returned 2013-09-18 11:12:34 -04:00
Tom Morris
f344e3da1c Return "null" for toString(null) - fixes #783
- also fixed grammar in error message
2013-09-18 10:20:17 -04:00
Tom Morris
daed3bd90c Move MARC->XML conversion to earlier in process - issue #794
- functional now, but probably not good enough to release yet
2013-09-17 19:19:50 -04:00
Tom Morris
6bd6a5934b Start wiring up MARC importer - issue #794 2013-09-17 17:17:23 -04:00
Tom Morris
3f5b117d07 Fix typo in I18N name - closes #790 2013-09-13 13:46:41 -04:00
Tom Morris
cce480ff38 Fix implementation for #466 to handle default empty string 2013-09-04 18:59:13 -04:00
Tom Morris
ec12e5f004 Unescape HTML entities (safely) - fixes #785 2013-09-04 18:40:16 -04:00
Tom Morris
889245fdf4 Make the number of reconciliation results configurable - closes #466 2013-09-04 18:07:12 -04:00
Tom Morris
82b764d06c Set up I18N on preferences page & fix button label id - fixes #804 2013-09-04 15:13:55 -04:00
Thad Guidry
f2c4e3ab48 Added ability to extract MILLISECOND to datePart (milliseconds,ms,S) 2013-08-30 09:09:54 -05:00
Tom Morris
c68c1bb2b1 Upgrade to Clojure 1.5.1 & switch to clojure-slim JAR - #792 2013-08-26 19:40:37 -04:00
Tom Morris
62b8c476f1 Use Java's built-in Number formatter instead of ICU4J which is
massive - #792
2013-08-26 15:47:12 -04:00
Tom Morris
df34978b11 Adjust our search parameters to match needs of Suggest 4.3 - closes #762 2013-08-20 09:57:44 -04:00
Tom Morris
7885256d78 Fix small Freebase preview widget text - fixes #763 2013-08-20 09:48:22 -04:00
Tom Morris
6440194658 Update broken Butterfly build 2013-08-18 12:37:26 -04:00
Tom Morris
4529310237 Switch from TimerTask to ScheduledExecutorService for more robustness 2013-08-18 11:31:03 -04:00
Tom Morris
25a3de410f Update to patched version of Butterfly - fixes #652 2013-08-18 11:24:33 -04:00
Tom Morris
e93bfa798e Use iterator when removing to avoid ConcurrentModificationException -
fixes #652
2013-08-17 13:45:22 -04:00
Tom Morris
3315136681 Allow reinitializatoin of ProjectManager singleton - fixes #787 2013-08-17 12:47:57 -04:00
Tom Morris
25f02dd9b9 Fix Java 6 incompatibility 2013-08-15 15:57:24 -04:00
Tom Morris
fa072df85c Add locale support to toDate() - fixes #729 2013-08-15 15:19:01 -04:00
Tom Morris
ab42df6ea3 Merge pull request #658 from Arcadelia/CSV_Multi-char-separator_support
Support for multi-char-separators in CSV
2013-08-14 07:29:45 -07:00
Tom Morris
37d8abc114 Minor improvement to recon error handling 2013-08-10 18:03:06 -04:00
Tom Morris
8b59e1ed5b Delete Suggest 4.2 - #762 2013-08-10 18:00:09 -04:00
Tom Morris
cafdb5c70a Reapply patch to Suggest to allow type param to be passed through to
Search
2013-08-10 17:59:15 -04:00
Tom Morris
4fd20f1b4e Update to Suggest 4.3 - fixes #762 2013-08-10 17:56:09 -04:00
Tom Morris
1d8784e059 Make workspace saving and loading more robust - fixes #528
- don't overwrite old files if we get an error writing new ones
- don't write unchanged data
- keep backup files around until next write rather than deleting
immediately
- attempt to recreate missing metadata as best as possible
2013-08-09 19:53:53 -04:00
Tom Morris
c4bd5d7392 Fix typo in Best candidates type match label - fixes #775 2013-08-08 13:34:05 -04:00
Tom Morris
b1e56a4dab Fix display of HTML encoded NBSP characters - fixes #766 2013-08-08 11:49:13 -04:00
Tom Morris
579d71b7eb Switch back to NUL character for quote now that OpenCSV handles it -
fixes #653
2013-08-07 17:07:17 -04:00
Tom Morris
cf6e855bf5 Update to latest patched OpenCSV 2013-08-07 16:18:48 -04:00
Tom Morris
71a9d2e0af Switch from encodeURIComponent to encodeURI - revised fix for #290 2013-08-06 13:35:34 -04:00
Tom Morris
0c483fa9f6 Correct I18N code for progress display - really fix #767 this time 2013-08-06 12:20:23 -04:00
Tom Morris
7b5b549113 More project saving changes for #528
- reduce project retention in memory from 1 hr to 15 min.
- free all unmodified projects if we get an error on save (we could be
running low on memory)
- make sure exceptions propagate up to where they can be usefully
handled
2013-08-05 14:13:56 -04:00
Tom Morris
190a031a8a Comments only. No code changes. 2013-08-05 14:11:06 -04:00
Tom Morris
3500f20e47 Save all modified projects before importing new one - hopefully helps
#528
2013-08-05 14:10:26 -04:00
Tom Morris
57f5e9873d Add Javadoc. No code changes. 2013-08-05 13:08:30 -04:00
Tom Morris
c3cab0524a Narrow exceptions thrown and let them propagate up so we know
workspace file isn't valid - first step for #528
2013-08-05 13:08:02 -04:00
Tom Morris
94936d7374 Fix variable name typo - fixes #767 2013-08-03 15:55:47 -04:00
Tom Morris
36e4fd1ef5 URI encode IDs before replacing them in URL. Fixes #290 2013-08-03 13:50:37 -04:00
Tom Morris
a7273625d7 Add support for Basic Authentication over HTTPS - addresses #217 2013-08-02 19:15:24 -04:00
Tom Morris
4f7da9d18e Switch to Apache HTTP client for downloads - fixes #748 2013-08-02 18:13:41 -04:00
Tom Morris
d7531bbbd8 Handle quoted fields with embedded new lines. Sort separators by score
rather than just standard deviation
2013-08-02 17:59:09 -04:00
Tom Morris
f4ff227340 Clean up localization - fixes #760, modifies pull request #755
- make all file loading relative to module base
- move core language files into appropriate place
- eliminate all SetLanguage commands and use SetPreference instead
- eliminate all LoadLanguage commands except for core's
- fix duplicate keys in JSON language files
- remove BOM from JSON language files

OPEN - task 760: Translations not being loaded from built kit 
http://github.com/OpenRefine/OpenRefine/issues/issue/760
2013-07-31 00:31:31 -04:00
Tom Morris
9450d483ce Fix up line endings 2013-07-29 15:49:20 -04:00
Tom Morris
3003c1a709 Make importers more robust to preview errors when someone selects the
wrong importer/parser
2013-07-27 13:35:12 -04:00
Tom Morris
57ca70132c Turn all import conversions off by default - fixes #478 2013-07-27 13:32:26 -04:00
Tom Morris
5123dad6a8 More conservative approach for locking of jobs table 2013-07-26 18:51:08 -04:00
Tom Morris
0dc14af1aa Fix bug in refactoring of ImportingJob from commit
1e5f89e84c
2013-07-26 18:50:03 -04:00
Tom Morris
46a1e198d8 Recompute max cell index when rebuiling maps in ColumnModel - fixes #406 2013-07-26 18:48:20 -04:00
Tom Morris
7edc550618 Give a reasonable error message on Excel 95 import failure - fixes #564 2013-07-26 16:24:56 -04:00
Tom Morris
ff4eeb549a Fix typo 2013-07-26 15:35:18 -04:00
Tom Morris
dc4d04c132 Allow arrays containing null in Filter & ForEach - fixes #741 2013-07-26 15:20:44 -04:00
Tom Morris
c8f0e88bd4 Replace retired Freebase Topic Blocks with Freebase Suggest flyout -
part of
#696
2013-07-26 10:55:42 -04:00
Tom Morris
559e0124ca Switch to patched (& non-minified) Suggest 4.2 2013-07-26 10:52:49 -04:00
Tom Morris
d16e8404b4 Patch Freebase Suggest 4.2 to deal with Freebase Search changes. 2013-07-26 10:50:22 -04:00
Tom Morris
1e5f89e84c Centralize handling of import job config object & synchronize to allow
multiple accessors
2013-07-25 15:41:08 -04:00
Tom Morris
dc206e1889 Switch to ConcurrentHashMap for jobs table to allow multiple accessors 2013-07-25 15:36:54 -04:00
Tom Morris
0ff2d7ed9f Simplify implementation from pull request #728 2013-07-25 13:45:44 -04:00
Tom Morris
6dd4b8ea23 Add tests for boolean functions and tighten up error handling 2013-07-25 13:45:04 -04:00
Tom Morris
2c2c0d3d68 Merge pull request #728 from jmcastagnetto/master
Implements Xor operation
2013-07-25 10:00:11 -07:00
Tom Morris
70d4229a2f Restore code mistakenly removed in
109138366b
 Put it where Eclipse doesn't get confused about it being unreferenced
2013-07-25 12:43:05 -04:00
Tom Morris
218ea46a4d Merge remote-tracking branch 'blakko/internationalization' - close #755
Conflicts:
	extensions/freebase/module/scripts/dialogs/schema-alignment/schema-alignment-dialog.html
	main/webapp/modules/core/index.vt
	main/webapp/modules/core/project.vt
	main/webapp/modules/core/scripts/project/browsing-engine.js
	main/webapp/modules/core/scripts/project/history-panel.html
2013-07-25 10:53:25 -04:00
Tom Morris
78bf52ff69 Add hyphens to camel case wiki links. Use https everywhere. fixes #757 2013-07-25 10:29:41 -04:00
Blakko
6e90bc41f6 Merge remote-tracking branch 'origin/master' into internationalization
Conflicts:
	extensions/freebase/module/scripts/dialogs/schema-alignment/schema-alignment-dialog.html
	main/webapp/modules/core/index.vt
	main/webapp/modules/core/project.vt
	main/webapp/modules/core/scripts/project/browsing-engine.js
	main/webapp/modules/core/scripts/project/history-panel.html
2013-07-25 11:07:59 +02:00
Tom Morris
109138366b Range check column move. Delete dead code. Fixes #602 2013-07-24 18:25:21 -04:00
Blakko
e6e6c8c002 Added a "Language Settings" menu at index
Now the language manually set has priority over the browser lang
Update translations
2013-07-12 11:12:33 +02:00
Blakko
13722c467b Added default translation file 2013-07-11 16:50:27 +02:00
Blakko
75277c18c9 added italian translation 2013-07-11 15:05:01 +02:00
Blakko
9f9e75400e Added internationalization for some missing labels 2013-07-11 15:01:45 +02:00
Blakko
d9ccaf53ad More small bugfixes 2013-07-11 11:05:13 +02:00
Tom Morris
1353f7f7aa Update Apache HTTP client JARs to 4.2.5 2013-07-10 15:16:21 -04:00
Tom Morris
92e4427c39 Adding a TODO 2013-07-10 15:13:22 -04:00
Tom Morris
32773122c4 Fix CollationKey creation - fixes #753 2013-07-10 15:12:49 -04:00
Tom Morris
163546de94 Remove update JARs 2013-07-09 14:17:40 -04:00
Blakko
8a0f23be3b Internationalization of the data-table part 2013-07-09 15:57:25 +02:00
Blakko
5e10a91175 Internationalization of the util part 2013-07-08 12:33:05 +02:00
Blakko
eb3eba9c5e Internationalization of the reconciliation part 2013-07-08 11:40:11 +02:00
Blakko
4492ca3bed Internationalization of the project part 2013-07-05 16:32:12 +02:00
Blakko
19b91bd282 Internationalization of the facets part 2013-07-05 09:30:37 +02:00
Blakko
5a6bef4162 Internationalization of the dialog part 2013-07-04 11:51:04 +02:00
Blakko
552b0bf94b Internationalization of the index part (create/open/update) of refine 2013-07-02 13:40:50 +02:00
Tom Morris
5b6bc888f7 Fix template escape processing. Fixes #752. 2013-06-30 12:21:26 -04:00
Blakko
817c6cc8d4 Added jquery i18n plugin to Open Refine 2013-06-27 12:01:47 +02:00
Tom Morris
a015b4e184 Update help links to point to new wiki. Fixes #716. 2013-06-23 15:34:47 -04:00
Tom Morris
8cb1dc05f8 Really restore Java 6 compatibilty 2013-06-23 14:42:05 -04:00
Tom Morris
3b835fabad Restore Java 6 compatibility 2013-06-23 14:11:30 -04:00
Charles Pritchard
d68351f93e FIXED: #731 Undo History Extract panel needs max width 2013-06-23 13:42:02 -04:00
Charles Pritchard
05389aa099 Fixed checkbox restore in custom tabular exporter dialog box when applying saved JSON 2013-06-23 13:40:36 -04:00
Tom Morris
bad5bc37b2 Watch paste events on input fields. Fixes #730. 2013-06-23 13:37:29 -04:00
Tom Morris
a3b4b45e4e Support non-string types in facetCount() - fixes #591 2013-06-23 12:04:48 -04:00
Tom Morris
51c1bc4a2f Refactor default toString with date support into separate utility 2013-06-23 12:02:13 -04:00
Tom Morris
a42925f3c8 Remove unused code 2013-06-23 11:21:48 -04:00
Tom Morris
c961bb64de Flush all column caches on row removals/changes. Fixes issue 567. 2013-06-22 18:44:26 -04:00
Tom Morris
fd58bd3327 Move documentation to Javadoc where it's visible 2013-06-22 16:27:18 -04:00
Tom Morris
6e88d068ee Throw a narrower exception 2013-06-22 16:26:45 -04:00
Tom Morris
43b2d89703 Remove dead code 2013-06-22 16:23:14 -04:00
Jesus M. Castagnetto
0795bd8422 resolved .gitignore conflict 2013-06-19 12:10:32 -05:00
Jesus M. Castagnetto
b09bb4463e fix error in index caught by thadguidry 2013-06-19 11:21:26 -05:00
Tom Morris
b91fc8a2b1 Use CollationKeys when sorting text. Fixes issue 738 2013-06-17 15:51:29 -04:00
Tom Morris
e1bea25c72 Clean up server tests
- move from shell script to Ant
- update TestNG and Mockito to latest versions
2013-06-11 19:44:58 -04:00
Tom Morris
067fcacec7 Clean up to pass tests:
- don't include TAB in control characters which get stripped so we can
use it for splitting
- remove trailing space from normalize strings
2013-05-31 17:06:03 -04:00
Tom Morris
1907bcd8dc Disable tests for character decomposition 2013-05-31 17:04:09 -04:00
Tom Morris
000c0a38a8 Compute delay from request issue, not response return. Fixes #721 2013-05-26 10:13:16 -04:00
Tom Morris
4a5d3d4662 Convert dates to ISO 8601 for reconciliation. Fixes #688. 2013-05-26 10:08:55 -04:00
Tom Morris
7615db97cf Add Javadoc clean up variable naming. No functional change. 2013-05-26 10:07:37 -04:00
Tom Morris
bf837e82ba Add TODO 2013-05-26 08:01:38 -04:00
Tom Morris
36dd95c263 Add TODO for record mode operation 2013-05-26 07:54:33 -04:00
Tom Morris
3bc36a997e Reapply patch to pass "type" parameter through to Search 2013-05-26 07:48:51 -04:00
Tom Morris
02b0816cc9 Update to Suggest 4.2 2013-05-26 07:47:14 -04:00
Tom Morris
d1b2dc3fe9 Add type to text input field - fixes #706
Even though type="text" is the default, the find won't work without it
explicitly included
2013-04-13 17:04:03 -04:00
Tom Morris
0d2881dac6 Update link to help
Switch from Google Code to Github
2013-04-13 16:50:56 -04:00
Tom Morris
567da6aa9f Normalize line endings
Add .gitattributes & do one-time normalization of line endings
2013-03-23 18:46:20 -04:00
Tom Morris
6a91b5d75b Use InputStream instead of Reader for JSON import - fixes #698 2013-03-23 18:36:05 -04:00
Tom Morris
6b3592982e Remove O(n^2) issue in tree importers - fixes #699
- Add sparse/based list implementation for ImportRecord
2013-03-23 12:02:51 -04:00
Tom Morris
f78dfadcf3 Clean up tree import utilities for #699
- lazy allocate objects
- conditionalize logging to prevent calls to StringBuilder & toString()

These are secondary issues, but still worth cleaning up.
2013-03-23 11:56:58 -04:00
Tom Morris
0a2ba1b1ae Switch from LinkedList to ArrayList
Just a simple list.  No need for extra overhead..
2013-03-23 08:16:23 -04:00
Tom Morris
56389588e3 Update to Jackson 1.9.12 2013-03-23 08:15:08 -04:00
Tom Morris
bfa7c34d17 Merge pull request #659 - closes #659 2013-03-18 21:24:01 -04:00
Tom Morris
31cffa1181 Merge remote-tracking branch 'upstream/master' 2013-03-18 21:16:55 -04:00
Tom Morris
8a61cf731b Merge pull request #664 from Arcadelia/Preserve_Quotes
Quotes should not be removed from values
2013-03-18 18:12:51 -07:00
Tom Morris
fe943fe3ea Flag English specific stopwords for cleanupp 2013-03-18 20:20:46 -04:00
Tom Morris
a06e16a9e5 Update some Javascript uses to new Freebase API - part of #696 2013-03-12 17:46:18 -04:00
Tom Morris
054ea643c3 Replace Google API key for Suggest - fixes #679 2013-03-12 17:27:58 -04:00
Tom Morris
7b9f6836e1 Update key & id recon to new Freebase APIs - part of #696 2013-03-12 16:50:23 -04:00
Tom Morris
7578d3375f Add logger and logging
- fix exception printing that goes nowhere
- make logger available for subclasses to use
2013-03-11 13:14:20 -04:00
Tom Morris
a2a8f4af2e Patch applied - closed #315 2013-03-06 21:45:54 -05:00
Tom Morris
d8d82bf8b7 Clean up a couple more format guessing issues left over from #685 2013-03-06 20:39:39 -05:00
Tom Morris
369bfffb2f Don't guess field widths unless we have at least 3 lines
- Investigation of #685 showed that single line files were being guessed
as fixed field width
2013-03-04 17:47:06 -05:00
Tom Morris
6b676f7513 Handle MIME media types which have charset param - fixes #685 2013-03-04 17:45:34 -05:00
Tom Morris
10bd7e3b75 Make upper bound of time facet inclusive - fixes issue #648 2013-03-03 16:06:20 -05:00
Tom Morris
5778a18b05 Switch to new reconcile service for namespaced lookups 2013-03-03 15:42:48 -05:00
Tom Morris
c2f2db52ab Fix issue #691 - include /common/topic properties
- Switch to new openrefine-helper app which includes /common/topic
properties in list
- Fix Suggest setup to allow /common/topic properties
2013-03-03 15:42:06 -05:00
Tom Morris
eba03fc69e Protect joins map with mutex - fixes issue #652 2013-03-03 09:36:43 -05:00
Tom Morris
0dfd7d7112 Blacklist /common/resource in Suggest - extends fix for issue #632 2013-03-03 09:17:48 -05:00
Tom Morris
23cc319fd7 Switch to released version of reconciliation service - fixes issue #629 2013-03-02 16:00:56 -05:00
Tom Morris
a2711e4f59 Correct Suggest property filter - fixes issue 689 2013-03-01 22:26:05 -05:00
Tom Morris
38a88db58d Patch Suggest to accept type param for Search 2013-03-01 18:57:11 -05:00
Tom Morris
7b3379afc7 fix range check in getFields - fixes issue 687 2013-02-26 16:35:21 -05:00
Tom Morris
389e762251 Merge remote-tracking branch 'upstream/master' 2013-02-26 00:01:06 -05:00
Tom Morris
95e13eac50 Improve recon error handling 2013-02-26 00:00:03 -05:00
Tom Morris
a2b60d3d4b Fix filter to blacklist documents correctly 2013-02-25 19:45:25 -05:00
Tom Morris
ed07a4d489 Revert "Black list /type/content in Suggest. Closes issue #632"
This reverts commit 98c64201ef.
2013-02-21 12:45:49 -05:00
Tom Morris
975d18942f Update to Clojure 1.4. Closes issue #634 2013-02-12 00:15:35 -05:00
Tom Morris
50888c6f2e Merge pull request #666 from Arcadelia/Temp-file_removal
Fixed removal of upload temp files
2013-02-11 15:11:24 -08:00
Tom Morris
98c64201ef Black list /type/content in Suggest. Closes issue #632 2013-02-11 17:43:58 -05:00
Tom Morris
ab14198899 Fix last page calculation. Closes #660. 2013-02-11 16:51:34 -05:00
Tom Morris
1033ce973e TODO about memory usage 2013-02-03 15:56:54 -05:00
Jesus M. Castagnetto
71f3196048 added comment on implementation 2013-02-01 23:45:43 -05:00
Jesus M. Castagnetto
36d2c4ac44 Added full text of BSD 2-clause 2013-02-01 23:44:35 -05:00
Jesus M. Castagnetto
df450b20f7 Registering new XOR command 2013-02-01 22:42:01 -05:00
Jesus Castagnetto
fec35a8bc6 Update main/src/com/google/refine/expr/functions/booleans/Xor.java 2013-02-01 21:07:42 -05:00
Jesus Castagnetto
ebec459cfd indentation change 2013-02-01 21:00:36 -05:00
Jesus Castagnetto
473e2f367f Implementing Xor operation 2013-02-01 17:59:16 -08:00
Tom Morris
0da4214f88 Add some tests before working on #640 and #409 2013-02-01 17:14:46 -05:00
Tom Morris
c0347225b8 Switch escape character from NUL to DEL in hopes that it's rarer. 2013-02-01 17:12:07 -05:00
Tom Morris
008df21b33 Update OpenCSV to our fork with multi-character separator support
Built from the openrefine-2.6 branch in the OpenRefine/opencsv repo
2013-01-27 15:21:53 -05:00
Tom Morris
b24b291251 Merge pull request #665 from Arcadelia/IE_Cache-fixes
Fixed history and header update in IE by setting "Cache-Control", "no-cache" in HTTP headers
2013-01-25 16:17:54 -08:00
Mateja Verlic
3b06060597 Tooltip is updated after changing facet expression - fixed #649 2013-01-25 21:56:24 +01:00
Mateja Verlic
7dc7bc0ad1 Updated logos with new ones - part of #630 rebranding 2013-01-25 19:57:10 +01:00
Frank Wennerdahl
2c59a0059f Fixed removal of upload temp files
Fixed an issue with an unclosed stream preventing upload temp files from
being removed after use. Also removed the use of FileCleaningTracker and
instead added manual removal of all tempfiles. By doing this the reaper
threads in FileCleaningTracker are avoided and files are removed
directly after use.
2013-01-24 09:59:09 +01:00
Frank Wennerdahl
64cf62e081 Fixed history and header update in IE
Due to Internet Explorer caching GET requests the Undo/Redo list and
column headers were not updated, leaving essential parts of the user
interface crippled even if Google Frame is installed. Adding
Cache-Control headers to the responses fixes this.
2013-01-24 09:39:12 +01:00
Frank Wennerdahl
1f7ab046c7 Quotes should not be removed from values
Leading quotation marks should not be removed from values. If they have
been left by the importing parser they should be considered part of the
value.
2013-01-24 09:04:17 +01:00
Frank Wennerdahl
ebdc40ad71 Added CSV quote options
Added two additional CSV options, one for parsing and one for export.

Specifying strict quotes when parsing will ignore all data not quoted.
Specifying quote all when exporting will enclose all values in quotes.

No front-end changes made, just added the support for the options in the
requests.
2013-01-21 08:21:16 +01:00
Frank Wennerdahl
f837643f1e Support for multi-char-separators in CSV
This change requires that the following patch is applied to OpenCSV:

http://sourceforge.net/tracker/index.php?func=detail&aid=3599477&group_id=148905&atid=773543
2013-01-18 16:28:27 +01:00
Tom Morris
33aa1132d7 Clarify wording/naming of blank rows export option - fixes issue #651
- clarify that it refers to all non-null cells
- rename variables without compatibility constraints to match actual
function
2013-01-14 16:36:09 -05:00
Tom Morris
d4cef3e2c5 Update to Freebase Suggest 4.1 - Closes #645
- change log for Suggest http://markmail.org/message/ycggcybvtyxep6ne
- most visible fix for Refine is display of /common/topic/article when
/common/topic/description is missing
2013-01-05 15:24:52 -05:00
Tom Morris
3b85ad7a7f Fix up a couple more absolute (or wrong) paths 2012-11-20 16:02:20 -05:00
Tom Morris
04668eb720 Blacklist /common/document in Suggest - fixes #632 2012-11-20 15:15:52 -05:00
Tom Morris
6315036c82 Don't assume notable types are returned by Suggest
Freebase Suggest doesn't always return a notable key in its dictionary,
so we need to check whether it exits.  Fixes issue #636
2012-11-20 14:03:35 -05:00
Tom Morris
2279fe86d7 Merge remote-tracking branch 'upstream/master' 2012-11-20 12:32:02 -05:00
Tom Morris
6e50347c77 Delete unused bad JSON jar 2012-11-18 11:06:35 -05:00
Tom Morris
390ac944aa Revert debug alert accidently committed 2012-11-06 19:15:28 -05:00
Tom Morris
91d67e2ddc Rename Eclipse project to OpenRefine
- change top level Eclipse project from grefine-all to OpenRefine as
part of #630 rebranding
2012-10-19 10:47:10 -04:00
Tom Morris
0bd2104a16 Issue 630: Change branding from Google Refine to OpenRefine
** The first native Github commit (ie not one converted from SVN **
Change Google Refine to OpenRefine or just Refine.  
Change icon filenames and add some placeholder icons
2012-10-18 19:40:31 -04:00
Tom Morris
03d997be8e FIXED - task 576: Use relative paths so works under a Java server named context - patch supplied by sergio@wikier.org
http://code.google.com/p/google-refine/issues/detail?id=576

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2584 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-13 17:47:08 +00:00
Tom Morris
068e0916a2 FIXED - task 587: Correct initialization of the temporary directory - patch from the Wikier project
http://code.google.com/p/google-refine/issues/detail?id=587
https://bitbucket.org/wikier/google-refine/changeset/f3dbdb16a320#chg-main/src/com/google/refine/RefineServlet.java

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2583 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-13 15:58:44 +00:00
Tom Morris
4d48741ce0 FIXED - task 574: create safe sheet names for Excel export - patch from jd@tekii.com.ar
http://code.google.com/p/google-refine/issues/detail?id=574

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2582 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-12 23:05:17 +00:00
Tom Morris
c003ef42a2 Missed a Freebase Suggest version change.
http://code.google.com/p/google-refine/issues/detail?id=630

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2581 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-12 22:41:04 +00:00
Tom Morris
12308c2840 task 584: Add a timeout of 10 seconds for reconciliation service to respond
http://code.google.com/p/google-refine/issues/detail?id=584

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2580 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-12 22:29:53 +00:00
Tom Morris
3ff52ba494 FIXED - task 584: remove busy spinner & show error if failed to query new recon service
http://code.google.com/p/google-refine/issues/detail?id=584

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2579 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-12 20:33:33 +00:00
Tom Morris
f135b1b8d9 FIXED - task 579: Rebuild services map when deleting recon service - patch from sergio@wikier.org
http://code.google.com/p/google-refine/issues/detail?id=579

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2578 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-12 19:49:33 +00:00
Tom Morris
bfb76d5907 FIXED - task 628: update to Freebase Suggest 4.0 - patch supplied by sdeo@google.com
http://code.google.com/p/google-refine/issues/detail?id=628

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2576 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-12 18:52:06 +00:00
Tom Morris
8defe9ee32 FIXED - task 628: update to Freebase Suggest 4.0 - patch supplied by sdeo@google.com
http://code.google.com/p/google-refine/issues/detail?id=628

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2575 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-12 18:39:05 +00:00
Tom Morris
ca2e959957 FIXED - task 529: Add support for key/value transpose with only two columns as well as repeating key fields in a single record.
http://code.google.com/p/google-refine/issues/detail?id=529

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2574 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-05 23:31:25 +00:00
Tom Morris
ffe674729c Just a little Javadoc. No functional changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2573 7d457c2a-affb-35e4-300a-418c747d4874
2012-10-05 21:10:32 +00:00
Tom Morris
2c52a00f55 Fixed - issue 544,600,618: Clean up handling of compressed files & archives with multi-segment paths
http://code.google.com/p/google-refine/issues/detail?id=600


git-svn-id: http://google-refine.googlecode.com/svn/trunk@2569 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-22 18:08:56 +00:00
Tom Morris
748e205ae8 FIXED - task 616: Support bzip2 decompression on import
http://code.google.com/p/google-refine/issues/detail?id=616

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2568 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-22 16:00:42 +00:00
Tom Morris
27e3c0c8dc FIXED - task 614: Use same instance of OAuthProvider in OAuth dance. Patch supplied by sdeo@google.com
http://code.google.com/p/google-refine/issues/detail?id=614

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2566 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-19 23:16:29 +00:00
Tom Morris
b3f5fada95 FIXED - task 578 & 596: Clean up JSON importer
http://code.google.com/p/google-refine/issues/detail?id=578
http://code.google.com/p/google-refine/issues/detail?id=596

Extend tree parser framework to allow any Serializable instead of just Strings. Use this in JSON importer to: Import keywords null, true, false; Import empty strings and don't trim whitespace from strings on import;  Import numbers directly instead of importing them as text and then parsing them ourselves. Add tests to verify all this stuff

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2543 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-08 01:20:25 +00:00
Tom Morris
9f7d0bc057 FIXED - task 607: Make memory/heap reporting more user-friendly
http://code.google.com/p/google-refine/issues/detail?id=607

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2542 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-07 21:49:00 +00:00
Tom Morris
93d6e176d6 Task 478: Default "guess datatypes" to False so importers which don't specify it (e.g. gData & Excel) aren't effected
http://code.google.com/p/google-refine/issues/detail?id=478

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2541 7d457c2a-affb-35e4-300a-418c747d4874
2012-09-07 21:17:34 +00:00
Tom Morris
83dce305cb FIXED - task 432: cross() failing - flush join cache table when column changes
http://code.google.com/p/google-refine/issues/detail?id=432

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2539 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-30 16:31:22 +00:00
Tom Morris
9b54a8f29e FIXED - task 559: Deadlock between autosave thread and history code
http://code.google.com/p/google-refine/issues/detail?id=559

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2538 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-30 16:22:28 +00:00
Stefano Mazzocchi
ba89daec1c make oauth against freebase work again in chrome
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2537 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-23 20:58:08 +00:00
Tom Morris
be6bdfe50a Restore old JSON library jar
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2535 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-21 17:29:47 +00:00
Tom Morris
12a61b6ec6 task 603: range check column move commands
http://code.google.com/p/google-refine/issues/detail?id=603

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2534 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-18 22:01:23 +00:00
Tom Morris
202018fac4 Add Javadoc. No code changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2533 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-18 22:00:41 +00:00
Tom Morris
60c3a31242 Update Jackson and JSON libs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2532 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-18 21:46:49 +00:00
Tom Morris
4bb6c43982 task 604: add Guava to main project so that we're not dependent on an extension
http://code.google.com/p/google-refine/issues/detail?id=604

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2531 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-15 13:33:17 +00:00
Tom Morris
7c7e10d9f5 Fix silly cut & paste test name.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2530 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-14 23:11:42 +00:00
Tom Morris
1e043dcc94 FIXED - task 604: The common transform “Trim leading and trailing whitespace” doesn’t trim non-breaking spaces
http://code.google.com/p/google-refine/issues/detail?id=604

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2529 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-14 23:00:13 +00:00
Tom Morris
f29f77e8f8 STARTED - task 604: The common transform “Trim leading and trailing whitespace” doesn’t trim non-breaking spaces
http://code.google.com/p/google-refine/issues/detail?id=604

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2528 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-14 20:09:49 +00:00
Tom Morris
40dbe79a03 FIXED - task 601: Allow selection of root element on JSON import
http://code.google.com/p/google-refine/issues/detail?id=601

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2527 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-09 14:17:35 +00:00
Tom Morris
4bf212c03d FIXED - task 154: Can't import RDF/XML Data
http://code.google.com/p/google-refine/issues/detail?id=154

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2526 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-05 16:31:41 +00:00
Tom Morris
5881addac8 Throw an exception if unsupported verb is used
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2525 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-05 15:36:23 +00:00
Tom Morris
264a7dfc77 NEW - task 599: RDF/XML parser preview not wired up
http://code.google.com/p/google-refine/issues/detail?id=599

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2523 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-04 18:02:45 +00:00
Tom Morris
cdaf60c20b FIXED - task 597: Deselect all button on Custom Tabular Exporter dialog doesn't work
http://code.google.com/p/google-refine/issues/detail?id=597

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2521 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-03 22:11:51 +00:00
Tom Morris
b2ae74d23f FIXED - task 586: Only one parse date format is attempted from list in toDate(format1,format2)
http://code.google.com/p/google-refine/issues/detail?id=586

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2520 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-03 18:01:01 +00:00
Tom Morris
4319314675 FIXED - task 594: Date diff function doesn't work for two Calendar objects
http://code.google.com/p/google-refine/issues/detail?id=594

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2519 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-02 21:41:19 +00:00
Tom Morris
efa58630cf Add constructor that takes a Throwable to eliminate redundant code from callers.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2518 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-02 21:38:00 +00:00
Stefano Mazzocchi
2947ebba0e updating the signpost library and attaching sources for easier inspection
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2517 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-01 21:47:21 +00:00
Stefano Mazzocchi
2cb31b8b29 fixing oauth problems with redirection for the Freebase API
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2516 7d457c2a-affb-35e4-300a-418c747d4874
2012-08-01 21:46:53 +00:00
David Huynh
4cfb921082 Added getStringKey() method for when it is difficult to generate integer keys that don't collide
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2515 7d457c2a-affb-35e4-300a-418c747d4874
2012-07-19 00:25:41 +00:00
Stefano Mazzocchi
5dffd249de updating signpost to the latest release
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2514 7d457c2a-affb-35e4-300a-418c747d4874
2012-07-13 06:50:53 +00:00
Stefano Mazzocchi
6e41f4ad91 make the latest eclipse happy (it triggers a warning)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2513 7d457c2a-affb-35e4-300a-418c747d4874
2012-07-12 01:55:11 +00:00
Stefano Mazzocchi
3b8701aeee further cleanup, sign.js should not contain presentation-related code
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2512 7d457c2a-affb-35e4-300a-418c747d4874
2012-07-12 01:54:24 +00:00
Stefano Mazzocchi
b634a03dbb moving the sign.js in the main refine block as this is potentially useful for all extensions that use the oauth mechanics
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2511 7d457c2a-affb-35e4-300a-418c747d4874
2012-07-12 01:52:15 +00:00
Stefano Mazzocchi
bccea8cebe we could be leaking file descriptors here
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2506 7d457c2a-affb-35e4-300a-418c747d4874
2012-06-30 07:05:08 +00:00
Stefano Mazzocchi
f84dcff900 moving oauth authorize and deauthrorize into the core module because they are reusable across extensions
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2505 7d457c2a-affb-35e4-300a-418c747d4874
2012-06-29 19:39:42 +00:00
Tom Morris
8872c1b0a1 Keep track of when we have unsaved preference changes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2502 7d457c2a-affb-35e4-300a-418c747d4874
2012-06-02 21:06:46 +00:00
Tom Morris
a0812c5751 Be slightly more tolerant of weird spreadsheet data
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2501 7d457c2a-affb-35e4-300a-418c747d4874
2012-06-02 21:00:30 +00:00
Tom Morris
07ed203ddd Update to jQuery 1.7.2 and jQuery UI 1.8.20
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2500 7d457c2a-affb-35e4-300a-418c747d4874
2012-05-18 22:39:57 +00:00
Tom Morris
c47b1e0ab7 Mark project as modified when metadata is changed
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2491 7d457c2a-affb-35e4-300a-418c747d4874
2012-04-14 14:10:11 +00:00
Tom Morris
166b176ba2 Update to Apache POI 3.8
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2486 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-29 04:41:42 +00:00
Tom Morris
8d22ede1f8 Issue 554 - rank formats *before* serializing them.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2482 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-16 20:21:57 +00:00
Tom Morris
b3f8ce83c1 Issue 553 - Make sure we have a usable filename when importing from a URL
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2481 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-16 20:16:18 +00:00
Tom Morris
51c586bc2c Issue 543 - Handle HTTP responses with Content-Encoding of gzip
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2480 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-16 20:12:10 +00:00
Tom Morris
a8cb23ca51 Issue 544 - preserve directory path after decompressing file
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2479 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-16 20:06:54 +00:00
Tom Morris
70a6a28c59 Add application/javascript as an alternate MIME type for JSON (used by Pinterest)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2478 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-16 19:53:19 +00:00
Tom Morris
e97e7523b2 Issue 548 - Convert non-strings to strings before escaping
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2463 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-14 03:06:11 +00:00
Tom Morris
18b780bebe Issue 517 - Fix combin() function to a) increase upper limit and b) keep it from continually recomputing the same values in recursion
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2459 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-08 22:53:21 +00:00
Tom Morris
28ff2295fd Issue 490 - Handle separator guessing for CSVs with quoted fields containing commas
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2458 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-08 15:53:55 +00:00
Tom Morris
9a680e8307 Switch to class name for logging, per convention
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2457 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-08 14:53:27 +00:00
Tom Morris
ab4c0cb21c Some basic type conversion tests
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2456 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-08 14:49:03 +00:00
Tom Morris
ddd3680128 Add a TODO for recon failure retries on HTTP 500s - no functional changes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2455 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-08 14:45:53 +00:00
Tom Morris
5a962b1768 Issue 534 - Attempt to recover recon links which have become corrupted
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2454 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-08 00:37:29 +00:00
Tom Morris
dbdbd906b7 Issue 547 - Decompress kmz files
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2453 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-08 00:29:25 +00:00
Tom Morris
4a99abf25d Isse 542 - allow integers to be converted to dates
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2450 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-03 21:36:36 +00:00
Tom Morris
8ff6c5617f Update Jackson parser to 1.9.5
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2448 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-01 18:11:28 +00:00
Tom Morris
5d080e5b3e Wrap if statement in a block to avoid future problems.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2447 7d457c2a-affb-35e4-300a-418c747d4874
2012-03-01 18:10:59 +00:00
Tom Morris
c583ad4367 Issue 537 - Try to convert to Long first before converting to Double. Matches behavior on import.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2446 7d457c2a-affb-35e4-300a-418c747d4874
2012-02-26 17:27:00 +00:00
Tom Morris
190e817fb8 Protect against NullPointerException
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2444 7d457c2a-affb-35e4-300a-418c747d4874
2012-02-22 20:06:03 +00:00
David Huynh
e21ae32722 Make sure project ID is completely numeric. Slightly better error reporting on project page when project ID is not valid.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2441 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-29 21:16:13 +00:00
David Huynh
4fbfd17ddf Fixed typo "cancelImportinJob".
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2440 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-29 08:01:05 +00:00
Tom Morris
6414ae7f87 Remove redundant test
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2436 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-27 20:38:55 +00:00
Tom Morris
40183aa0ba Issue 513 - get rid of exception at end of import in JSON parser
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2435 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-27 17:05:45 +00:00
Tom Morris
ca2afc1dc1 Issue 524 - missing piece of __anonymous__ shortening - fix client side to match server
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2434 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-27 16:46:11 +00:00
Tom Morris
593c4123a9 Update one Windmill UI test for Refine 2.5. Another 6 still need to be done.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2433 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-27 16:26:42 +00:00
Tom Morris
fdac0c30cf Issue 524 - shorten __anonymous__ names for JSON importer
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2432 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-26 22:38:25 +00:00
Tom Morris
254d4468cc Fix failing test
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2431 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-26 22:34:39 +00:00
Tom Morris
df45d06b2b Issue 523 - On URL fetch error, return HTTP error code, message, and contents of error stream (HTML page) if available
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2429 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-26 18:47:30 +00:00
David Huynh
0de40ad0a2 Added support for page opening actions following finished operations.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2428 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-25 02:09:08 +00:00
David Huynh
794629eee6 ChangeSequence did not save/load properly at all.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2427 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-25 02:04:52 +00:00
David Huynh
893b767c01 ChangeSequence did not revert properly at all.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2426 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-25 00:46:52 +00:00
Tom Morris
3af6487f44 Fix negative number of weeks at year boundary
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2421 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-12 06:34:04 +00:00
Tom Morris
fa2e6fe608 Issue 517 - add some interim error checking and reporting
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2420 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-12 06:20:28 +00:00
Tom Morris
8ec10a6ea6 Fix error message to match code
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2419 7d457c2a-affb-35e4-300a-418c747d4874
2012-01-12 05:51:16 +00:00
David Huynh
b3a90d0ede Bundle scripts.
Make sure new version notification will work.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2406 7d457c2a-affb-35e4-300a-418c747d4874
2011-12-11 22:01:42 +00:00
Tom Morris
b409ef5670 Issue 491 - fix off-by-one error in column counts
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2405 7d457c2a-affb-35e4-300a-418c747d4874
2011-12-09 23:50:40 +00:00
Tom Morris
b3bcb3361b Issue 483 - make custom metadata available to the client
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2404 7d457c2a-affb-35e4-300a-418c747d4874
2011-12-09 23:05:42 +00:00
David Huynh
ae771a7ccb Fixed Issue 502 in google-refine: Fetch URLs does not return the exact HTTP payload, like Create Project from URLs does.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2398 7d457c2a-affb-35e4-300a-418c747d4874
2011-12-02 20:44:13 +00:00
David Huynh
4ecd83bcf8 Fixed flickering problem of progress/undo panel.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2396 7d457c2a-affb-35e4-300a-418c747d4874
2011-12-01 22:15:08 +00:00
David Huynh
a7e2704655 Attempt at fixing Issue 500: Sequential creation of related columns using apply-operation command
by letting long-running processes report errors.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2394 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-30 23:54:40 +00:00
David Huynh
4a8145d624 Added Refine.defaultEncoding to Javascript of index.vt and project.vt, for debugging.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2393 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-30 07:22:08 +00:00
David Huynh
d419f4bbc7 For reinterpret function, swapped encoder and decoder arguments if decoder is specified, as discussed here:
http://groups.google.com/group/google-refine/msg/629dbf11b073e129

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2392 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-29 19:55:08 +00:00
Tom Morris
3b4bdbecdf Issue 378 - JSONize NaNs as their string equivalent to keep JSONwriter from throwing an exception
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2391 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-29 07:57:36 +00:00
David Huynh
76802d328d Default the encoding of clipboard data to UTF-8.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2390 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-29 05:21:26 +00:00
David Huynh
07ba5cf27b Fixed Issue 492: Table header cells misaligning with table cells.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2389 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-27 20:53:33 +00:00
David Huynh
9360e3f71a Fixed Issue 488: ISO 8601 dates not supported in cell editing - cell-ui.js.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2388 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-27 20:22:58 +00:00
David Huynh
cdca6fff8f Checked in Shardul Deo's patch from
http://groups.google.com/group/google-refine-dev/browse_thread/thread/5222a68396c56405
to support HTTP PUT and DELETE.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2387 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-25 03:48:03 +00:00
David Huynh
2ad885d6df Fixed bug in custom tabular exporter where separators were not escaped/unescaped properly.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2386 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-21 19:13:59 +00:00
Tom Morris
f1b567bc31 Issue 487 - Add support for ISO 8601 date parsing
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2383 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-18 22:05:45 +00:00
Tom Morris
80c13e4b59 Issue 486 - make sure project character encoding doesn't get set to ""
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2381 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-18 20:52:49 +00:00
Tom Morris
d5dd04965a Allow user to optionally override source encoding in reinterpret function so they can fix up bad projects. Interpret empty string as system default encoding.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2380 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-18 20:50:55 +00:00
Tom Morris
23ac625818 Issue 430 - Fix timeline facet to handle Calendar type as well as Date
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2379 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-17 23:52:32 +00:00
David Huynh
73a9785372 Minor tweak to "no existing project" message.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2373 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-13 01:04:59 +00:00
Tom Morris
c992ed9670 Issue 482 - make facet sort case insensitive
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2371 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-12 20:23:39 +00:00
David Huynh
dbeaefb00b Minor bug fix to previous check-in: made sure blank cells in the 2 newly generated columns don't get filled in.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2368 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-07 19:53:26 +00:00
David Huynh
d01745284b Added option to "transpose columns into rows" operation for filling in other columns.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2367 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-07 19:39:23 +00:00
David Huynh
5aec75696d Fixed Issue 477 in google-refine: Implement or remove the line separator option.
Also, fixed displaying bug in the fixed-width parser UI: previously, tab characters forced columns to be wider.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2364 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-06 20:13:05 +00:00
David Huynh
a35b9f53f7 Made operation "Transpose columns into rows" support the option of transposing into 2 new columns rather than just one.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2362 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-06 02:50:33 +00:00
Tom Morris
85a37d23f9 Issue 474 - implement record limit for XML and JSON importers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2359 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-05 16:38:19 +00:00
David Huynh
b36b229ba4 Fixed Issue 465: Data text file with extension .dta within a .ZIP is not automatically extracted
.dta isn't recognized so there's no best format detected. But now we default to text/line-based and always select all files if no file gets selected by default.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2358 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-04 22:33:38 +00:00
David Huynh
41a90ad71f Fixed Issue 459: Undefined error with some CSV files (incorrectly detected as EXCEL)
by favoring file name-based format over mime type-based format (because the user's computer might have .csv registered as an Excel format).

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2357 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-04 21:52:12 +00:00
David Huynh
2f6b635f66 Added initial implementation of Key/value Columnize operation and command.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2356 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-04 21:00:32 +00:00
Tom Morris
a7c81880a8 Issue 475 - Support escaped custom separators
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2355 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-04 19:04:16 +00:00
Tom Morris
cacbedd352 Fix index out of bounds exception when separator is the empty string
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2354 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-04 17:31:51 +00:00
Stefano Mazzocchi
856ef6a65a commented out unused variables
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2352 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-01 21:47:24 +00:00
Stefano Mazzocchi
8184e16bb9 updating http client and http core to the latest released versions
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2351 7d457c2a-affb-35e4-300a-418c747d4874
2011-11-01 21:46:56 +00:00
Tom Morris
83db311b18 Issue 473 - Fix cancel button for project creation import phase
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2350 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-29 22:05:24 +00:00
Tom Morris
71492c706c Just some TODOs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2349 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-28 17:51:20 +00:00
Tom Morris
ad8705e299 Javadoc only
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2348 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-28 17:29:35 +00:00
Tom Morris
a870e782f5 Make sure out counts our current before attempting to use them for sorting
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2347 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-28 17:28:27 +00:00
Tom Morris
5dad4d6a0b Handle legacy projects which have an empty slot 0 for the column model (old off-by-one bug)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2346 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-23 19:29:44 +00:00
Tom Morris
fe7bf1d1f0 Refactor to conform to method naming conventions
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2344 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-21 16:57:52 +00:00
Tom Morris
ab950689dd Add debugging info - mostly toString() methods for types missing them
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2343 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-21 16:46:55 +00:00
Tom Morris
b2781bda3f Javadoc only
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2342 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-21 16:30:37 +00:00
Tom Morris
9a9f4c1354 Issue 467 - provide JVM heap usage as part of the progress monitor during project creation.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2341 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-21 16:28:40 +00:00
David Huynh
f4b2ee3715 "Transpose columns into rows" operation now supports specifying the ending column to be the last column regardless of its name.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2337 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-19 13:42:50 +00:00
David Huynh
223074bb25 Xml importer should stop trying to skip over initial non-xml content after some number of characters.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2336 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-18 15:25:31 +00:00
Tom Morris
9710521ef8 Correct column counting so maxCellIndex represents current count rather than next column
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2335 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-14 21:00:50 +00:00
Tom Morris
5d6ab76b7c Issue 313 - fix cell format so dates export as dates rather than numbers.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2334 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-14 20:23:59 +00:00
Tom Morris
2d5125af1e Issue 462 - don't trim whitespace from string-valued cell contents on import
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2330 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-12 23:45:52 +00:00
Tom Morris
4966dcc61f Basic trivial test for Excel importer. Please add to this...
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2329 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-12 23:42:29 +00:00
Tom Morris
5c95c9c1f9 New exporter - Open Document Format (ODF) spreadsheets (.ods)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2326 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 21:02:23 +00:00
Tom Morris
3bd84088da Rename OO/ODS importer with more generic name
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2325 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 21:01:45 +00:00
Tom Morris
ee0fb9033e Javadoc
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2324 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 20:57:40 +00:00
Tom Morris
ca17e1ef0a New importer for Open Document Format (ODF) spreadsheet files (.ods)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2323 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 20:27:40 +00:00
Tom Morris
2726f61a61 Add toString methods to help with debugging
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2321 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 20:19:53 +00:00
Tom Morris
5c856179cb Add TODO for suspicious code
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2320 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 20:14:57 +00:00
Tom Morris
16421303cb Add Javadoc
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2318 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 20:12:24 +00:00
Tom Morris
da0e68dd76 Fix typo in variable name
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2317 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-11 16:26:21 +00:00
David Huynh
55c3fdebab Bumped up version to 2.5.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2314 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-10 21:58:42 +00:00
David Huynh
1a14d82393 For XML files, ignore not just leading whitespace but anything except <.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2313 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-10 20:51:00 +00:00
David Huynh
99830b2ea9 Half fix for Issue 459: Undefined error with some CSV files (incorrectly detected as EXCEL) - just made sure the error messages are shown properly rather than "Undefined".
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2312 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-10 17:46:19 +00:00
David Huynh
8a7b2fdd4e Added chrome frame detection.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2305 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-09 01:04:51 +00:00
Stefano Mazzocchi
b413833ca1 fixing a bunch of jslint issues
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2303 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 23:44:11 +00:00
Tom Morris
fffd24d64b Parse parameters from multipart/form-data POSTs rather than just dropping them (needed for Windmill tests, among other things)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2302 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 23:15:55 +00:00
Stefano Mazzocchi
1f67866258 fixing a bunch of inconsistencies and potential bugs as indicated by findbugs, pmd and eclipse
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2301 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 21:23:23 +00:00
Stefano Mazzocchi
af5b49eab9 whitespace (no functional changes)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2299 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 19:25:15 +00:00
Tom Morris
6b97f6602f Fix last(?) failing test
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2297 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 19:16:19 +00:00
Tom Morris
31073d7712 Refactor importer interfaces to narrow exceptions thrown and handled
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2296 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 19:06:53 +00:00
Tom Morris
50927b33dc Javadoc
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2295 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 18:56:23 +00:00
Tom Morris
4a230abb44 Narrow exception handling
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2294 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 18:55:46 +00:00
Stefano Mazzocchi
1313160af0 few minor fixes to the 'about' page
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2293 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 18:39:42 +00:00
Tom Morris
29cbc5af20 Remove some obsolete TODOs. No functional changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2290 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 17:29:30 +00:00
Tom Morris
f7475e2f3f Update JSON parser lib to Jackson 1.8.6
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2288 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 16:59:39 +00:00
Tom Morris
e3f1fab4e8 Issue 453 - Add test for importing top level JSON array - from Thad
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2287 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 16:52:31 +00:00
Tom Morris
79c795138c Provide exception info for failures
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2286 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 16:51:06 +00:00
Tom Morris
4a4daf7112 Add some Javadoc. No functional changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2285 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-07 16:29:14 +00:00
David Huynh
18f32ed7e8 Fixed up Rdf Triples importer, added a parser UI for it, and got its tests to pass.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2283 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 21:28:20 +00:00
Tom Morris
cf206c33bc Update test to accommodate new test for pending operations
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2282 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 21:09:31 +00:00
Tom Morris
97dda9f577 Refactor option mock setup and verification - all tests green (for this module)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2281 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 20:53:19 +00:00
Tom Morris
90c2715901 Back out workaround for cell numbering
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2280 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 20:29:53 +00:00
David Huynh
58414f72df Got more tests to pass.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2279 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 20:01:27 +00:00
David Huynh
08fdc1982c Styling tweaks.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2278 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 07:20:48 +00:00
David Huynh
a9279e2997 Got more tests to pass.
Note that the automatic column naming behavior did change from { "Column", "Column2", "Column3", ... } to { "Column 1", "Column 2", "Column 3", ... }.

Also note that the tsv/csv importer no longer supports the option not to split into columns. That's another importer (the line-based importer).

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2277 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 07:09:05 +00:00
David Huynh
1c5dc32b88 Fixed tsv/csv tests.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2276 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 06:22:30 +00:00
David Huynh
3c6358d518 Fixed json tests.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2275 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-06 04:50:05 +00:00
Tom Morris
850e147779 Changes needed to get FixedWidthImporter test to pass
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2274 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-05 23:49:14 +00:00
Tom Morris
e064dcce3e Add support for getTempDir() as required by new importers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2273 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-05 23:42:15 +00:00
Tom Morris
ac4a0ca747 Store blank cells as nulls if that's what the user request
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2272 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-05 23:41:52 +00:00
Tom Morris
0ce0a0a8d3 Add toString support for null cells to help with debugging
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2271 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-05 23:33:17 +00:00
David Huynh
765fb4ea8e Use chrome frame to support IE. Also rewired gdata authentication process to support IE.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2270 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-05 04:39:42 +00:00
David Huynh
e7e9dbc74d Minor fixes to pass some exporter tests.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2269 7d457c2a-affb-35e4-300a-418c747d4874
2011-10-03 16:38:07 +00:00
David Huynh
e55bab31b8 Default error mode to keep original for common transforms.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2268 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-30 06:09:55 +00:00
David Huynh
1db293bcf8 Fixed Issue 454: Reselect Files after Configuring Parsing Options does not allow Select.
Also polished up file selection panel of new importer UI.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2267 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-30 03:18:15 +00:00
David Huynh
7935dfd60e Stricter detection of json and xml formats on import, by checking for initial nonspace character.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2266 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-30 01:47:42 +00:00
David Huynh
d047acf1d1 Fixed Issue 452: Importing using Clipboard function does not guess structure correctly for XML or JSON
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2263 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-29 14:02:12 +00:00
David Huynh
b6b8da99a8 Added more <label> to custom tabular exporter dialog.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2262 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-29 10:35:07 +00:00
David Huynh
d092b97139 Added more <label> to various dialogs.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2261 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-29 06:53:44 +00:00
David Huynh
0e6c37ce35 Fixed Issue 433: Usability: use HTML <label> (e.g., for checkboxes) (for index page)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2260 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-29 05:58:02 +00:00
David Huynh
fbc990a2e0 Fixed Issue 424: Duplicate column names don't allow user to recover
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2259 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-29 03:20:51 +00:00
David Huynh
5762efebf6 Fixed Issue 397: New UI Importer Branch - individual JSON record nodes do not preview well.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2258 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-28 03:38:23 +00:00
David Huynh
81d0072bda Changed 'Reorder Columns' to 'Re-order / Remove Columns', which more accurately describes that feature
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2257 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-27 09:22:40 +00:00
Tom Morris
1b197d93d8 Issue 447 - allow users to specify delimiters for toTitlecase function
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2253 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-20 05:07:46 +00:00
Tom Morris
884d0ea8d4 Look up functions by name to make tests more directly analogous to user view
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2252 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-20 05:00:48 +00:00
David Huynh
e1184003df Color-code date values in data table.
Fixed Issue 426: filter with custom facet adds zero lines choice

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2251 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-20 01:36:47 +00:00
Tom Morris
59d6020979 Add basic test coverage for ToTitleCase and (commented out) support for 2nd parameter
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2250 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-19 15:47:33 +00:00
Tom Morris
f309a26a95 Fix XML importer test to handle new exception being thrown
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2249 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-19 15:34:29 +00:00
David Huynh
82cc76f076 Fixed bug where a blank row used to corrupt the whole project because it could not be re-loaded from file.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2248 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-19 10:36:38 +00:00
David Huynh
9111157172 Fixed Issue 447: Extend toTitlecase() function with support for char[] delimiters in Apache WordUtils.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2247 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-19 09:48:37 +00:00
David Huynh
db3bbb5c86 Fixed xml parsing error due to whitespaces in front of <?xml>.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2246 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-19 09:06:36 +00:00
David Huynh
66cf0b6596 Fixed Issue 449: Uncaught exception from Excel importer.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2245 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-19 08:49:35 +00:00
David Huynh
4c5b2514fd Support uploading directly to a new Google Fusion table.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2244 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-16 20:59:58 +00:00
David Huynh
5c446d28d0 Support uploading directly to a new Google spreadsheet.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2243 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-16 18:04:55 +00:00
David Huynh
503cca6d3b More error handling in file selection panel.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2241 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-16 00:19:14 +00:00
David Huynh
02c58e2c56 Periodically clean up stale importing jobs to free up disk space.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2240 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-15 23:52:05 +00:00
David Huynh
0693205430 Added support for importing from fusion tables.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2239 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-15 21:40:40 +00:00
Tom Morris
ebede9b424 Issue 441 - return EvalError if we can't parse a date
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2237 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-13 20:58:43 +00:00
Tom Morris
131ff81c0d Don't reschedule a canceled timer
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2236 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-13 20:38:34 +00:00
David Huynh
585d3fce3b Fixed issue 445: Made it more obvious that the column options in the custom tabular exporter dialog are for the selected column.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2232 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-02 03:31:03 +00:00
David Huynh
f7aa8c2705 Fixed styling problems introduced to previewed data table during importing stage, as introduced by recent changes to get the data table's headers stuck.
Some refactoring to gdata extension to prepare for other types of document.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2231 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-02 01:24:31 +00:00
David Huynh
57c11d0238 Fixed issue 442: Two column transforms to date on the same column turns the cells blank
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2230 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-01 22:11:45 +00:00
David Huynh
98c268d9f7 Fixed issue 38: [Wishlist] Fix the table header so that it's always visible when scrolling a long page
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2229 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-01 22:03:10 +00:00
David Huynh
a88ccd2c32 Reduced amount of logging.
Suppressed logging for the GetProcessesCommand, which gets ping'ed often while there is a long running operation being executed (e.g., reconciling, fetching URLs).

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2228 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-01 18:26:45 +00:00
David Huynh
b78d3f8bf4 Fixed issue 444: move Preview button closer to Export button in Custom Tabular Exporter dialog.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2227 7d457c2a-affb-35e4-300a-418c747d4874
2011-09-01 17:32:11 +00:00
David Huynh
90ad8247b7 Minor layout change in custom tabular exporter dialog from Thad's suggestion.
Fixed small compile error in main/tests/.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2226 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-30 21:21:46 +00:00
David Huynh
a8815956cd Implemented back-end of customizable tabular exporting support.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2225 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-30 19:19:46 +00:00
David Huynh
2b351233e7 Added a dialog box for custom tabular exporting. No back-end implementation yet.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2223 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-28 22:43:45 +00:00
Tom Morris
e174bb163a Issue 440 - Don't purge from memory those projects with pending operations
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2222 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-28 22:00:02 +00:00
David Huynh
420e74c6f4 Made CreateProjectCommand scriptable again, so it can be called from client libraries.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2216 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-23 18:49:47 +00:00
David Huynh
4113a10b5b Catch/log exceptions in the importers a bit more carefully.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2215 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-22 21:47:15 +00:00
David Huynh
f023b922e1 Implemented encoding selectors in a few importing parser UIs.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2214 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-22 17:55:06 +00:00
Tom Morris
bde63ff417 Last set of indentation cleanups - no functional changes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2211 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-18 17:46:36 +00:00
Tom Morris
9d7b8a5279 Don't die if we get passed no candidates
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2210 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-18 17:39:18 +00:00
David Huynh
afb7953eac Fixed problem for importing from an archive file containing fixed width column files: we used to create totally new columns for each contained file, yielding too many columns.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2203 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-14 02:53:19 +00:00
David Huynh
33d99186ea Made fixed width column guessing slightly better.
Made sure fixed width parser UI take into account the File column.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2202 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-14 02:05:18 +00:00
David Huynh
41e4e1cd70 Some more JS indentation fixes.
Fixed issue 31: "Maximum number of facet values should be configurable." Now when we're showing "too many choices" we also display exactly how many choices there are and show a link to change the limit.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2201 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-14 01:05:43 +00:00
David Huynh
8ded93008a Generalized GData document listing to support other types of document in the future.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2199 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-12 21:32:45 +00:00
David Huynh
e955ed05ae Made sure busy indicator shows up for GData importing when needed.
Fixed radio button issue with GData worksheet selection.
Fixed resizing issue with open project action area.
Fixed NullPointerException in RecordModel.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2198 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-12 19:15:58 +00:00
Tom Morris
31eaea385d Update formatter preferences to match settings in formatter XML file
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2197 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-11 19:18:12 +00:00
Tom Morris
b8c2b92d19 Export Butterfly so it's available to extensions that need it (e.g. Jython)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2195 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-11 19:15:18 +00:00
David Huynh
823729776d Google spreadsheets can now be imported directly from within Refine.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2192 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-11 00:35:01 +00:00
David Huynh
c42382f3ae Started deeper integration of GData: we now have a "Google Data" importing source, which lets you sign in and authorize access to your docs. It then lists all the spreadsheets you have access to. It does not yet let you import those spreadsheets.
Minor fixes to the open project action area; fixes to render relative dates properly.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2190 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-07 23:26:51 +00:00
David Huynh
c5078d1887 Fixed issue 428: Excel import sometimes drops last row of data.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2189 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-06 19:37:23 +00:00
David Huynh
bad7266534 Cleaned up code formatting in .js, .html, .vt, .css, .less files.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2185 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-04 20:37:14 +00:00
David Huynh
c9db107d7e Put back lines mistakenly removed when merging branch new-importing-ui over
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2184 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-03 04:56:27 +00:00
Tom Morris
da7347e7b1 Make sure all conditionals and loops are in blocks (too bug-prone otherwise)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2183 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 22:21:47 +00:00
Tom Morris
c16a2378f9 Ask people not to reformat since this is imported code.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2182 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 22:18:50 +00:00
Tom Morris
539fea6eb3 Simplify some for loops using new Java 5 syntax
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2181 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 21:17:41 +00:00
Tom Morris
97a0f2a33e Organize imports. com.google.refine last in a section of its own. Everything alphabetical in its section.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2180 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 21:10:22 +00:00
Tom Morris
b03e85d1ad Make tab size the standard value of 8 spaces.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2175 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 20:54:53 +00:00
Tom Morris
5497fa4685 Remove unnecessary casts
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2173 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 20:33:57 +00:00
Tom Morris
7fd6e22af4 Convert tabs to spaces. No functional changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2172 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 20:26:32 +00:00
Tom Morris
123614539d Add missing @Override annotations
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2171 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 19:30:23 +00:00
David Huynh
78edff6f7f Merged new importer UI work from branch over.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2170 7d457c2a-affb-35e4-300a-418c747d4874
2011-08-02 03:34:47 +00:00
Tom Morris
b82448037a Add @Override annotations. No functional changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2124 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-24 04:01:47 +00:00
Tom Morris
eb38ab75a4 FIXED - task 415: Evaluation precedence wrong for arithmetic expressions
http://code.google.com/p/google-refine/issues/detail?id=415

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2123 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-23 23:42:12 +00:00
Tom Morris
d03c8a1f70 Issue 415: Add some tests for arithmetic expressions in GREL
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2122 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-23 23:41:35 +00:00
Tom Morris
2af22f9485 Issue 404 - Fix indeterminate behavior in character encoding guesser. Thanks to Paul Makepeace.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2120 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-14 04:29:44 +00:00
Tom Morris
21c9234ae6 Update contributors' names to their preferred forms.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2106 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-11 19:15:55 +00:00
Tom Morris
8da1291650 Issue 399 - Add Cologne Phonetic Keyer and allow it to be used for clustering
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2102 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-09 19:42:05 +00:00
Tom Morris
81045d91e1 Add Heather Campbell (was in README.txt, but not about.html)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2101 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-09 19:37:24 +00:00
Tom Morris
0467eb0b11 Update credits
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2100 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-09 18:37:17 +00:00
Tom Morris
830a2c376f Update to Apache Commons Codec 1.5
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2095 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-08 00:58:47 +00:00
Tom Morris
51c898d602 Issue 351 - truncate exports to Excel at 256 columns (limitation of Excel format)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2094 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-07 23:55:00 +00:00
Tom Morris
6a14049652 Issue 401 - use default exception handling for ExportRows command instead of JSON response
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2093 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-07 23:52:23 +00:00
Tom Morris
2cd3ae03d0 @Override annotations. No functional changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2092 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-07 23:51:16 +00:00
Tom Morris
a52c25272e Issue 342 - help text update
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2090 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 22:38:50 +00:00
Tom Morris
eebc225abc Add missing @Override annotations (issue 316, 317, 319, 320 among others)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2089 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 22:35:01 +00:00
Tom Morris
73acd497e9 Fix for issue 358 from Tomaz Solc. Don't return a NaN when comparing two 0-length word lists.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2088 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 21:30:46 +00:00
Tom Morris
84c7ff6816 Update classpath for POI 3.7
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2085 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 20:58:51 +00:00
David Huynh
d07a3f3f52 Applied patch for issue 398: Patch: duplicates facet.
Added mention of "record" field for "row" variable in expression preview dialog's help.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@2084 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 20:29:15 +00:00
Tom Morris
746ca93b1e Fix warning when new param doesn't exist
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2083 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 20:23:08 +00:00
David Huynh
11cf415ee8 Exposed more fields for each record.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2081 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 20:19:20 +00:00
Tom Morris
4dc3ef8caa Bump version to 2.1
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2080 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 20:16:19 +00:00
David Huynh
b75a5efe71 Applied patch for Issue 222: save favorite transforms.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2079 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-06 18:49:36 +00:00
David Huynh
f7c33fba45 Fixed issue 196: failure and error dialog attempting to remove columns
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2077 7d457c2a-affb-35e4-300a-418c747d4874
2011-06-05 04:31:51 +00:00
Tom Morris
c097e383a2 Update to Apache POI 3.7
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2063 7d457c2a-affb-35e4-300a-418c747d4874
2011-05-25 06:29:11 +00:00
Tom Morris
149cf1dfcb Update to Apache POI 3.7
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2062 7d457c2a-affb-35e4-300a-418c747d4874
2011-05-25 06:10:32 +00:00
Tom Morris
518ca1e654 Update to Apache POI 3.7
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2061 7d457c2a-affb-35e4-300a-418c747d4874
2011-05-25 06:07:44 +00:00
Tom Morris
06d5b108fa Set project encoding to UTF-8 to match source files
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2040 7d457c2a-affb-35e4-300a-418c747d4874
2011-04-08 14:39:55 +00:00
David Huynh
cecfa244e0 Changed to UTF-8 encoding
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2039 7d457c2a-affb-35e4-300a-418c747d4874
2011-04-06 21:09:21 +00:00
Stefano Mazzocchi
610de0d33a adding Metaphone3 algorithm
Many thanks to Lawrence Philips for donating the code to us under the BSD license.


git-svn-id: http://google-refine.googlecode.com/svn/trunk@2029 7d457c2a-affb-35e4-300a-418c747d4874
2011-03-01 00:17:48 +00:00
Stefano Mazzocchi
87e7f9a7a4 remove unused variable
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2028 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-25 22:51:58 +00:00
Tom Morris
c5312a2e6a Issue 338 - patch from Thad Guidry to provide function which calls JSoup ownText() method
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2025 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-23 19:40:35 +00:00
David Huynh
a4572b66c8 Fixed yet another problem caused by r1989.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2022 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-23 01:19:06 +00:00
David Huynh
669b708d60 Fixed r185: same reconciliation candidate for two cells seems to be overridden
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2010 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-18 05:38:41 +00:00
Tom Morris
5b9362e956 Issue 334 - Make sure URLs are encoded before using them.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2007 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-15 23:15:09 +00:00
Tom Morris
bbc2b3d363 Test provided by Gabriel Sjoberg. Thank you!
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2002 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-04 20:09:01 +00:00
Tom Morris
3e08aca4ec Issue 304 - Apply patch to fix test. Thanks to GabrielS
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2001 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-04 04:55:05 +00:00
Tom Morris
06e2487189 Issue 276 - patch from pxb1... to fix character encoding issue with CreateProject command slightly modified to preserve request encoding if it has one
git-svn-id: http://google-refine.googlecode.com/svn/trunk@2000 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-04 03:15:12 +00:00
Tom Morris
5519f61335 Issue 311 - give input fields unique names
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1999 7d457c2a-affb-35e4-300a-418c747d4874
2011-02-04 02:31:14 +00:00
David Huynh
d7b482be06 Attempt at fixing issue 185. Will need someone else to verify.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1989 7d457c2a-affb-35e4-300a-418c747d4874
2011-01-20 22:49:36 +00:00
David Huynh
44652a3ee2 Make copy of Calendar object before modifying it. Also handle Date type.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1982 7d457c2a-affb-35e4-300a-418c747d4874
2011-01-10 23:06:28 +00:00
Tom Morris
4d84733b8e Fixed - task 197: Handle date wraparound for year boundary
http://code.google.com/p/google-refine/issues/detail?id=197

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1979 7d457c2a-affb-35e4-300a-418c747d4874
2011-01-09 06:09:30 +00:00
David Huynh
90794d5039 Started working on new import UI. Not much to see yet, but if you append ?new=1 to the index page URL then you see the new form. It can only upload a file at the moment.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1971 7d457c2a-affb-35e4-300a-418c747d4874
2011-01-02 23:09:08 +00:00
David Huynh
6fb2b05739 Fixed issue 294: "Exporting date type column to TSV/CSV shows java debugging information instead of value" with help from Gabriel Sjoberg.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1967 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-28 15:54:24 +00:00
David Huynh
53442c5ef2 Handle the case where an excel cell has a formula but the cached result of that formula is an error.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1962 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-25 21:41:21 +00:00
David Huynh
687e9064df A shorter fix for toString() to handle Date than the last commit.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1961 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-25 21:36:51 +00:00
David Huynh
0ff40eabbd toString() should handle Date, too, rather than just Calendar.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1960 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-25 21:33:59 +00:00
Tom Morris
209f157656 RESOLVED - task 202: Sort text with accents
http://code.google.com/p/google-refine/issues/detail?id=202

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1951 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-12 18:16:29 +00:00
Tom Morris
dda74792bc Add jsoup library so project will compile
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1950 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-08 05:35:07 +00:00
Iain Sproat
f55f11cd0d Adding classes to now make it possible to parse Html in GREL. Uses small subset of methods from the JSoup library, licensed under the MIT license.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1948 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-06 23:15:24 +00:00
Tom Morris
9aaa1c9919 Replace tabs with spaces. No functional change.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1947 7d457c2a-affb-35e4-300a-418c747d4874
2010-12-05 20:50:03 +00:00
Tom Morris
a560cb56df Replace tabs with spaces. No functional changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1942 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-29 06:27:06 +00:00
Tom Morris
3a8f9306bd Add some toString() methods to help with debugging
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1941 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-29 06:24:50 +00:00
Tom Morris
af20157532 Fix indentation so indent levels match logical block levels. No code changes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1940 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-28 17:46:57 +00:00
Tom Morris
748b5699b9 Issue 61 - Turn on text coalescing and XML entity reference replacement
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1939 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-27 22:07:15 +00:00
Tom Morris
e19148c375 Make sure we at least log an error if the import fails
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1938 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-27 22:05:45 +00:00
Tom Morris
824f445530 Unused import
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1937 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-27 17:54:16 +00:00
Tom Morris
b9fa100d31 Don't try to save a null encoding
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1936 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-27 17:54:01 +00:00
Tom Morris
850c43d6f3 Issue 107 - set encoding on response
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1935 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-27 02:46:10 +00:00
Tom Morris
3d6458a0e5 Replace tabs with spaces
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1934 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-27 01:38:32 +00:00
Tom Morris
bc8637f638 Issue 257 - Don't return a String where a Date is required (using generics in Criterion API would prevent this kind of problem, but that's incompatible with the use of the Eval_Error class)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1933 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-27 01:18:36 +00:00
Tom Morris
c7b0f4d024 Issue 184 - use default locale date formatting if no format string is specified
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1932 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-26 23:47:09 +00:00
Tom Morris
080ec5332e Issue 237 - Make sure project's character encoding is always set. Lower minimum confidence threshold for guesser.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1931 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-26 22:23:31 +00:00
David Huynh
1e2af79851 Let's handle .tar files as well rather than requiring .tar.gz.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1919 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-21 03:00:43 +00:00
David Huynh
c496f1e941 Helped toward fixing issue 228: ButterflyServlet already tracks the ServletConfig, so there's no need for RefineServlet to do that, too.
Importing archive files has another big problem at the moment: namely, even if the many files in a single archive file share several columns, they still cause columns with the same names to be over and over again as each file gets imported. This is because individual importer was written with the assumption that it imports into an empty project with no column.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1918 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-21 02:58:15 +00:00
Iain Sproat
09fa36198c Additions to GREL:
* Factorial function allowing variable steps
* GreatestCommonDenominator function
* LeastCommonMultiple function
* Multinomial function
* Quotient function

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1910 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-20 18:04:11 +00:00
Iain Sproat
43d0de2d8a Fixed registered name of GREL combination function
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1909 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-20 12:15:31 +00:00
Iain Sproat
f1643565b8 Additions to GREL:
* modulo operator, %
* cos, sin and tan functions
* acos, asin, atan and atan2 functions
* cosh, sinh and tanh functions
* fact and combin functions
* degrees and radians functions
* odd and even functions

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1908 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-20 12:11:37 +00:00
Iain Sproat
1ec7cb9f7b PI constant added to GREL
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1904 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-18 23:53:07 +00:00
Tom Morris
675714d03d Add toString() methods to help with debugging
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1894 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-18 08:19:05 +00:00
Iain Sproat
dd333d5b43 Abs function now available in GREL
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1890 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-17 09:38:51 +00:00
Iain Sproat
74e9288229 Additional error dialog for Issue 188
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1858 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-11 14:25:46 +00:00
Iain Sproat
2f564589f5 Adding a Fixed Width data importer (Issue 85) and associated tests.
Although this importer is 'wired up', it requires a property "fixed-column-widths" which is not (yet) implemented in the UI.  But the ImporterRegister.guessImporter method will probably select the CsvTsvImporter before the FixedWidthImporter anyway.  I suggest an improvement to the project creation UI and/or the guessImporter method will be required.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1857 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-11 13:15:41 +00:00
Iain Sproat
4f9dc38066 TsvCsvImporter now uses the CSV test methods to also test the TSV importer. Separate tests for the two importers are no longer required.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1856 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-11 13:06:39 +00:00
Iain Sproat
37a6f938c3 The TestNG DataProvider for the Tsv/Csv importer tests was previously providing just one test case with two parameters, rather than the two test cases of one parameter each which is required. This is now fixed, and the tests pass.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1855 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-11 10:52:18 +00:00
David Huynh
703d2dbd19 IsTest should catch errors and wrap them.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1833 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-08 21:19:25 +00:00
David Huynh
5d915be096 Numeric comparisons == and != should be special-cased, too.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1780 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-05 19:17:57 +00:00
David Huynh
fe08a43e0c FunctionCall and ControlCall should catch exceptions and wrap them as EvalError's.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1777 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-05 04:26:10 +00:00
James Home
b282952448 clean up top right nav
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1775 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-04 01:03:50 +00:00
Iain Sproat
e33c00f388 GoogleRefineTests.launch now looks in the correct directories for the tests
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1773 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-03 19:38:54 +00:00
David Huynh
232d97f832 Prevent really long expressions from stretching the expression preview dialogs.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1772 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-03 19:15:48 +00:00
David Huynh
faaca5beea Fixed the GREL round function.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1749 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-01 20:28:42 +00:00
David Huynh
1f12bfb409 Fixed bug in HasFieldsListImpl where list members weren't tested for being null.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1735 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-01 18:13:53 +00:00
David Huynh
1eebe2e4a3 Fixed transpose-rows-into-columns command, which previously duplicated columns that precede the column being transposed.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1734 7d457c2a-affb-35e4-300a-418c747d4874
2010-11-01 17:59:58 +00:00
David Huynh
258637c343 Minor bug introduced recently when trying to be smart to clean up operation json
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1728 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-28 23:37:50 +00:00
David Huynh
c1ec3efdad More styling tweaks. Added link to sample data sets. Set project name whenever an upload file is picked
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1702 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-27 05:20:48 +00:00
David Huynh
687515a669 Made each bar in histogram a minimum of 2 pixels tall
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1701 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-27 04:14:33 +00:00
David Huynh
764558c48a In numeric bin index, count infinity values as errors
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1700 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-26 22:49:59 +00:00
David Huynh
8d422e2e54 Fixed Calendar vs. Date bug in time range facet
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1699 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-26 21:06:16 +00:00
David Huynh
dfa9c538c7 Minor style tweaks to facets
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1697 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-26 07:24:02 +00:00
David Huynh
8ccf9d1bf8 The judgment facet created after a recon operation is done should also show (blank) and (unreconciled) choices
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1696 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-26 04:57:02 +00:00
David Huynh
2a77e7bd8a Fixed bug in recon dialog: previously, manually specified type didn't get its id transmitted properly to the server
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1695 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-26 04:05:04 +00:00
David Huynh
8030595254 Broke the history extract dialog in last night check in
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1694 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-26 01:18:01 +00:00
David Huynh
d4969e02ee Fixed: Issue 167 in google-refine: 'No syntax error' is alarming
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1659 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-25 17:27:38 +00:00
David Huynh
a193f9acf7 Added Thad to Special Thanks section. Various minor styling and url tweaks.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1636 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-25 05:59:00 +00:00
David Huynh
88ff48d89a Fixed external docs URLs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1635 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-25 05:36:48 +00:00
David Huynh
ad2a03a106 Styling tweaks to history extract dialog. Apply some heuristics to pasted operation json to fix common json problems, such as missing commas or extra commas
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1631 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-25 04:31:28 +00:00
David Huynh
e601ad8d40 bug: autoMatch flag wasn't actually used before
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1627 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-25 01:41:07 +00:00
David Huynh
d6b1455fb2 Added help documentation links
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1626 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-25 01:35:00 +00:00
David Huynh
2d9e7c87f6 Increased recon batch size to 10 again. Various style tweaks. Polished up freebase extension's dialogs to be a bit more helpful
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1625 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-25 01:07:25 +00:00
James Home
424501ba0e UI tweaks to menu text
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1624 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-23 01:21:13 +00:00
James Home
cbb73b17be more facet tweaks, menu case tweaks
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1622 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-22 23:32:37 +00:00
David Huynh
bc4de76ec5 Minor styling tweaks to cells judged as new topics.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1619 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-22 07:35:27 +00:00
David Huynh
345c1c62ac Added new recon commands:
- clear recon data for all matching rows
- clear recon data for one cell
- clear recon data for similar cells
- copy recon judgments across columns

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1618 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-22 07:25:27 +00:00
James Home
91797339e0 UI improvements to facetting, star and flags
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1617 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-22 01:43:56 +00:00
David Huynh
47381ce485 Unified capitalization scheme for menu items' labels
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1615 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-21 18:02:12 +00:00
James Home
3fbefac8e1 UI fixes to table controls, matching dialogs and edit dialogs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1614 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-20 23:43:37 +00:00
David Huynh
5a17acfd70 Prepended license text to java source
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1613 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-20 20:45:52 +00:00
David Huynh
9a96d2b8f0 Added license text to .js, .css, .less, and main .vt and .html pages
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1612 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-20 18:11:15 +00:00
David Huynh
9b8206da29 Fixed new bug for query-based reconciliation introduced by factoring out the freebase extension
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1611 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-20 04:52:35 +00:00
David Huynh
0e0c3ccea2 Added bottom padding to history so it clears the status bar of Chrome
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1610 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-20 04:52:05 +00:00
James Home
19878490f1 improved/simplified notifications, improved undo/redo
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1609 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-19 05:46:48 +00:00
David Huynh
69b7d34e09 Reduce filtered out history items' heights rather than hiding them entirely
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1606 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 20:05:58 +00:00
David Huynh
83e94d240c Changed history panel's design to mimic Adobe Photoshop's history
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1605 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 19:47:36 +00:00
David Huynh
a28b6fe21e Made sure suggest widgets automatically clean up their stuff when they get removed.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1604 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 17:44:42 +00:00
Tom Morris
05d8180016 Disable failing test until it can be debugged
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1602 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 05:52:11 +00:00
Tom Morris
7dcd0c073d Revert bad commit r1600
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1601 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 05:19:05 +00:00
Tom Morris
79c00bab36 Incomplete - task 157: Integrate Google Spreadsheet import/export plugin
http://code.google.com/p/google-refine/issues/detail?id=157

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1600 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 04:59:39 +00:00
David Huynh
e7184ec9ab Deleted old empty protograph dirs. Use a default assign version even if running from trunk; this is so that we have at least some clue about an imported project file.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1598 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 04:18:09 +00:00
David Huynh
8b8e9f1c1b Made some dialogs shorter to fit smaller screens
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1594 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 02:33:52 +00:00
David Huynh
2fc0374f79 Made data table view's All menu extensible. Added more common transforms. Touched up on a few menus.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1593 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 01:53:23 +00:00
David Huynh
a5c6a3af34 Support ESC key to dismiss menus and dialogs (which required jquery eventstack plugin).
Updated binding names in project.vt so that the bound HTML elements are distinguished from the JS objects that manage them (e.g., summarBarDiv vs summaryBar).

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1591 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 01:07:35 +00:00
David Huynh
5c54984c96 Css tweaks to make tabs' top corners squared in Firefox
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1590 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-18 00:04:01 +00:00
David Huynh
02857122c0 Added 'Create project' message to history panel as another hint for understanding the history.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1589 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-17 23:55:17 +00:00
David Huynh
c8dcc10ab8 Be sure to use UTF-8 when saving data.txt, pool.txt, and change files.
Fix issue 163: Refine doesn't retain the characters for flat or sharp.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1588 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-17 23:43:02 +00:00
David Huynh
a9a3944cbf Upgraded to suggest 1.2.1.
Fixed issue 160: Cancel button on Search for Match dialog sometimes not working.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1587 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-17 20:49:54 +00:00
David Huynh
7a6d53783b Factored out some HTML from history-panel.js.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1586 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-17 06:54:27 +00:00
David Huynh
ac04675f5e Renamed HistoryWidget to HistoryPanel, ProcessWidget to ProcessPanel, SummaryWidget to SummaryBar, and renamed and moved their files accordingly.
Added quick filter support to history panel.


git-svn-id: http://google-refine.googlecode.com/svn/trunk@1585 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-17 06:23:58 +00:00
David Huynh
7f48b3a692 Added padding to "working" popup.
Use background colors to explain undo/redo better, hopefully.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1584 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-17 05:30:03 +00:00
David Huynh
d99abaa52b Added 'browse workspace directory' link to index.vt.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1582 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-16 19:12:26 +00:00
David Huynh
3b57c84175 Removed borders from tab panel bodies in schema alignment skeleton. Render operation index in history widget so user can refer to each operation.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1581 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-16 18:36:35 +00:00
David Huynh
6da68b37ef Added class 'button' to buttons.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1580 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-16 06:43:01 +00:00
David Huynh
c451b2ded5 Re-laid out 'cell search for match' dialog so buttons wouldn't be obscured by suggest dropdown. Also added 'new' button. Made sure history widget is always scrolled to the 'done upto here' bar.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1579 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-16 06:21:00 +00:00
David Huynh
a62638e88d For each recon group, try at least 3 times if the service keeps failing. Log errors more for debugging purposes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1578 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-16 00:19:31 +00:00
Stefano Mazzocchi
f50880905e fixed warnings
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1577 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-16 00:01:42 +00:00
Tom Morris
80c1e5ac97 Convert mixed Java/Javascript projects to faceted form so we can support both languages in Eclipse
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1576 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 21:42:49 +00:00
David Huynh
f504a59eb1 Removed left, right, bottom borders to sidebar tab panels to streamline them a bit.
Moved extract, apply links of history widget to the top and made them into buttons. And always show them even if there's no operation.
Minor tweaks to history entries' visual.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1571 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 18:43:17 +00:00
Tom Morris
c8bb6a3475 Fix failing template exporter test. Disable HTML exporter no column headers test (unimplemented)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1570 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 18:07:17 +00:00
Tom Morris
47dd5f8da6 Make sure the stream/writer is flushed in case the exporter forgets to do it
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1569 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 17:10:37 +00:00
Tom Morris
aba75a9b4a Add a couple more tests
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1568 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 17:10:07 +00:00
Tom Morris
87b6d940b7 Some very basic tests for exporters with no test coverage
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1567 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 15:50:25 +00:00
Tom Morris
0041863a13 Placeholder (failing) tests for exporters with no test coverage
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1566 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 13:27:44 +00:00
Tom Morris
bbebb4d2dc Add @Overrides so we get warned about API changes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1565 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 13:26:25 +00:00
David Huynh
4859b7eb4e Firefox doesn't understand a pixel offset and a positional keyword used together to position a background image. So we use a separate element to position the logo on the home page.
Prevent last modified dates for projects from wrapping.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1563 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 07:54:14 +00:00
James Home
6686a48804 various improvements to data table and reconciliation indicators
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1561 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 06:42:24 +00:00
David Huynh
c5ba025bad Removing facets individually should also show the help message if there is no more facet.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1560 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 06:40:23 +00:00
David Huynh
7e9df21b70 Exporters need to implement either WriterExporter or StreamExporter.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1558 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 06:18:20 +00:00
David Huynh
73042712ed Made csv/tsv importer not trim whitespace even if "guess cells' types" is checked (for cells that are strings).
Updated csv tests to expect un-trimmed cells.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1557 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 05:30:15 +00:00
David Huynh
35def004ac Made expression bars inside facets highlight on hover to suggest they are editable.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1556 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 05:17:07 +00:00
David Huynh
1066169c05 When a new facet is added, make sure to switch to the Filter / Facet tab in the sidebar.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1555 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 05:10:05 +00:00
David Huynh
855dec26e5 Adjusted sidebar's and view panel's resizing code to pixel-precision.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1554 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 04:53:05 +00:00
David Huynh
15e715dce4 When "change" is clicked in a facet, and the expression bar is opened, then it should automatically open the dialog box to edit the expression.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1553 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 04:23:46 +00:00
James Home
fdc6fee052 dialog styles, first round of improvements to facets, data table, menus
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1552 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 02:23:22 +00:00
David Huynh
9e35ea3775 Better error message for numeric range facet if there's no numeric value.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1551 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-15 01:00:51 +00:00
James Home
f254740b11 refactor css, sidebar help UX, data table UX
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1549 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 23:31:27 +00:00
Tom Morris
083abd4329 Refactor exporter interface along same lines as importer
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1547 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 21:33:50 +00:00
Tom Morris
9858849198 Reexport some libs that are useful for extensions. Should really be independent, but fewer duplicate libs this way.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1546 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 21:32:06 +00:00
Tom Morris
495b3b6ec3 Rename gdata and sample extensions to drop the -extension suffix
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1544 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 21:12:44 +00:00
James Home
5719309a22 tightened project list type, deleted unused images
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1543 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 20:37:33 +00:00
James Home
5ab02f5a77 ui improvements: data-table-view header
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1540 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 20:24:05 +00:00
David Huynh
9542c1f254 Converted list facet's "sorted by name/count" from radio buttons to links.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1537 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 19:23:21 +00:00
David Huynh
f7222f70f7 Converted "Show as rows/records" from radio buttons to links.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1534 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 18:31:34 +00:00
James Home
d6015f783c first round of UI improvements:
- new front page
- new header
- improved about and preference pages
- new project tabs and header
- new buttons
- new logos



git-svn-id: http://google-refine.googlecode.com/svn/trunk@1533 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 17:39:41 +00:00
David Huynh
4ccdbc8716 Fixed bug in which a newly created and unedited project would never get saved because it had the same modified time and last save time.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1530 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-14 01:43:26 +00:00
David Huynh
dc49047092 We have previously changed the standard-reconcile acre app to return mids, but we still need to make sure its metadata says that its identifier space is mid, not id. And we need Refine to test for the mid identifier space as well.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1479 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-13 18:33:27 +00:00
Tom Morris
6e71e1ba76 Fix redirect & owner website. Obsoleted by David's commit, but just in case...
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1476 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-13 14:46:51 +00:00
David Huynh
a16df8f2d6 For unrecoverable projects, rename them with a suffix so the next time we won't try to recover them again.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1472 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-13 07:05:34 +00:00
David Huynh
91ffe71d17 Lowering recon batch size from 7 to 3 to avoid timeout problem. This is a temporary fix only for
Issue 156: Reconcile is not picking up alias hints or even type hints correctly

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1470 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-13 05:03:49 +00:00
David Huynh
208152b55c Added .vt template for reporting errors with stacktraces.
Fixed Issue 155: Blank browser shown when non-GZIP format is detected during import

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1469 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-13 04:51:01 +00:00
David Huynh
7cd5a47fbf We haven't been using non-split row parser, so we need to fix the trimming problem in the tsv/csv importer instead.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1467 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-12 23:24:16 +00:00
Stefano Mazzocchi
facecaa35d use png 24 to reduce the grainyness of the 16px favicon (by Heather)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1466 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-12 23:15:18 +00:00
David Huynh
2d276fa1e6 Non split row parser shouldn't trim lines because whitespaces are significant
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1465 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-12 22:45:30 +00:00
David Huynh
69c338c728 Text filter was throwing an exception if the column went away (which happened when the column got split).
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1464 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-11 23:15:13 +00:00
David Huynh
336a773069 Only try to create the workspace dir if it doesn't exist.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1463 7d457c2a-affb-35e4-300a-418c747d4874
2010-10-11 23:04:06 +00:00