Commit Graph

91 Commits

Author SHA1 Message Date
David Huynh
4ad31ffcde Excel importer now supports "header lines" parameter.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1125 7d457c2a-affb-35e4-300a-418c747d4874
2010-08-01 04:22:45 +00:00
David Huynh
7bb6674e5b Fixed recently introduced bug: expressions were not logged because preference stores were not initialized properly.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1124 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-31 07:01:44 +00:00
David Huynh
f069780bfa Added support for bundling .js files to shave off some loading time.
For GetRowsCommand, tried to use jsonp but that didn't seem to improve performance much.
Gzip http responses of various text-based mime types.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1122 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-31 06:51:11 +00:00
David Huynh
d71d84194f Register new operation Transpose Cells in Columns into Rows.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1112 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-30 02:28:33 +00:00
David Huynh
ee14955605 Added new command Transpose Cells in Columns into Rows.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1111 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-30 02:25:58 +00:00
David Huynh
a192674118 - added smartSplit GEL function that can handle quoted values
- added max width to operation extract dialog
- made GEL get and slice functions handle HasFieldsList
- fixed versioned standard-reconcile URLs (they need userid.user.dev)

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1110 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-26 22:50:00 +00:00
David Huynh
2ff0184c65 - switched to accessing versioned standard-reconcile app
- standardized preference keys to using dot separated format
- added support to override freeq url from workspace preferences
- added GEL controls: forEachIndex, forRange, filter
- enforced max-width on preview table columns in expression preview dialog
- added preservedAllTokens option to split GEL function

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1109 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-26 21:12:40 +00:00
David Huynh
67daaf2140 Export as Tripleloader format command was broken by menu bar refactoring
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1108 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-25 07:30:49 +00:00
David Huynh
4522b98f32 Store and use job ID to retrieve MDO ID and send that in subsequent loads.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1100 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-16 17:32:06 +00:00
David Huynh
4373e7276f Pass target Freebase type IDs in recon objects to freeq.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1099 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-15 21:45:17 +00:00
David Huynh
b854f99ef5 Removed extra closing brace.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1096 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-11 05:54:06 +00:00
David Huynh
43dadf40da Added ignore:true to any triple that shouldn't be loaded.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1095 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-10 05:07:24 +00:00
Stefano Mazzocchi
fc005d2958 adding new favicon and watermark to the first page
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1094 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-08 23:53:25 +00:00
David Huynh
513283d4d1 Support creation of cache directories, so the rdf importer can store its lucene indexes.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1090 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-08 23:22:29 +00:00
David Huynh
67679253a7 Minor fix to freebase loading dialog: last refactoring of overlay models moved the client-side "protograph" to under theProject.overlayModels, but the dialog wasn't updated to access it there.
Refactored menu bar to be extensible.

Added wiring for upcoming rdf-exporter extension.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1075 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-06 22:24:16 +00:00
David Huynh
f5fc44e24e Refactoring to expose extension points that the rdf-exporter extension will plug into.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1074 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-06 00:14:07 +00:00
David Huynh
ab82562016 Tripleloader protograph transposer now generates more context information for QA.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1073 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-03 01:39:14 +00:00
David Huynh
217fb7b25c Fixed Issue 66: Records not excluded with inverted text facet.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1064 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-01 20:26:54 +00:00
Stefano Mazzocchi
a682d6b36f fixing eclipse warnings
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1063 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-01 08:03:42 +00:00
Stefano Mazzocchi
9fbff0640b make sure that splitting values maintains empty cells if the separator is repeated
(this is useful in case the cells contains a rigid structure across multiple columns)

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1062 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-01 07:47:57 +00:00
Stefano Mazzocchi
2302d017d8 remove eclipse warnings
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1061 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-01 07:47:52 +00:00
Stefano Mazzocchi
64e68fce89 fixed broken link to "browse this cluster"
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1060 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-01 07:47:45 +00:00
David Huynh
18b720b913 Fixed CSV and TSV export bug.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1059 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-01 02:32:03 +00:00
David Huynh
b47ada4dca When rendering recon candidates and matches, check for freebase ID on the recon object's identifier space, not the service's identifier space. This lets matches added by the "extend data" operation to be rendered properly as links.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1058 7d457c2a-affb-35e4-300a-418c747d4874
2010-07-01 02:29:27 +00:00
David Huynh
a1ae492a4d Fixed bug: Sorting radio buttons in all list facets were sharing the same name.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1056 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-30 17:45:39 +00:00
David Huynh
2adc0ad1db Minor dom wiring bug in clustering dialog.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1055 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-30 17:29:03 +00:00
David Huynh
04d32746d8 Various recon commands in the UI were not updated to work with the refactored backend.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1054 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-30 17:20:59 +00:00
David Huynh
2e3984d54a When transposing data to triple loader output, pass row indices and cell indices deep down so later we can generate more context information for recon.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1051 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-29 17:30:16 +00:00
David Huynh
7a914f01e8 Schema alignment dialog box was broken by recon refactoring.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1050 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-28 23:02:17 +00:00
David Huynh
59fe9e35bd Property suggest and type suggest widgets in standard recon service panel now use the service's suggest settings, including custom service URLs.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1049 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-28 22:42:53 +00:00
David Huynh
0e4781cb58 Forgot a console.log() call.
Allow reconciling against no particular type.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1043 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-27 04:20:35 +00:00
David Huynh
7439be4ce1 Since we're using the same panel for both showing undo and showing long running processes, we need to stop the sliding animation when showing long running processes, too.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1042 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-27 03:48:56 +00:00
David Huynh
76c8cd77eb "search for match" links in data table cells now use recon service's entity suggest options.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1041 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-27 03:31:56 +00:00
David Huynh
40c5fb8ff1 More work on recon refactoring:
- services can now be unregistered.
- matched topics and candidates now have links formatted by the service that generated them.
- recon candidate previews are also based on the recon service.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1040 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-26 05:34:54 +00:00
David Huynh
ecfb893e98 More work on the recon UI. Standard services can now be added.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1038 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-26 01:10:23 +00:00
David Huynh
1342ceacea Careful not to load all projects in an autosave cycle.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1037 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-25 22:43:30 +00:00
Stefano Mazzocchi
5193630b9a updating to the latest butterfly (and remove the version number that is a pain to maintain for now)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1034 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-25 07:03:16 +00:00
David Huynh
058e86b4c8 First pass in trying to generalize standard reconciliation service UI. A lot of pieces are still Freebase-centric.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1032 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-24 20:13:51 +00:00
Iain Sproat
f0ed50e468 issue 69 fixed. ControlFunctionRegistry now correctly registers Chomp expression as "chomp" key.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1024 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-23 17:53:29 +00:00
David Huynh
a9f77d0f51 Minor bug.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1020 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-22 21:29:15 +00:00
David Huynh
8046c63a8a Moved data-table view's files into its own sub-directory.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1017 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-21 22:14:17 +00:00
David Huynh
52f1e2ba53 Updated butterfly jar.
Extracted several dialogs' html fragments from their .js files out to .html files.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1016 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-21 21:59:53 +00:00
Iain Sproat
0d7b3b0e9c ProjectManager is now partially unit tested.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1015 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-21 19:57:31 +00:00
Iain Sproat
dcf6919900 Functionality which didn't need to be moved to FileProjectManager as it wasn't file system specific has been moved back to ProjectManager. importProject function is now named loadProjectMetadata to avoid confusion.
Some additional source code documentation added to ProjectManager, and methods rearranged in more readable fashion.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1011 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-20 16:32:49 +00:00
Iain Sproat
7ced0cb31e New feature for importing text files (CSV and TSV). By selecting the checkbox in index.html it allows the effects of quotation marks around data values to be ignored.
Unit test added for this.

This has required a further branch to opencsv - patch sent to opencsv project and can be tracked at  https://sourceforge.net/tracker/?func=detail&aid=3018599&group_id=148905&atid=773543

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1010 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-20 14:47:45 +00:00
David Huynh
778873957f Updated butterfly to r25, which now initializes modules in order based on their dependencies.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1006 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-20 01:06:47 +00:00
David Huynh
df6a62a2cf Remove extensions/jython/jython/, which has already been replaced by extensions/jython/module/; same for extensions/sample-extension/sample-extension/. Added build.xml for extensions/ and made the root build.xml file call all the extension build.xml files. Updated extensions' module.properties files to require the core module.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1005 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-20 00:44:06 +00:00
Stefano Mazzocchi
4c28f616f7 updating butterfly to the latest trunk (now allows modules to change their name with properties)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@994 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-19 02:31:36 +00:00
Iain Sproat
0af7e5fcf5 More functionality which didn't need to be moved to FileProjectManager, as it wasn't file system specific, has been moved back to ProjectManager.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@992 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-18 20:47:15 +00:00
Iain Sproat
c72b4571a5 Functionality which didn't need to be moved to FileProjectManager as it wasn't file system specific has been moved back to ProjectManager.
Some additional source code documentation added.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@991 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-18 19:16:30 +00:00