s434730/RandomSec
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
3,518 Commits 6 Branches 0 Tags 1.3 GiB
7ed8c8b7e7
Commit Graph

3518 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
David Huynh
f02fd3f5c3 Try to keep the same scrolling position in the data table view when it gets re-rendered. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@269 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-10 07:51:34 +00:00
Stefano Mazzocchi
a7d4951725 several improvements for clustering 
- added a unicode ASCII-fiying addition to the fingerprinting functions
 - removed all distance functions for kNN that didn't seem to do anything useful
 - added the ability to indicate what value to use as cluster centroid by simply clicking on it
 (this is useful for those names that have non-ASCII chars that might not even be on your keyboard.. and cut/paste is error prone/cumbersome)
 - added a 10x multiplier to the PPM compression distance which makes it more aligned with the levenshtein ones
 - made sure that we construct a phonetic fingerprint for the whole string and not just the beginning subset
(performance is still not ideal but it's now reasonable)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@268 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-10 07:45:14 +00:00
David Huynh
6bf5418f9d Cell changes should also flush column precomputes. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@267 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-10 07:42:57 +00:00
David Huynh
0160b6841d Fixed data table view bugs: collapsed columns should now stay collapsed even if the column model changes. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@266 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-10 07:12:09 +00:00
David Huynh
e008332399 - make recon changes flush column precomputes 
- fixed bug where recon features are not saved to file properly
- support selecting non-numeric, blank, and error choices in numeric range facets

git-svn-id: http://google-refine.googlecode.com/svn/trunk@265 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-10 06:02:36 +00:00
Stefano Mazzocchi
72b012971f more polish on the clustering dialog 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@264 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-10 01:18:41 +00:00
David Huynh
1000d63539 In the range facet, although we don't want to update the facets until the user stops dragging, we still want to update the selection indicators from-to during the dragging. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@263 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 22:53:53 +00:00
Stefano Mazzocchi
c03b223a78 fixed another NPE bug 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@262 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 22:43:49 +00:00
David Huynh
51b38a4eed Fixed minor bug in binning clusterer. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@261 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 21:28:40 +00:00
Stefano Mazzocchi
0c4b79c53a more polish on the clustering dialog 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@260 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 20:58:51 +00:00
David Huynh
6b3a20dc46 Check for null confidence string. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@259 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 20:57:46 +00:00
Stefano Mazzocchi
3f7397e467 fixing typo 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@258 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 20:16:04 +00:00
David Huynh
2bac6844e2 Fixed csv importer to handle escaped quotation marks (""). 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@257 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 19:10:55 +00:00
Stefano Mazzocchi
8ce21461cb getting closer to the desired functionality... still way too slow though 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@256 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 17:28:50 +00:00
Stefano Mazzocchi
50e58fb863 ngram-blocking gives more expected results... but slow as hell, maybe bug in the vptree code? 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@255 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 09:05:20 +00:00
Stefano Mazzocchi
546f87a536 let's try with another knn method 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@254 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 08:09:35 +00:00
Stefano Mazzocchi
358586ac8f adding minimal unit testing framework (type ./gridworks test to run) 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@253 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 08:08:35 +00:00
Stefano Mazzocchi
0a7882bf6c moving testing data into its own folder 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@252 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 07:34:41 +00:00
Stefano Mazzocchi
5b0129b36f adding junit in preparation from testing 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@251 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 07:33:36 +00:00
David Huynh
977dbdb9ed Fixed numeric range facet: 
- use X icon for facet remove button
- update facet only when user finishes dragging slider bracket

git-svn-id: http://google-refine.googlecode.com/svn/trunk@250 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 07:01:13 +00:00
David Huynh
311d15f493 Re-organized column header popup menus and added a bunch of common facets and common cell edit transforms. 
Added native syntax for regex in GEL and modified replace, split, partition, and rpartition functions to support regex. Removed function replaceRegex.


git-svn-id: http://google-refine.googlecode.com/svn/trunk@249 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 06:57:08 +00:00
Stefano Mazzocchi
5b079b04b7 - moved from float to double to avoid excessive casting from secondstring 
- added a few of the more powerful distances
- fixed a bug in the VPTree builder (although is still not working as I expect it to)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@248 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 05:11:36 +00:00
David Huynh
af9e9f590b Fixed minor bug in facets of facet-based edit dialog. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@247 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 00:41:33 +00:00
David Huynh
4cc1933065 Got facets in facet-based edit dialog to update only after the user has finished dragging the slider bracket. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@246 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 00:33:07 +00:00
David Huynh
562b9d67a2 Customized brackets of slider widget so that they are asymmetric. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@245 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-09 00:14:01 +00:00
David Huynh
a3bcfc1576 Implemented facets on cluster metrics in facet-based edit dialog. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@244 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 23:05:44 +00:00
David Huynh
ff94de5900 Made dialogs draggable. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@243 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 21:50:53 +00:00
David Huynh
8633b20392 Fixed layout bug in expression preview dialog. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@242 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 21:02:04 +00:00
David Huynh
6b421c2c75 In property suggest, bubble up properties of included types as well. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@241 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 20:56:04 +00:00
David Huynh
4a4ae6bf27 Fixed toTitlecase to handle parentheses and other delimiters. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@240 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 19:40:51 +00:00
David Huynh
c147837a3e Cell and facet choice edit popups now allow Shift-Enter as a means to insert new lines. Plain Enter still applies the edit immediately. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@239 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 19:27:37 +00:00
David Huynh
0ef0aec0c5 Implemented list facet choice edit. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@238 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 19:07:16 +00:00
David Huynh
d731b89b4c Back to Tahoma as the main font. 
Tried more branding colors on dialog header background and tab widget header background.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@237 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 07:21:46 +00:00
David Huynh
6472e1f076 Re-layout when window is resized. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@236 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 06:48:12 +00:00
David Huynh
ac50b3c48b Re-worked the cell editor popup. 
Don't keep logging "Saved workspace."

git-svn-id: http://google-refine.googlecode.com/svn/trunk@235 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 06:30:47 +00:00
David Huynh
5d3a57eeeb Implemented project import and export commands (from/to .tar files). 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@234 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 02:34:25 +00:00
David Huynh
12d5c6aba5 Fixed layout of extract operation dialog. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@233 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 00:45:29 +00:00
David Huynh
a1ec0ea8df When saving projects, save only modified ones. 
Save projects and workspace periodically.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@232 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-08 00:37:06 +00:00
Stefano Mazzocchi
404883da92 forgot to remove from the eclipse build path 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@231 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 23:57:03 +00:00
Stefano Mazzocchi
bbd6a17732 and more protbuf stuff removed 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@230 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 23:56:34 +00:00
Stefano Mazzocchi
8633ec1c4e no more reason to use protocol buffers 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@229 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 23:54:18 +00:00
David Huynh
3388c3e09f Still some old Serializable stuff to remove. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@228 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 23:02:57 +00:00
David Huynh
80e6111a92 Added options for omitting error and blank choices in list facets, and use them in the various recon facets. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@227 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 22:54:02 +00:00
David Huynh
694f09fb0a Major refactoring: everything is now saved to disk using our own formats, mostly json-based, some inside zip files. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@226 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 22:37:26 +00:00
Stefano Mazzocchi
f7b0caa1b8 now kNN clustering is fully operational... not very practical though, needs more work and testing 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@225 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 08:27:13 +00:00
David Huynh
e06d8fe130 Better checking for null value in Cell.load. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@224 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 00:35:44 +00:00
David Huynh
e0d72c81e9 Renamed "facet-based edit" operation and command to "mass edit", because it's not just facet-based. 
Added option "apply to other cells with same original content" to single cell edit popup, so it can be used like a find&replace operation.
Renamed "do-text-transform" operation and command to just "text-transform".

git-svn-id: http://google-refine.googlecode.com/svn/trunk@223 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-07 00:25:00 +00:00
David Huynh
b9308e4034 Added option to apply and recluster in the facet based edit dialog. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@222 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-06 23:34:27 +00:00
David Huynh
02cd59a5c0 Display cluster sizes and number of cluster in facet-based edit dialog. 
Added command to invoke that dialog from column popup menu, so you don't have to create a text facet first to get to it.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@221 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-06 23:01:46 +00:00
David Huynh
253874b1a1 Got Clusterer to use Column.name rather than Column.headerLabel now. 
Tried using Verdana instead of Tahoma as the common font.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@220 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-06 22:48:42 +00:00