s434730/RandomSec
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
303 Commits 6 Branches 0 Tags 1.3 GiB
4e262f0e1d
Commit Graph

303 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Stefano Mazzocchi
0c6590fe2c - added an encoding guesser 
- fixed a bunch of encoding issues
- added a function to reinterpret call content in another encoding
- added a 'phonetic' function to the expression language that supports metaphone and soundex
- updated the COS library to the latest released version 
- added the IBM ICU4j library (that contains the encoding guesser)
- added examples with same content but different encodings


git-svn-id: http://google-refine.googlecode.com/svn/trunk@154 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-28 21:51:33 +00:00
Stefano Mazzocchi
d9e67ac806 - diff now can act before two dates (still to be fully tested) 
- added string fingerprinting function (useful for clustering)
- fixed unicode() function which wasn't returning correct values
- added a toString method to EvalError to know what error that was
- fixed a NPE in TextTransformationOperation


git-svn-id: http://google-refine.googlecode.com/svn/trunk@153 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-28 00:55:09 +00:00
Stefano Mazzocchi
f1923758e7 - add a bunch of new functions 
- very lax date parser
 - lots of new advanced string functions
- new version of commons-lang


git-svn-id: http://google-refine.googlecode.com/svn/trunk@152 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 08:56:04 +00:00
David Huynh
25fd5794cd Added choices blank and error to list facets. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@151 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 06:59:55 +00:00
David Huynh
49e7241d1d Re-organized functions into a few sub-packages. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@150 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 05:59:09 +00:00
David Huynh
5f4dc16d20 Some new packages for re-organizing functions. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@149 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 05:51:20 +00:00
David Huynh
c914aa6c16 Introduced EvalError objects as possible values returned by expressions. 
Extracted function and control name mappings to ControlFunctionRegistry.


git-svn-id: http://google-refine.googlecode.com/svn/trunk@148 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 05:48:33 +00:00
David Huynh
f0b8268809 Implemented permanent link, at least for facets' states. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@147 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 00:16:44 +00:00
David Huynh
f5ff9044cf Track and display recon stats in column headers. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@146 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-26 23:33:16 +00:00
David Huynh
aadf98a388 Show choice count in list facet. Use close.png for close button. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@145 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-26 22:24:25 +00:00
David Huynh
c601bb6b0a Re-organized .js files a bit. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@144 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-26 22:07:54 +00:00
David Huynh
9f7a86fb4d Folders for re-organizing .js files. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@143 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-26 22:03:24 +00:00
David Huynh
30dce3b3d5 Made range facet more robust against bad expressions. 
Centralized code that updates components of the UI. Show "Working..." indicator if anything takes more than 500ms.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@142 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-26 21:56:41 +00:00
David Huynh
1e4b9f4e80 Fixed bug in text search facet where if the query is null or empty string it'd filter to nothing. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@141 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-26 18:44:36 +00:00
Stefano Mazzocchi
7152c4aae2 make sure to set JAVA_HOME when it's not set and we already know where it is 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@139 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-25 00:07:18 +00:00
Stefano Mazzocchi
2e5267c088 allowing to use letters in windows versions 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@138 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-24 23:52:20 +00:00
David Huynh
e2ccd491c5 New dmg background. 
Added download site html.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@137 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-24 23:28:24 +00:00
David Huynh
c81913c6f8 Make sure process widget doesn't get stuck. 
Enforce maximum height on process widget.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@136 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-24 19:48:11 +00:00
David Huynh
bb83dcda1c Added support for specifying number of initial rows to skip when creating a new project. 
Fixed the height of the histogram images in range facets to eliminate jitters.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@135 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-24 18:52:54 +00:00
David Huynh
254853b51d Added reverse and sort functions. 
Support a limit on how many rows to load into a new project.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@134 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 23:22:02 +00:00
David Huynh
e449617960 Fixed minor bug introduced in last change: recon candidates didn't get rendered at all. 
Added "refresh" link for list facets.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@133 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 20:20:14 +00:00
David Huynh
2eb3a67125 Styled data table view summary a bit to highlight current number of rows. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@132 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 19:18:25 +00:00
David Huynh
4bdb2320b7 Styled help tab of expression preview dialog. Added variables section. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@131 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 19:06:58 +00:00
David Huynh
dce42400d4 Fixed bug introduced while trying to delay constructing the candidates arrays in Recon objects. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@130 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 17:47:34 +00:00
David Huynh
ec1604e815 Added support for starring rows. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@129 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 07:45:12 +00:00
David Huynh
92806cea7e Forgot one instance of "gridlock" after project rename. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@128 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 01:49:41 +00:00
David Huynh
8992531d02 Documented functions and controls in expression language. 
Better error checking in operator calls.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@127 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 01:40:06 +00:00
David Huynh
607fca04cb Added a few more math functions. 
Fixed expression preview dialog to use tabs.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@126 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 00:33:39 +00:00
David Huynh
94fbd97bc4 Added a few more expression functions. 
Bind row index when filtering rows, so we can create facets based on row indices.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@125 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 23:51:44 +00:00
David Huynh
0f505c72c5 Delay constructing the candidates array in recon objects to save memory. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@124 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 23:27:16 +00:00
David Huynh
c45e0edc10 Lower recon batch size back to 10. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@123 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 23:06:34 +00:00
David Huynh
4ed7b45e41 Don't use schema restriction for protograph link suggest because it's not a "soft" restriction (so if the user wants a property that doesn't belong to the type, there is no way to get it). 
More expression functions and controls.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@122 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 23:04:46 +00:00
David Huynh
5e9be8c258 Support reusing newly created topics for cells with the same content. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@121 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 22:15:48 +00:00
David Huynh
e4b01cb36c Make similar cell judgments an abstract operation. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@120 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 20:25:45 +00:00
David Huynh
c98a8ad552 Pulled the operations package up one level. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@119 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 18:42:25 +00:00
David Huynh
c50de52883 Improved the "extract operations" dialog to let user select which operations to extract. Also show history entries that cannot be abstracted. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@118 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 06:31:09 +00:00
David Huynh
1227c9dff4 Centralized mapping between operation names and their reconstructors. 
Implemented comparison operators.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@117 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 04:23:25 +00:00
David Huynh
934c0f81c3 Forgot to check in image files. 
Added commands for judging similar cells.
Started to fix/unify terminologies for recon operations.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@116 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 01:28:13 +00:00
David Huynh
b3167a1a9f Added option for automatically approving best recon candidates that match the expected type and score at least some minimum score. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@115 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-21 08:11:07 +00:00
David Huynh
b4935f576c Tweaked recon type guessing heuristic: remove "role" and "annotation" types, and rank types based on result orders rather than relevance scores. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@114 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-21 07:32:16 +00:00
David Huynh
b730dfd8f9 Added commands for searching for specific topics to match cells with. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@113 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-20 00:47:08 +00:00
David Huynh
ea2c904704 Use the schema index to suggest properties in the schema alignment dialog. 
Fixed minor bug in triple loader transposer that wrote a bad triple for each literal cell value.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@112 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 22:56:29 +00:00
David Huynh
c4396798e3 Made schema alignment dialog shorter to fit on laptop screens. 
Make sure main menu bar doesn't stay above dialog overlays after it gets deactivated.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@111 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 18:47:46 +00:00
David Huynh
846e540ff6 Keep track of type names of reconciled columns so we can display them later in the schema alignment dialog. 
Automatically create properties linking to all columns when starting with an empty protograph.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@110 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 18:32:48 +00:00
David Huynh
acb0c91306 Re-organized column header popup menu. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@109 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 17:55:46 +00:00
David Huynh
6c7557eeff Minor bug fixes. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@108 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 17:47:04 +00:00
David Huynh
7f528c320d Implemented a "busy" indicator dialog, useful for preparatory steps like guessing types before showing the recon dialog. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@107 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 17:38:47 +00:00
David Huynh
bc412b99ea Fixed bug in triple loader transposer: properties didn't get asserted before. 
Made triple loader transposer index its output variables.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@106 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 07:05:09 +00:00
David Huynh
5264c829ae A bit more careful error handling during recon. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@105 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 01:17:35 +00:00
David Huynh
28a86dfe0f Automatically guess types to reconcile a column, using Stefano's trick in his "cupid" acre app. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@104 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-19 00:28:34 +00:00