s434730/RandomSec
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
193 Commits 6 Branches 0 Tags 1.3 GiB
6811f54f31
Commit Graph

35 Commits

Author SHA1 Message Date
Stefano Mazzocchi
8f01da0aa8 fixing the date parser 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@193 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-04 04:06:38 +00:00
Stefano Mazzocchi
1695e2f8f1 add the ngramFingerprint function 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@191 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-04 02:37:25 +00:00
Stefano Mazzocchi
5c3ca7723a use a TreeSet to do both sorting and de-dupe of the split fragments 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@190 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-04 02:37:06 +00:00
Stefano Mazzocchi
cde6a02cbb typo (needed to escape ' which is actually *not* an HTML entity, who knew) 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@188 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-04 02:24:06 +00:00
David Huynh
87956be756 Minor bug: don't try to bind null cell value. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@187 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-04 02:14:40 +00:00
David Huynh
b4d2cef526 Added an option for what to do when a text transform errors out. Made a custom expression preview dialog for the text transform command in order to suppor that option. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@178 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-03 22:12:48 +00:00
David Huynh
b75f1faea8 Changed tabs to spaces. No functionality change. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@174 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-03 04:19:58 +00:00
Stefano Mazzocchi
2691ee50d7 adding OS-specific data paths 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@173 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-03 02:53:07 +00:00
Stefano Mazzocchi
621655372f - save encoding and confidence in the project metadata 
- use the saved encoding for decoding
- don't error when fingerprinting null


git-svn-id: http://google-refine.googlecode.com/svn/trunk@160 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-01 04:56:16 +00:00
David Huynh
bc9bc54d30 Implemented a meta parser that looks for a language prefix and picks the right parser. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@159 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-01 01:50:56 +00:00
David Huynh
acfa19a683 Moved GEL stuff (gridworks expression language) into gel package. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@158 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-01 01:30:31 +00:00
David Huynh
7c38fbb945 Created an ast package for gridworks expression language abstract syntax tree nodes. Moved parsing exception class out to its own file. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@156 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-01 01:14:21 +00:00
David Huynh
983be19e14 Made EvalError serializable because errors can be cell values and need to be saved. 
Turned is* functions into controls, since they have to be able to test errors, and only controls can do that, not functions.
Polished display of errors in cells and in expression preview dialog.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@155 7d457c2a-affb-35e4-300a-418c747d4874
 2010-03-01 00:21:13 +00:00
Stefano Mazzocchi
0c6590fe2c - added an encoding guesser 
- fixed a bunch of encoding issues
- added a function to reinterpret call content in another encoding
- added a 'phonetic' function to the expression language that supports metaphone and soundex
- updated the COS library to the latest released version 
- added the IBM ICU4j library (that contains the encoding guesser)
- added examples with same content but different encodings


git-svn-id: http://google-refine.googlecode.com/svn/trunk@154 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-28 21:51:33 +00:00
Stefano Mazzocchi
d9e67ac806 - diff now can act before two dates (still to be fully tested) 
- added string fingerprinting function (useful for clustering)
- fixed unicode() function which wasn't returning correct values
- added a toString method to EvalError to know what error that was
- fixed a NPE in TextTransformationOperation


git-svn-id: http://google-refine.googlecode.com/svn/trunk@153 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-28 00:55:09 +00:00
Stefano Mazzocchi
f1923758e7 - add a bunch of new functions 
- very lax date parser
 - lots of new advanced string functions
- new version of commons-lang


git-svn-id: http://google-refine.googlecode.com/svn/trunk@152 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 08:56:04 +00:00
David Huynh
25fd5794cd Added choices blank and error to list facets. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@151 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 06:59:55 +00:00
David Huynh
49e7241d1d Re-organized functions into a few sub-packages. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@150 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 05:59:09 +00:00
David Huynh
c914aa6c16 Introduced EvalError objects as possible values returned by expressions. 
Extracted function and control name mappings to ControlFunctionRegistry.


git-svn-id: http://google-refine.googlecode.com/svn/trunk@148 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-27 05:48:33 +00:00
David Huynh
254853b51d Added reverse and sort functions. 
Support a limit on how many rows to load into a new project.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@134 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 23:22:02 +00:00
David Huynh
4bdb2320b7 Styled help tab of expression preview dialog. Added variables section. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@131 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 19:06:58 +00:00
David Huynh
8992531d02 Documented functions and controls in expression language. 
Better error checking in operator calls.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@127 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 01:40:06 +00:00
David Huynh
607fca04cb Added a few more math functions. 
Fixed expression preview dialog to use tabs.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@126 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-23 00:33:39 +00:00
David Huynh
94fbd97bc4 Added a few more expression functions. 
Bind row index when filtering rows, so we can create facets based on row indices.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@125 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 23:51:44 +00:00
David Huynh
4ed7b45e41 Don't use schema restriction for protograph link suggest because it's not a "soft" restriction (so if the user wants a property that doesn't belong to the type, there is no way to get it). 
More expression functions and controls.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@122 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 23:04:46 +00:00
David Huynh
1227c9dff4 Centralized mapping between operation names and their reconstructors. 
Implemented comparison operators.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@117 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-22 04:23:25 +00:00
Stefano Mazzocchi
a61f35079a make eclipse happier by removing @Override annotations when really it's an interface method implementation 
(no functional changes)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@62 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-07 06:47:52 +00:00
David Huynh
a025b272bd String.isEmpty() is no longer there (?!). 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@61 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-07 06:16:46 +00:00
David Huynh
2ceaa53390 Split css files. 
Allow expressions to be evaluated on null cells too.
Various minor UI polishing touches and minor bug fixes.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@58 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-07 03:36:40 +00:00
David Huynh
3e30ab2a33 Added length function and support for creating custom numeric (range slider) facets. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@48 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-05 19:43:43 +00:00
David Huynh
3ea230b11c Minor bug fixes. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@46 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-05 08:56:44 +00:00
David Huynh
8444136be1 Added control constructs to expression language. 
Fixed bugs in multi-value cell split/join operations.
Condensed movies-condensed.tsv test data further.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@45 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-05 08:39:10 +00:00
David Huynh
f8e15798e2 Implemented column addition and removal features. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@41 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-04 23:38:40 +00:00
David Huynh
9a63bdd821 Unified the way expression bindings are created, so everywhere we'll have the same variable bindings. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@38 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-04 06:30:56 +00:00
David Huynh
047f59e461 Renamed java packages. 
git-svn-id: http://google-refine.googlecode.com/svn/trunk@27 7d457c2a-affb-35e4-300a-418c747d4874
 2010-02-03 02:29:47 +00:00