Commit Graph

58 Commits

Author SHA1 Message Date
Stefano Mazzocchi
6990604981 implemented the full gridworks -> freebase conduit via delegated oauth and freeq/tripleloader
(still doesn't work as argus returns a 500 but the entire conduit is in place)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@519 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-23 08:25:52 +00:00
Stefano Mazzocchi
531431a869 make sure the jython stuff is copied in the various distributions and that it can be found even when no environment parameter is sett
git-svn-id: http://google-refine.googlecode.com/svn/trunk@518 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-22 21:36:32 +00:00
Stefano Mazzocchi
9d79278b99 better use of existing JYTHONPATH
git-svn-id: http://google-refine.googlecode.com/svn/trunk@512 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-21 00:18:31 +00:00
Vishal Talwar
d0df704d8a added python code part of jython distribution in lib/jython-2.5.1
added python.path vm arg to startup script
fixed infinite loop in unwrap() when displaying sequences of sequences



git-svn-id: http://google-refine.googlecode.com/svn/trunk@509 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-20 18:50:24 +00:00
Will Moffat
6be29f712c Fix previous fix.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@477 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-14 21:18:27 +00:00
Will Moffat
70c6f901ac Fix: build on mac
git-svn-id: http://google-refine.googlecode.com/svn/trunk@475 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-14 18:17:15 +00:00
Stefano Mazzocchi
2e1c8e688c bunch of fixes to make this script working also under cygwin
(this is useful mostly to run automated ui testing on windows)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@471 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-14 01:37:56 +00:00
Will Moffat
8142b27ee4 Fixed: Mac OS X default to Java 5. export JAVA_HOME to Java 6
git-svn-id: http://google-refine.googlecode.com/svn/trunk@469 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-13 22:14:02 +00:00
Stefano Mazzocchi
52b4fd556f more robust checking of java presence
git-svn-id: http://google-refine.googlecode.com/svn/trunk@450 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-12 04:24:17 +00:00
Stefano Mazzocchi
d3d40d608a bunch of PMD-induced fixes
(now the PMD report is clean)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@430 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-09 00:14:11 +00:00
Stefano Mazzocchi
be084ff0da more de-bash-ing
git-svn-id: http://google-refine.googlecode.com/svn/trunk@426 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-08 20:45:02 +00:00
Stefano Mazzocchi
2c221a5bf6 caved to the compulsion and fixed the bash-isms
git-svn-id: http://google-refine.googlecode.com/svn/trunk@422 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-08 18:23:14 +00:00
Stefano Mazzocchi
2da0ec986d turns out that because sh -> bash on macosx, but sh != bash on linux, we have to force this to be bash or it will crap out
(since I have no idea what kind of involuntary bash-ism I ended up using here, I'll let the power of the community fix this once it gets out... if they care, that is)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@419 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-08 03:24:48 +00:00
Stefano Mazzocchi
135f870061 - adding interactive test mode so one can use the Windmill IDE to make tests
(use ./gridworks test interactive)
- split the windmill tests between python and js
(the js one is just a silly test, waiting for Jeff to fill it up with more meaty stuff)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@418 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 22:56:46 +00:00
Stefano Mazzocchi
73454cfa05 use virtualenv to prepare python and install windmill
(this should be much more portable and much more user friendly since it doesn't change the local python installation and doesn't require any administration credentials)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@417 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 21:45:39 +00:00
Stefano Mazzocchi
4171db6540 adding jslint support
git-svn-id: http://google-refine.googlecode.com/svn/trunk@413 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 19:05:04 +00:00
Stefano Mazzocchi
7690f932b7 more fixes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@412 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 18:51:16 +00:00
Stefano Mazzocchi
f816a288af this command might fail in leopard (it's needed for snow-leopard) so avoid existing if that happens
git-svn-id: http://google-refine.googlecode.com/svn/trunk@411 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 18:40:50 +00:00
Stefano Mazzocchi
4626f88836 fixing untar issue
git-svn-id: http://google-refine.googlecode.com/svn/trunk@410 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 18:34:10 +00:00
Stefano Mazzocchi
c921fb703f syntax problems
git-svn-id: http://google-refine.googlecode.com/svn/trunk@408 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 17:40:55 +00:00
Stefano Mazzocchi
6674b69773 adding PMD and CPD support
git-svn-id: http://google-refine.googlecode.com/svn/trunk@407 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 17:31:25 +00:00
Stefano Mazzocchi
6dbe794658 enabled windmill-based UI testing (type ./gridworks test to try)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@406 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 08:28:53 +00:00
Stefano Mazzocchi
6114530723 make sure the junit tests still work
git-svn-id: http://google-refine.googlecode.com/svn/trunk@405 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 01:17:14 +00:00
Stefano Mazzocchi
0e6718388e a little more solid
git-svn-id: http://google-refine.googlecode.com/svn/trunk@401 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 00:18:26 +00:00
Stefano Mazzocchi
0978a8ec1d make things more solid for snow-leopard
git-svn-id: http://google-refine.googlecode.com/svn/trunk@400 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 00:12:40 +00:00
Stefano Mazzocchi
9e90e6f05c this time is for real
git-svn-id: http://google-refine.googlecode.com/svn/trunk@399 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:42:57 +00:00
Stefano Mazzocchi
008cc32d0d - fixing the curl redirect issue
- reduced cut/paste
- starting to load windmill


git-svn-id: http://google-refine.googlecode.com/svn/trunk@398 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:28:52 +00:00
Stefano Mazzocchi
1ad122ee47 fixes issues in case wget is not found in path
git-svn-id: http://google-refine.googlecode.com/svn/trunk@397 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:13:09 +00:00
Stefano Mazzocchi
5afd2e8c00 hmm, let's see if this fixes the problem that David is seeing but I can't repro
git-svn-id: http://google-refine.googlecode.com/svn/trunk@396 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:05:45 +00:00
Stefano Mazzocchi
687eae475d make sure to have the tools dir
git-svn-id: http://google-refine.googlecode.com/svn/trunk@395 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 22:41:33 +00:00
Stefano Mazzocchi
7590e30454 revert back to 1Gb starting heap size (3Gb was too much)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@383 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-05 21:09:34 +00:00
Stefano Mazzocchi
2efbf0031f - removed the 'thirdparty' directory (now the 'gridworks' script will download and install needed tools if they are not present in the system already)
- added 'findbugs' command that uses the findbugs static analyzer to look for problems in the code
- fixed a bunch of issues that findbugs found (a few methods would go a little faster, and a few NPE will be avoided... nothing major but good to have)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@382 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-05 07:15:16 +00:00
Stefano Mazzocchi
798b2a36ca - archive and compressed file importer (supports zip, tar, gz, bz2, tar.gz and tar.bz2)
(works by loading the files that have the most common extensions in the archive)
- changed default max heap to 3Gb


git-svn-id: http://google-refine.googlecode.com/svn/trunk@381 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-04 07:48:47 +00:00
Stefano Mazzocchi
7cf4f2e5e4 make autoreloading transpartent (so that we don't forget to set it and later think it's not working... like I just did ;-)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@379 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-03 01:28:54 +00:00
Stefano Mazzocchi
c24ec94835 had to shuffle around a bunch of classes to separate the main server classloader from the context classloader and allow reloading to happen for real
git-svn-id: http://google-refine.googlecode.com/svn/trunk@377 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-03 01:01:11 +00:00
Stefano Mazzocchi
521acda025 - pass the svn revision as format version (for more detailed verification)
- add an 'autoreload' setting that makes Gridworks autoreload its self if a class gets changed
(this is useful to make development cycles faster when working on the java code with autocompiling IDE like Eclipse or IDEA)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@372 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-02 00:52:38 +00:00
Stefano Mazzocchi
9db9351a0b - condensing exe and cli distributions into one for windows (shipping both the .exe and the .bat in the same package)
- renamed the distibutions based on their target OS
- more polishing here and there


git-svn-id: http://google-refine.googlecode.com/svn/trunk@365 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 02:11:53 +00:00
Stefano Mazzocchi
3c9af6501e more consistent naming and various polishing
git-svn-id: http://google-refine.googlecode.com/svn/trunk@364 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 01:07:52 +00:00
Stefano Mazzocchi
571f2c9ab3 - better README
- made the build system obtain and use svn revision info directly in version.js
- fixed lunch4j initial memory usage
- added .ini support for .exe starting in windows
- more robust up-to-date logic that uses SVN revisions instead of dates
- connected to new freebase.com/labs/gridworks web site


git-svn-id: http://google-refine.googlecode.com/svn/trunk@362 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 00:17:40 +00:00
Stefano Mazzocchi
8508fbbd01 - adding the BSD license
- changed a buch of issues with cli builds and windows operations
- added the ability to persist init parameters in an gridworks.ini file (both used in windows and unix)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@359 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-30 21:24:04 +00:00
David Huynh
07cf85b2a5 Added make_cli option for generating a zip containing all files necessary to do 'gridworks run' at the command line. This excludes Java source files but contains pretty much everything else.
Added make_all option that makes dmg, exe, and cli.

Added html and xls exporters.
Made exported files named after project names rather than project IDs.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@314 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-17 22:30:16 +00:00
Stefano Mazzocchi
e1d064f25c make ./gridworks -h work
git-svn-id: http://google-refine.googlecode.com/svn/trunk@310 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-17 01:51:29 +00:00
Stefano Mazzocchi
d72c07b715 latest clustering fixes (the vptree is still too slow though, I'll probably abandon that approach for now)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@285 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-12 07:37:37 +00:00
Stefano Mazzocchi
3f7397e467 fixing typo
git-svn-id: http://google-refine.googlecode.com/svn/trunk@258 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-09 20:16:04 +00:00
Stefano Mazzocchi
358586ac8f adding minimal unit testing framework (type ./gridworks test to run)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@253 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-09 08:08:35 +00:00
Stefano Mazzocchi
8633ec1c4e no more reason to use protocol buffers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@229 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-07 23:54:18 +00:00
Stefano Mazzocchi
409b451085 started work on protocol buffers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@197 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-04 08:46:33 +00:00
Stefano Mazzocchi
2691ee50d7 adding OS-specific data paths
git-svn-id: http://google-refine.googlecode.com/svn/trunk@173 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-03 02:53:07 +00:00
Stefano Mazzocchi
7152c4aae2 make sure to set JAVA_HOME when it's not set and we already know where it is
git-svn-id: http://google-refine.googlecode.com/svn/trunk@139 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-25 00:07:18 +00:00
Stefano Mazzocchi
2e5267c088 allowing to use letters in windows versions
git-svn-id: http://google-refine.googlecode.com/svn/trunk@138 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-24 23:52:20 +00:00