Commit Graph

45 Commits

Author SHA1 Message Date
Stefano Mazzocchi
135f870061 - adding interactive test mode so one can use the Windmill IDE to make tests
(use ./gridworks test interactive)
- split the windmill tests between python and js
(the js one is just a silly test, waiting for Jeff to fill it up with more meaty stuff)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@418 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 22:56:46 +00:00
Stefano Mazzocchi
73454cfa05 use virtualenv to prepare python and install windmill
(this should be much more portable and much more user friendly since it doesn't change the local python installation and doesn't require any administration credentials)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@417 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 21:45:39 +00:00
Stefano Mazzocchi
4171db6540 adding jslint support
git-svn-id: http://google-refine.googlecode.com/svn/trunk@413 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 19:05:04 +00:00
Stefano Mazzocchi
7690f932b7 more fixes
git-svn-id: http://google-refine.googlecode.com/svn/trunk@412 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 18:51:16 +00:00
Stefano Mazzocchi
f816a288af this command might fail in leopard (it's needed for snow-leopard) so avoid existing if that happens
git-svn-id: http://google-refine.googlecode.com/svn/trunk@411 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 18:40:50 +00:00
Stefano Mazzocchi
4626f88836 fixing untar issue
git-svn-id: http://google-refine.googlecode.com/svn/trunk@410 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 18:34:10 +00:00
Stefano Mazzocchi
c921fb703f syntax problems
git-svn-id: http://google-refine.googlecode.com/svn/trunk@408 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 17:40:55 +00:00
Stefano Mazzocchi
6674b69773 adding PMD and CPD support
git-svn-id: http://google-refine.googlecode.com/svn/trunk@407 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 17:31:25 +00:00
Stefano Mazzocchi
6dbe794658 enabled windmill-based UI testing (type ./gridworks test to try)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@406 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 08:28:53 +00:00
Stefano Mazzocchi
6114530723 make sure the junit tests still work
git-svn-id: http://google-refine.googlecode.com/svn/trunk@405 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 01:17:14 +00:00
Stefano Mazzocchi
0e6718388e a little more solid
git-svn-id: http://google-refine.googlecode.com/svn/trunk@401 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 00:18:26 +00:00
Stefano Mazzocchi
0978a8ec1d make things more solid for snow-leopard
git-svn-id: http://google-refine.googlecode.com/svn/trunk@400 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-07 00:12:40 +00:00
Stefano Mazzocchi
9e90e6f05c this time is for real
git-svn-id: http://google-refine.googlecode.com/svn/trunk@399 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:42:57 +00:00
Stefano Mazzocchi
008cc32d0d - fixing the curl redirect issue
- reduced cut/paste
- starting to load windmill


git-svn-id: http://google-refine.googlecode.com/svn/trunk@398 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:28:52 +00:00
Stefano Mazzocchi
1ad122ee47 fixes issues in case wget is not found in path
git-svn-id: http://google-refine.googlecode.com/svn/trunk@397 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:13:09 +00:00
Stefano Mazzocchi
5afd2e8c00 hmm, let's see if this fixes the problem that David is seeing but I can't repro
git-svn-id: http://google-refine.googlecode.com/svn/trunk@396 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 23:05:45 +00:00
Stefano Mazzocchi
687eae475d make sure to have the tools dir
git-svn-id: http://google-refine.googlecode.com/svn/trunk@395 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-06 22:41:33 +00:00
Stefano Mazzocchi
7590e30454 revert back to 1Gb starting heap size (3Gb was too much)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@383 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-05 21:09:34 +00:00
Stefano Mazzocchi
2efbf0031f - removed the 'thirdparty' directory (now the 'gridworks' script will download and install needed tools if they are not present in the system already)
- added 'findbugs' command that uses the findbugs static analyzer to look for problems in the code
- fixed a bunch of issues that findbugs found (a few methods would go a little faster, and a few NPE will be avoided... nothing major but good to have)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@382 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-05 07:15:16 +00:00
Stefano Mazzocchi
798b2a36ca - archive and compressed file importer (supports zip, tar, gz, bz2, tar.gz and tar.bz2)
(works by loading the files that have the most common extensions in the archive)
- changed default max heap to 3Gb


git-svn-id: http://google-refine.googlecode.com/svn/trunk@381 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-04 07:48:47 +00:00
Stefano Mazzocchi
7cf4f2e5e4 make autoreloading transpartent (so that we don't forget to set it and later think it's not working... like I just did ;-)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@379 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-03 01:28:54 +00:00
Stefano Mazzocchi
c24ec94835 had to shuffle around a bunch of classes to separate the main server classloader from the context classloader and allow reloading to happen for real
git-svn-id: http://google-refine.googlecode.com/svn/trunk@377 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-03 01:01:11 +00:00
Stefano Mazzocchi
521acda025 - pass the svn revision as format version (for more detailed verification)
- add an 'autoreload' setting that makes Gridworks autoreload its self if a class gets changed
(this is useful to make development cycles faster when working on the java code with autocompiling IDE like Eclipse or IDEA)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@372 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-02 00:52:38 +00:00
Stefano Mazzocchi
9db9351a0b - condensing exe and cli distributions into one for windows (shipping both the .exe and the .bat in the same package)
- renamed the distibutions based on their target OS
- more polishing here and there


git-svn-id: http://google-refine.googlecode.com/svn/trunk@365 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 02:11:53 +00:00
Stefano Mazzocchi
3c9af6501e more consistent naming and various polishing
git-svn-id: http://google-refine.googlecode.com/svn/trunk@364 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 01:07:52 +00:00
Stefano Mazzocchi
571f2c9ab3 - better README
- made the build system obtain and use svn revision info directly in version.js
- fixed lunch4j initial memory usage
- added .ini support for .exe starting in windows
- more robust up-to-date logic that uses SVN revisions instead of dates
- connected to new freebase.com/labs/gridworks web site


git-svn-id: http://google-refine.googlecode.com/svn/trunk@362 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 00:17:40 +00:00
Stefano Mazzocchi
8508fbbd01 - adding the BSD license
- changed a buch of issues with cli builds and windows operations
- added the ability to persist init parameters in an gridworks.ini file (both used in windows and unix)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@359 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-30 21:24:04 +00:00
David Huynh
07cf85b2a5 Added make_cli option for generating a zip containing all files necessary to do 'gridworks run' at the command line. This excludes Java source files but contains pretty much everything else.
Added make_all option that makes dmg, exe, and cli.

Added html and xls exporters.
Made exported files named after project names rather than project IDs.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@314 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-17 22:30:16 +00:00
Stefano Mazzocchi
e1d064f25c make ./gridworks -h work
git-svn-id: http://google-refine.googlecode.com/svn/trunk@310 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-17 01:51:29 +00:00
Stefano Mazzocchi
d72c07b715 latest clustering fixes (the vptree is still too slow though, I'll probably abandon that approach for now)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@285 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-12 07:37:37 +00:00
Stefano Mazzocchi
3f7397e467 fixing typo
git-svn-id: http://google-refine.googlecode.com/svn/trunk@258 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-09 20:16:04 +00:00
Stefano Mazzocchi
358586ac8f adding minimal unit testing framework (type ./gridworks test to run)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@253 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-09 08:08:35 +00:00
Stefano Mazzocchi
8633ec1c4e no more reason to use protocol buffers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@229 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-07 23:54:18 +00:00
Stefano Mazzocchi
409b451085 started work on protocol buffers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@197 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-04 08:46:33 +00:00
Stefano Mazzocchi
2691ee50d7 adding OS-specific data paths
git-svn-id: http://google-refine.googlecode.com/svn/trunk@173 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-03 02:53:07 +00:00
Stefano Mazzocchi
7152c4aae2 make sure to set JAVA_HOME when it's not set and we already know where it is
git-svn-id: http://google-refine.googlecode.com/svn/trunk@139 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-25 00:07:18 +00:00
Stefano Mazzocchi
2e5267c088 allowing to use letters in windows versions
git-svn-id: http://google-refine.googlecode.com/svn/trunk@138 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-24 23:52:20 +00:00
David Huynh
e2ccd491c5 New dmg background.
Added download site html.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@137 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-24 23:28:24 +00:00
Stefano Mazzocchi
91d0133a76 - build a windows distribution
- update to the latest ant to use in case one is not present locally


git-svn-id: http://google-refine.googlecode.com/svn/trunk@85 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-10 07:30:16 +00:00
Stefano Mazzocchi
7510594d0d build MacOSX desktop app and disk installer
git-svn-id: http://google-refine.googlecode.com/svn/trunk@81 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-09 20:21:10 +00:00
Stefano Mazzocchi
6d4425c696 - finally java6 has support for wildcards... seriously, how fricking long did it take for this to happen?!
- so require java6 since it's also a lot faster and a lot more reliable for us for profiling


git-svn-id: http://google-refine.googlecode.com/svn/trunk@68 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-08 19:48:28 +00:00
Stefano Mazzocchi
f198cba994 I guess wildcards are not supported in java6 on macs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@66 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 23:22:34 +00:00
Stefano Mazzocchi
1343162a75 major rewrite of the foundation:
- de-maveniziation (uses the same code that Acre uses to drive jetty directly)
 - removed all dependencies on external javascript code (jquery and suggest) by making a local copy (this makes gridworks totally self-serving, meaning that you can use it even if you don't have any internet connectivity)
 - fixed a NPE when the servlet is shutdown before any project is loaded
 - found a way to spawn a browser directly from the java code (untested in windows)
 - added two ant tasks to generate windows and macosx stand-alone binaries (unused just yet)

To run, just type "./gridworks run" at the command line


git-svn-id: http://google-refine.googlecode.com/svn/trunk@65 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 23:15:50 +00:00
Stefano Mazzocchi
c194beb11a hmm, shell files are picky
git-svn-id: http://google-refine.googlecode.com/svn/trunk@60 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 05:32:07 +00:00
Stefano Mazzocchi
2077d3f094 adding unix and windows startup scripts
use maven to build the eclipse scripts instead of committing them in svn which makes them less portable
(do './gridworks eclipse' at the beginning to regenerate your eclipse project files, then reload in eclipse)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@59 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 05:25:44 +00:00