Commit Graph

26 Commits

Author SHA1 Message Date
Stefano Mazzocchi
798b2a36ca - archive and compressed file importer (supports zip, tar, gz, bz2, tar.gz and tar.bz2)
(works by loading the files that have the most common extensions in the archive)
- changed default max heap to 3Gb


git-svn-id: http://google-refine.googlecode.com/svn/trunk@381 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-04 07:48:47 +00:00
Stefano Mazzocchi
7cf4f2e5e4 make autoreloading transpartent (so that we don't forget to set it and later think it's not working... like I just did ;-)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@379 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-03 01:28:54 +00:00
Stefano Mazzocchi
c24ec94835 had to shuffle around a bunch of classes to separate the main server classloader from the context classloader and allow reloading to happen for real
git-svn-id: http://google-refine.googlecode.com/svn/trunk@377 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-03 01:01:11 +00:00
Stefano Mazzocchi
521acda025 - pass the svn revision as format version (for more detailed verification)
- add an 'autoreload' setting that makes Gridworks autoreload its self if a class gets changed
(this is useful to make development cycles faster when working on the java code with autocompiling IDE like Eclipse or IDEA)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@372 7d457c2a-affb-35e4-300a-418c747d4874
2010-04-02 00:52:38 +00:00
Stefano Mazzocchi
9db9351a0b - condensing exe and cli distributions into one for windows (shipping both the .exe and the .bat in the same package)
- renamed the distibutions based on their target OS
- more polishing here and there


git-svn-id: http://google-refine.googlecode.com/svn/trunk@365 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 02:11:53 +00:00
Stefano Mazzocchi
3c9af6501e more consistent naming and various polishing
git-svn-id: http://google-refine.googlecode.com/svn/trunk@364 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 01:07:52 +00:00
Stefano Mazzocchi
571f2c9ab3 - better README
- made the build system obtain and use svn revision info directly in version.js
- fixed lunch4j initial memory usage
- added .ini support for .exe starting in windows
- more robust up-to-date logic that uses SVN revisions instead of dates
- connected to new freebase.com/labs/gridworks web site


git-svn-id: http://google-refine.googlecode.com/svn/trunk@362 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-31 00:17:40 +00:00
Stefano Mazzocchi
8508fbbd01 - adding the BSD license
- changed a buch of issues with cli builds and windows operations
- added the ability to persist init parameters in an gridworks.ini file (both used in windows and unix)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@359 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-30 21:24:04 +00:00
David Huynh
07cf85b2a5 Added make_cli option for generating a zip containing all files necessary to do 'gridworks run' at the command line. This excludes Java source files but contains pretty much everything else.
Added make_all option that makes dmg, exe, and cli.

Added html and xls exporters.
Made exported files named after project names rather than project IDs.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@314 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-17 22:30:16 +00:00
Stefano Mazzocchi
e1d064f25c make ./gridworks -h work
git-svn-id: http://google-refine.googlecode.com/svn/trunk@310 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-17 01:51:29 +00:00
Stefano Mazzocchi
d72c07b715 latest clustering fixes (the vptree is still too slow though, I'll probably abandon that approach for now)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@285 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-12 07:37:37 +00:00
Stefano Mazzocchi
3f7397e467 fixing typo
git-svn-id: http://google-refine.googlecode.com/svn/trunk@258 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-09 20:16:04 +00:00
Stefano Mazzocchi
358586ac8f adding minimal unit testing framework (type ./gridworks test to run)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@253 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-09 08:08:35 +00:00
Stefano Mazzocchi
8633ec1c4e no more reason to use protocol buffers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@229 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-07 23:54:18 +00:00
Stefano Mazzocchi
409b451085 started work on protocol buffers
git-svn-id: http://google-refine.googlecode.com/svn/trunk@197 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-04 08:46:33 +00:00
Stefano Mazzocchi
2691ee50d7 adding OS-specific data paths
git-svn-id: http://google-refine.googlecode.com/svn/trunk@173 7d457c2a-affb-35e4-300a-418c747d4874
2010-03-03 02:53:07 +00:00
Stefano Mazzocchi
7152c4aae2 make sure to set JAVA_HOME when it's not set and we already know where it is
git-svn-id: http://google-refine.googlecode.com/svn/trunk@139 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-25 00:07:18 +00:00
Stefano Mazzocchi
2e5267c088 allowing to use letters in windows versions
git-svn-id: http://google-refine.googlecode.com/svn/trunk@138 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-24 23:52:20 +00:00
David Huynh
e2ccd491c5 New dmg background.
Added download site html.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@137 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-24 23:28:24 +00:00
Stefano Mazzocchi
91d0133a76 - build a windows distribution
- update to the latest ant to use in case one is not present locally


git-svn-id: http://google-refine.googlecode.com/svn/trunk@85 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-10 07:30:16 +00:00
Stefano Mazzocchi
7510594d0d build MacOSX desktop app and disk installer
git-svn-id: http://google-refine.googlecode.com/svn/trunk@81 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-09 20:21:10 +00:00
Stefano Mazzocchi
6d4425c696 - finally java6 has support for wildcards... seriously, how fricking long did it take for this to happen?!
- so require java6 since it's also a lot faster and a lot more reliable for us for profiling


git-svn-id: http://google-refine.googlecode.com/svn/trunk@68 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-08 19:48:28 +00:00
Stefano Mazzocchi
f198cba994 I guess wildcards are not supported in java6 on macs
git-svn-id: http://google-refine.googlecode.com/svn/trunk@66 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 23:22:34 +00:00
Stefano Mazzocchi
1343162a75 major rewrite of the foundation:
- de-maveniziation (uses the same code that Acre uses to drive jetty directly)
 - removed all dependencies on external javascript code (jquery and suggest) by making a local copy (this makes gridworks totally self-serving, meaning that you can use it even if you don't have any internet connectivity)
 - fixed a NPE when the servlet is shutdown before any project is loaded
 - found a way to spawn a browser directly from the java code (untested in windows)
 - added two ant tasks to generate windows and macosx stand-alone binaries (unused just yet)

To run, just type "./gridworks run" at the command line


git-svn-id: http://google-refine.googlecode.com/svn/trunk@65 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 23:15:50 +00:00
Stefano Mazzocchi
c194beb11a hmm, shell files are picky
git-svn-id: http://google-refine.googlecode.com/svn/trunk@60 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 05:32:07 +00:00
Stefano Mazzocchi
2077d3f094 adding unix and windows startup scripts
use maven to build the eclipse scripts instead of committing them in svn which makes them less portable
(do './gridworks eclipse' at the beginning to regenerate your eclipse project files, then reload in eclipse)


git-svn-id: http://google-refine.googlecode.com/svn/trunk@59 7d457c2a-affb-35e4-300a-418c747d4874
2010-02-07 05:25:44 +00:00