Commit Graph

2597 Commits

Author SHA1 Message Date
Iain Sproat
7ced0cb31e New feature for importing text files (CSV and TSV). By selecting the checkbox in index.html it allows the effects of quotation marks around data values to be ignored.
Unit test added for this.

This has required a further branch to opencsv - patch sent to opencsv project and can be tracked at  https://sourceforge.net/tracker/?func=detail&aid=3018599&group_id=148905&atid=773543

git-svn-id: http://google-refine.googlecode.com/svn/trunk@1010 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-20 14:47:45 +00:00
David Huynh
778873957f Updated butterfly to r25, which now initializes modules in order based on their dependencies.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1006 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-20 01:06:47 +00:00
David Huynh
df6a62a2cf Remove extensions/jython/jython/, which has already been replaced by extensions/jython/module/; same for extensions/sample-extension/sample-extension/. Added build.xml for extensions/ and made the root build.xml file call all the extension build.xml files. Updated extensions' module.properties files to require the core module.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@1005 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-20 00:44:06 +00:00
Stefano Mazzocchi
4c28f616f7 updating butterfly to the latest trunk (now allows modules to change their name with properties)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@994 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-19 02:31:36 +00:00
Iain Sproat
0af7e5fcf5 More functionality which didn't need to be moved to FileProjectManager, as it wasn't file system specific, has been moved back to ProjectManager.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@992 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-18 20:47:15 +00:00
Iain Sproat
c72b4571a5 Functionality which didn't need to be moved to FileProjectManager as it wasn't file system specific has been moved back to ProjectManager.
Some additional source code documentation added.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@991 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-18 19:16:30 +00:00
David Huynh
367c86fdd4 Fixed absolute jar path.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@990 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-17 17:06:17 +00:00
Iain Sproat
846cf1d57e Fixed bug in CsvExporter, all unit tests for CsvExporter and TsvExporter now working.
History now has the beginnings of a unit test.

Additional source documentation on public methods in ProjectManager and History.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@989 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-17 15:37:28 +00:00
David Huynh
e7d0fc5ed6 Implemented a generic preference store for both the whole workspace and each project.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@988 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-17 02:15:26 +00:00
David Huynh
0fedad047b Renamed projects to remove spaces in their names.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@987 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-16 20:23:56 +00:00
Iain Sproat
18e319bb76 Moved call to FileHistoryEntryManager from ProjectManager to FileProjectManager.
Added interface HistoryEntryManager, which seems to have been forgotten from last commit.
FileHistoryEntry is now named FileHistoryEntryManager.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@983 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-16 14:17:17 +00:00
Iain Sproat
f92fc2d056 Internal refactor for IO - HistoryEntry is now a concrete class, so can be instantiated (reverting Operations classes back to r972 which were changed as a result of HistoryEntry being abstract).
HistoryEntry now deals with backend (filesystem etc.) through classes which implement HistoryEntryManager.  This HistoryEntryManager is held by ProjectManager, which allows for FileProjectManager to create FileHistoryEntryManager as appropriate.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@982 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-16 12:35:37 +00:00
Iain Sproat
280daad2f6 Refactored ImportProjectCommand and ExportProjectCommand. These are no longer dependent on the File System, and all file system related work is done in FileProjectManager.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@981 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-16 07:44:46 +00:00
Iain Sproat
f47cb75525 Fixed ImportProjectCommand so it no longer contains references to project.html, a file previously removed from the project.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@980 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-16 07:06:52 +00:00
David Huynh
6a3da4116a Sample extension is wired up properly now.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@976 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 23:33:15 +00:00
David Huynh
7ba97c61ad More work on the sample extension
git-svn-id: http://google-refine.googlecode.com/svn/trunk@974 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 23:21:08 +00:00
Iain Sproat
17f1dc2e6f The file system coupled method getProjectDirectory is now removed from ProjectManager.
Methods of HistoryEntry which directly work with the File System have been moved to FileHistoryEntry in the io directory, and HistoryEntry made abstract.

As the abstract HistoryEntry cannot be instantiated directly, the ProjectManager is now responsible for creating new HistoryEntry.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@973 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 22:11:35 +00:00
Iain Sproat
b07075bed5 FileProjectManager and portions of Project and ProjectMetadata classes which deal with io are moved to an io directory.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@972 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 20:55:38 +00:00
Iain Sproat
c94957b6a0 CreateProjectCommand no longer contains references to project.html, a file previously removed from the project.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@971 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 20:28:18 +00:00
Iain Sproat
dc7060d390 portion of ProjectManager which interacts with File System has been moved to FileProjectManager, which extends ProjectManager. ProjectManager is now abstract.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@970 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 19:34:40 +00:00
Iain Sproat
ca5d5ea828 Fixed bug when opening existing project - javascript was referring to nonexistent project.html file, which was previously replaced by project.vt file.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@969 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 18:37:57 +00:00
Iain Sproat
a671551289 Two more XmlImport tests now work. Some documentation stubs were added to XmlImporterUtilities.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@967 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 16:22:53 +00:00
David Huynh
f7fe44dccc Converted project.html to project.vt and added a client side resource manager, where extensions can register scripts and styles to be included in .vt files
git-svn-id: http://google-refine.googlecode.com/svn/trunk@965 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-15 00:35:23 +00:00
David Huynh
b0389d8c6a Jython integration has been moved out to an extension.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@964 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-14 22:11:34 +00:00
David Huynh
ecce4db53f Moved netbeans project stuff into IDEs/netbeans/.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@951 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-07 22:16:36 +00:00
David Huynh
fd55c47cda Moved netbeans project into the sub-projects.
git-svn-id: http://google-refine.googlecode.com/svn/trunk@950 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-07 18:03:37 +00:00
Stefano Mazzocchi
ef6f03694d make all tests pass
git-svn-id: http://google-refine.googlecode.com/svn/trunk@945 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-05 01:30:12 +00:00
Stefano Mazzocchi
3668dde0d1 forgot to add the module descriptor
git-svn-id: http://google-refine.googlecode.com/svn/trunk@941 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-05 00:55:03 +00:00
Stefano Mazzocchi
af48cb799e moving Griworks to use the Butterfly webapp framework (this will allow us to make gw more extensible without excessive complexity... as a bonus we gain server side javascript support which might end up being useful)
git-svn-id: http://google-refine.googlecode.com/svn/trunk@940 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-05 00:50:18 +00:00
Stefano Mazzocchi
0648e8725e adding regexp group capturing GEL function
git-svn-id: http://google-refine.googlecode.com/svn/trunk@932 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-01 08:54:17 +00:00
Stefano Mazzocchi
5e0acf28d0 forgot to add the ngram class itself
git-svn-id: http://google-refine.googlecode.com/svn/trunk@931 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-01 08:04:40 +00:00
Stefano Mazzocchi
b3173211e3 adding an ngram function to GEL
git-svn-id: http://google-refine.googlecode.com/svn/trunk@930 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-01 08:02:28 +00:00
Stefano Mazzocchi
82d3730568 no need for this anymore
git-svn-id: http://google-refine.googlecode.com/svn/trunk@927 7d457c2a-affb-35e4-300a-418c747d4874
2010-06-01 06:56:54 +00:00
Stefano Mazzocchi
fe004d5fa6 fixed client tests
git-svn-id: http://google-refine.googlecode.com/svn/trunk@926 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-31 17:56:07 +00:00
Stefano Mazzocchi
3b7f132430 fixing jython initialization logic
git-svn-id: http://google-refine.googlecode.com/svn/trunk@924 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-31 09:00:42 +00:00
Stefano Mazzocchi
b288f41854 another gitignore for eclipse git support
git-svn-id: http://google-refine.googlecode.com/svn/trunk@923 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-31 09:00:37 +00:00
Stefano Mazzocchi
7ce78776c6 refactored tests to avoid using static initialization which conflicts with our ability to have special log4j configurati
ons for testings. Also tagged all broken tests as broken so that the tree is now green. Also used the test class as the
logger name so that it's easier to groupt the logger verbosity based on java packages.

git-svn-id: http://google-refine.googlecode.com/svn/trunk@922 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-31 08:51:51 +00:00
Stefano Mazzocchi
e3fc7ab603 bringing the refactor branch up to speed with trunk
(everything works like in trunk for now, although some tests still fail)


git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@915 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 18:18:59 +00:00
Stefano Mazzocchi
081df24a97 removing classes
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@914 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 17:32:22 +00:00
Stefano Mazzocchi
1313c2798a missing stuff
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@913 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 17:18:11 +00:00
Stefano Mazzocchi
301dd4deb3 adding eclipse project files and changing the build system
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@912 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 17:13:37 +00:00
Stefano Mazzocchi
01ea2043f8 moving the IDE stuff in the right place
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@911 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 17:07:20 +00:00
Stefano Mazzocchi
8e748fdc7a second batch of libraries
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@909 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 17:01:39 +00:00
Stefano Mazzocchi
726d90d871 moving first batch of libraries
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@908 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 17:00:35 +00:00
Stefano Mazzocchi
8369961b9e renaming tests
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@907 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 16:56:53 +00:00
Stefano Mazzocchi
aa4de48f95 some renaming, moving tests into main
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@906 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 16:55:53 +00:00
Stefano Mazzocchi
365868564f create 'main' and 'server'
git-svn-id: http://google-refine.googlecode.com/svn/branches/split-refactor@905 7d457c2a-affb-35e4-300a-418c747d4874
2010-05-30 16:52:50 +00:00