Added a mention of the new JsonImporter to CHANGES.txt
Corrected the logger name in JsonImporter.java git-svn-id: http://google-refine.googlecode.com/svn/trunk@1455 7d457c2a-affb-35e4-300a-418c747d4874
This commit is contained in:
Iain Sproat
parent
ad0d227ab3
commit
142591a090
203
CHANGES.txt
203
CHANGES.txt
@ -1,101 +1,102 @@
|
|||||||
Ongoing
|
Ongoing
|
||||||
|
|
||||||
Major Changes:
|
Major Changes:
|
||||||
- New extension architecture.
|
- New extension architecture.
|
||||||
- Generalized reconciliation framework that allows plugging in standard reconciliation services.
|
- Generalized reconciliation framework that allows plugging in standard reconciliation services.
|
||||||
- Support for QA on data loads into Freebase.
|
- Support for QA on data loads into Freebase.
|
||||||
- Timeline Facet (Issue 40 and 95)
|
- Timeline Facet (Issue 40 and 95)
|
||||||
|
|
||||||
Features:
|
Features:
|
||||||
- New commands:
|
- New commands:
|
||||||
- Fill Down
|
- Fill Down
|
||||||
- Blank Down
|
- Blank Down
|
||||||
- Transpose Cells in Columns into Rows
|
- Transpose Cells in Columns into Rows
|
||||||
- Transpose Cells in Rows into Columns (Issue 82)
|
- Transpose Cells in Rows into Columns (Issue 82)
|
||||||
- Move Column to Beginning, Move Column to End, Move Column Left, Move Column Right, Reorder Columns
|
- Move Column to Beginning, Move Column to End, Move Column Left, Move Column Right, Reorder Columns
|
||||||
- Add Column by Fetching URLs
|
- Add Column by Fetching URLs
|
||||||
- GEL:
|
- GEL:
|
||||||
- JSON support
|
- JSON support
|
||||||
- New functions: smartSplit, escape, parseJson, hasField, uniques
|
- New functions: smartSplit, escape, parseJson, hasField, uniques
|
||||||
- New controls: forEachIndex, forRange, filter
|
- New controls: forEachIndex, forRange, filter
|
||||||
- New parameters:
|
- New parameters:
|
||||||
- preserveAllTokens on split function
|
- preserveAllTokens on split function
|
||||||
- Regexp groups capturing GEL function
|
- Regexp groups capturing GEL function
|
||||||
- Importers
|
- Importers
|
||||||
- New: RDF exporter (as extension)
|
- New: RDF exporter (as extension)
|
||||||
- CSV and TSV importers: added support for ignoring quotation marks
|
- New: Json importer
|
||||||
- Added support for creating a project by pointing to a data file URL.
|
- CSV and TSV importers: added support for ignoring quotation marks
|
||||||
- Text facet's choice count limit is now configurable through preference page
|
- Added support for creating a project by pointing to a data file URL.
|
||||||
- Select All and Unselect All buttons in History Extract dialog
|
- Text facet's choice count limit is now configurable through preference page
|
||||||
- Schema skeleton: support for multiple cells per cell-as nodes, and for conditional links
|
- Select All and Unselect All buttons in History Extract dialog
|
||||||
|
- Schema skeleton: support for multiple cells per cell-as nodes, and for conditional links
|
||||||
Fixes:
|
|
||||||
- TSV/CSV exporter bug: Gridworks crashed when there were empty cells.
|
Fixes:
|
||||||
- Issue 29: Delievered "Collapse whitespace" transformation does not work
|
- TSV/CSV exporter bug: Gridworks crashed when there were empty cells.
|
||||||
- Issue 69: ControlFunctionRegistry now correctly registers Chomp expression as "chomp" key.
|
- Issue 29: Delievered "Collapse whitespace" transformation does not work
|
||||||
- Issue 66: Records not excluded with inverted text facet
|
- Issue 69: ControlFunctionRegistry now correctly registers Chomp expression as "chomp" key.
|
||||||
- Issue 86: Parse cells after splitting columns
|
- Issue 66: Records not excluded with inverted text facet
|
||||||
- Issue 99: Diff for dates fails with "unknown error" always
|
- Issue 86: Parse cells after splitting columns
|
||||||
- Issue 110: Import of single column text file with Postal Codes shows only 1 row with lots of <20> chars (?)
|
- Issue 99: Diff for dates fails with "unknown error" always
|
||||||
- Issue 113: Export filtered rows as tsv or csv fails; html and excel OK
|
- Issue 110: Import of single column text file with Postal Codes shows only 1 row with lots of <20> chars (?)
|
||||||
- Issue 116: CSV/TSV export data includes blank fields for deleted columns
|
- Issue 113: Export filtered rows as tsv or csv fails; html and excel OK
|
||||||
- Issue 121: Importing attached file strips backslashes
|
- Issue 116: CSV/TSV export data includes blank fields for deleted columns
|
||||||
- Issue 122: Exporting to Excel on attached project raises server exception
|
- Issue 121: Importing attached file strips backslashes
|
||||||
- Issue 126: Large integers formatted in scientific notation in formulas
|
- Issue 122: Exporting to Excel on attached project raises server exception
|
||||||
- Issue 135: Hangs when setting cell value to large JSON string
|
- Issue 126: Large integers formatted in scientific notation in formulas
|
||||||
- Issue 138: Numbers should be right-justified
|
- Issue 135: Hangs when setting cell value to large JSON string
|
||||||
- Issue 146: In "Cluster and Edit Column", clicking on entry value to set "Merge?" checkbox does not reflect the final value of operation
|
- Issue 138: Numbers should be right-justified
|
||||||
|
- Issue 146: In "Cluster and Edit Column", clicking on entry value to set "Merge?" checkbox does not reflect the final value of operation
|
||||||
1.1 Release (May 27, 2010)
|
|
||||||
|
1.1 Release (May 27, 2010)
|
||||||
Features:
|
|
||||||
- Row/record sorting (Issue 32)
|
Features:
|
||||||
- CSV exporter (Issue 59)
|
- Row/record sorting (Issue 32)
|
||||||
- Mqlwrite exporter
|
- CSV exporter (Issue 59)
|
||||||
- Templating exporter (experimental)
|
- Mqlwrite exporter
|
||||||
|
- Templating exporter (experimental)
|
||||||
Fixes:
|
|
||||||
- Issue 34: "Behavior of Text Filter is unpredictable when "regular expression" mode is enabled."
|
Fixes:
|
||||||
Regex was not compiled with case insensitivity flag.
|
- Issue 34: "Behavior of Text Filter is unpredictable when "regular expression" mode is enabled."
|
||||||
- Issue 4: "Match All bug with ZIP code". Numeric values in cells were not stringified first
|
Regex was not compiled with case insensitivity flag.
|
||||||
before comparison.
|
- Issue 4: "Match All bug with ZIP code". Numeric values in cells were not stringified first
|
||||||
- Issue 41: "Envelope quotation marks are removed by CSV importer"
|
before comparison.
|
||||||
- Issue 19: "CSV import is too basic"
|
- Issue 41: "Envelope quotation marks are removed by CSV importer"
|
||||||
- Issue 15: "Ability to rename projects"
|
- Issue 19: "CSV import is too basic"
|
||||||
- Issue 16: "Column name collision when adding data from Freebase"
|
- Issue 15: "Ability to rename projects"
|
||||||
- Issue 28: "mql-like preview is not properly unquoting numbers"
|
- Issue 16: "Column name collision when adding data from Freebase"
|
||||||
- Issue 45: "Renaming Cells with Ctrl-Enter produced ERROR"
|
- Issue 28: "mql-like preview is not properly unquoting numbers"
|
||||||
Tentative fix for a concurrent bug.
|
- Issue 45: "Renaming Cells with Ctrl-Enter produced ERROR"
|
||||||
- Issue 46: "Array literals in GEL"
|
Tentative fix for a concurrent bug.
|
||||||
- Issue 55: "Use stable sorting for text facets sorted by count"
|
- Issue 46: "Array literals in GEL"
|
||||||
- Issue 53: "Moving the cursor inside the Text Filter box by clicking"
|
- Issue 55: "Use stable sorting for text facets sorted by count"
|
||||||
- Issue 58: "Meta facet"
|
- Issue 53: "Moving the cursor inside the Text Filter box by clicking"
|
||||||
Supported by the function facetCount()
|
- Issue 58: "Meta facet"
|
||||||
- Issue 14: "Limiting Freebase load to starred records"
|
Supported by the function facetCount()
|
||||||
We load whatever rows that are filtered through, not particularly starred rows.
|
- Issue 14: "Limiting Freebase load to starred records"
|
||||||
- Issue 49: "Add Edit Cells / Set Null"
|
We load whatever rows that are filtered through, not particularly starred rows.
|
||||||
- Issue 30: "Transform dialog should remember preferred language."
|
- Issue 49: "Add Edit Cells / Set Null"
|
||||||
- Issue 62: "It'd be nice if URIs were hyperlinked in the data cells"
|
- Issue 30: "Transform dialog should remember preferred language."
|
||||||
|
- Issue 62: "It'd be nice if URIs were hyperlinked in the data cells"
|
||||||
Other Changes:
|
|
||||||
- Moved unit tests from JUnit to TestNG
|
Other Changes:
|
||||||
|
- Moved unit tests from JUnit to TestNG
|
||||||
|
|
||||||
1.0.1 Release (May 12, 2010)
|
|
||||||
|
1.0.1 Release (May 12, 2010)
|
||||||
Fixes:
|
|
||||||
- Issue 2: "Undo History bug" - bulk row starring and flagging operations could not be undone.
|
Fixes:
|
||||||
- Issue 5: "Localized Windows cause save problems for Gridworks" -
|
- Issue 2: "Undo History bug" - bulk row starring and flagging operations could not be undone.
|
||||||
Windows user IDs that contain unicode characters were not retrieved correctly.
|
- Issue 5: "Localized Windows cause save problems for Gridworks" -
|
||||||
- Issue 10: "OAuth fails on sign in" - due to clock offset.
|
Windows user IDs that contain unicode characters were not retrieved correctly.
|
||||||
- Issue 11: "missing "lang" attribute in MQL generated in schema alignment"
|
- Issue 10: "OAuth fails on sign in" - due to clock offset.
|
||||||
- Issue 13: "float rejected from sandbox upload as Json object" - everything was sent as a string.
|
- Issue 11: "missing "lang" attribute in MQL generated in schema alignment"
|
||||||
- Issue 17: "Conflated triples - all rows are producing triple with "s" :" $Name_0"" -
|
- Issue 13: "float rejected from sandbox upload as Json object" - everything was sent as a string.
|
||||||
The Create A New Topic for Each Cell command created shared recon objects.
|
- Issue 17: "Conflated triples - all rows are producing triple with "s" :" $Name_0"" -
|
||||||
- Issue 18: "Error converting russian characters during edit of single cell"
|
The Create A New Topic for Each Cell command created shared recon objects.
|
||||||
- [partial fix] Issue 19: "CSV import is too basic" - fixed for CSV, not for TSV
|
- Issue 18: "Error converting russian characters during edit of single cell"
|
||||||
|
- [partial fix] Issue 19: "CSV import is too basic" - fixed for CSV, not for TSV
|
||||||
1.0 Release (May 10, 2010)
|
|
||||||
|
1.0 Release (May 10, 2010)
|
||||||
First Public Release
|
|
||||||
|
First Public Release
|
||||||
|
|
||||||
|
|||||||
@ -16,7 +16,7 @@ import com.google.refine.importers.parsers.TreeParser;
|
|||||||
import com.google.refine.model.Project;
|
import com.google.refine.model.Project;
|
||||||
|
|
||||||
public class JsonImporter implements StreamImporter{
|
public class JsonImporter implements StreamImporter{
|
||||||
final static Logger logger = LoggerFactory.getLogger("XmlImporter");
|
final static Logger logger = LoggerFactory.getLogger("JsonImporter");
|
||||||
|
|
||||||
public static final int BUFFER_SIZE = 64 * 1024;
|
public static final int BUFFER_SIZE = 64 * 1024;
|
||||||
|
|
||||||
|
|||||||
Loading…
Reference in New Issue
Block a user