You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Stefania (JIRA)" <ji...@apache.org> on 2015/11/19 10:01:11 UTC

[jira] [Commented] (CASSANDRA-9303) Match cassandra-loader options in COPY FROM

    [ https://issues.apache.org/jira/browse/CASSANDRA-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013182#comment-15013182 ] 

Stefania commented on CASSANDRA-9303:
-------------------------------------

Here is the current status. I will regularly edit the following tables to reflect the progress:

h3. Importing

||cassandra-loader||COPY FROM||description||status||
|-configFile filename| |File with configuration options|TODO|
|-delim delimiter|delimiter|Delimiter to use|already available|
|-dateFormat dateFormatString|dtformats|Date format|TODO but we can parse all valid CQL time formats|
|-nullString nullString|nullval|String that signifies NULL|already available|
|-skipRows skipRows| |Number of rows to skip|TODO|
|-skipCols columnsToSkip|column|Comma-separated list of columsn to skip|already available, they can specify which columns in the cmd syntax|
|-maxRows maxRows| |Maximum number of rows to read (-1 means all)|TODO|
|-maxErrors maxErrors| |Maximum parse errors to endure|TODO|
|-badDir badDirectory| |Directory for where to place badly parsed rows.|TODO|
|-port portNumber| |CQL Port Number|TODO|
|-user username| |Cassandra username|TODO|
|-pw password| |Password for user|TODO|
|-ssl-truststore-path path| |Path to SSL truststore|TODO|
|-ssl-truststore-pw pwd| |Password for SSL truststore|TODO|
|-ssl-keystore-path path| |Path to SSL keystore|TODO|
|-ssl-keystore-pw pwd| |Password for SSL keystore|TODO|
|-consistencyLevel CL| |Consistency level|TODO|
|-numFutures numFutures|jobs|Number of CQL futures to keep in flight|already available|
|-batchSize batchSize|minbatchsize, maxbatchsize|Number of INSERTs to batch together|alredy available|
|-decimalDelim decimalDelim| |Decimal delimiter|TODO|
|-boolStyle boolStyleString| |Style for booleans|TODO|
|-numThreads numThreads| |Number of concurrent threads (files) to load|TODO (numProcesses)|
|-queryTimeout # seconds|pageTimeout|Query timeout (in seconds)|already available|
|-numRetries numRetries|maxattempts|Number of times to retry the INSERT|already available|
|-maxInsertErrors # errors| |Maximum INSERT errors to endure|TODO|
|-rate rows-per-second| |Maximum insert rate|TODO (unsure how)|
|-progressRate num txns|reportfrequency|How often to report the insert rate|already available|
|-rateFile filename| |Where to print the rate statistics|TODO|
|-successDir dir| |Directory where to move successfully loaded files|TODO|
|-failureDir dir| |Directory where to move files that did not successfully load|TODO|


h3. Exporting

||cassandra-unloader||COPY TO||description||status||
|configFile filename| |File with configuration options|TODO|
|-delim delimiter|delimiter|Delimiter to use|TODO|
|-dateFormat dateFormatString|dtformats|Date format|already available|
|-nullString nullString|nullval|String that signifies NULL|already available|
|-port portNumber| |CQL Port Number|TODO|
|-user username| |Cassandra username|TODO|
|-pw password| |Password for user|TODO|
|-ssl-truststore-path path| |Path to SSL truststore|TODO|
|-ssl-truststore-pw pwd| |Password for SSL truststore|TODO|
|-ssl-keystore-path path| |Path to SSL keystore|TODO|
|-ssl-keystore-pw pwd| |Password for SSL keystore|TODO|
|consistencyLevel CL| |Consistency level|TODO|
|decimalDelim decimalDelim| |Decimal delimiter|TODO|
|boolStyle boolStyleString| |Style for booleans|TODO|
|numThreads numThreads| |Number of concurrent threads to unload|TODO (numProcesses)|
|beginToken tokenString| |Begin token|TODO|
|endToken tokenString| |End token|TODO|

> Match cassandra-loader options in COPY FROM
> -------------------------------------------
>
>                 Key: CASSANDRA-9303
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-9303
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Tools
>            Reporter: Jonathan Ellis
>            Assignee: Stefania
>            Priority: Critical
>             Fix For: 2.1.x
>
>
> https://github.com/brianmhess/cassandra-loader added a bunch of options to handle real world requirements, we should match those.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)