You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Francisco Guerrero (Jira)" <ji...@apache.org> on 2023/12/21 19:42:00 UTC
[jira] [Updated] (CASSANDRA-19223) [Analytics] Column type mapping error for timestamp type during bulk writes
[ https://issues.apache.org/jira/browse/CASSANDRA-19223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Francisco Guerrero updated CASSANDRA-19223:
-------------------------------------------
Bug Category: Parent values: Correctness(12982)Level 1 values: Consistency(12989)
Complexity: Normal
Discovered By: User Report
Fix Version/s: NA
Severity: Normal
Status: Open (was: Triage Needed)
> [Analytics] Column type mapping error for timestamp type during bulk writes
> ---------------------------------------------------------------------------
>
> Key: CASSANDRA-19223
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19223
> Project: Cassandra
> Issue Type: Bug
> Components: Analytics Library
> Reporter: Francisco Guerrero
> Assignee: Francisco Guerrero
> Priority: Normal
> Fix For: NA
>
>
> When doing bulk reads with the analytics library, a user can specify the last modified column as an option. Bulk reader will add a column with the last modified column to the data frame. If a user wants to use the bulk-read data frame to persist data, and using the {{WriterOptions.TIMESTAMP}} feature from the last modified column from the bulk-read data frame, the bulk write will fail with a data type mapping error.
> {code:java}
> Caused by: java.lang.RuntimeException: Unsupported conversion for LONG from java.sql.Timestamp
> at org.apache.cassandra.spark.bulkwriter.SqlToCqlTypeConverter$LongConverter.convertInternal(SqlToCqlTypeConverter.java:245)
> at org.apache.cassandra.spark.bulkwriter.SqlToCqlTypeConverter$LongConverter.convertInternal(SqlToCqlTypeConverter.java:231)
> at org.apache.cassandra.spark.bulkwriter.SqlToCqlTypeConverter$Converter.convert(SqlToCqlTypeConverter.java:203)
> at org.apache.cassandra.spark.bulkwriter.SqlToCqlTypeConverter$NullableConverter.convert(SqlToCqlTypeConverter.java:212)
> at org.apache.cassandra.spark.bulkwriter.TableSchema.normalize(TableSchema.java:91)
> at org.apache.spark.api.java.JavaPairRDD$.$anonfun$toScalaFunction$1(JavaPairRDD.scala:1070)
> at scala.collection.Iterator$$anon$10.next(Iterator.scala:461)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org