You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yuan Dong (Jira)" <ji...@apache.org> on 2025/07/19 08:42:00 UTC
[jira] [Updated] (SPARK-52879) [spark-connect-go] Error with conversion to arrow while using CreateDataFrame
[ https://issues.apache.org/jira/browse/SPARK-52879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuan Dong updated SPARK-52879:
------------------------------
Description:
Hi,
When I try to convert a struct in go to a DataFrame, I found that the time.Time type only supports conversion to microsecond timestamp type
I encountered the following error
{code:java}
[UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(MILLISECOND, UTC). SQLSTATE: 0A000.
[UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(SECOND, UTC). SQLSTATE: 0A000.
[UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(NANOSECOND, UTC). SQLSTATE: 0A000.{code}
was:
Hi,
When I try to convert a struct in go to a DataFrame, I found that the time.Time type only supports conversion to microsecond timestamp type
I encountered the following error
{code:java}
[UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(MILLISECOND, UTC). SQLSTATE: 0A000.
[UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(SECOND, UTC). SQLSTATE: 0A000.
[UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(NANOSECOND, UTC). SQLSTATE: 0A000.{code}
> [spark-connect-go] Error with conversion to arrow while using CreateDataFrame
> -----------------------------------------------------------------------------
>
> Key: SPARK-52879
> URL: https://issues.apache.org/jira/browse/SPARK-52879
> Project: Spark
> Issue Type: Bug
> Components: Connect
> Affects Versions: 4.0.0
> Reporter: Yuan Dong
> Priority: Major
>
> Hi,
> When I try to convert a struct in go to a DataFrame, I found that the time.Time type only supports conversion to microsecond timestamp type
> I encountered the following error
> {code:java}
> [UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(MILLISECOND, UTC). SQLSTATE: 0A000.
> [UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(SECOND, UTC). SQLSTATE: 0A000.
> [UNSUPPORTED_ARROWTYPE] Unsupported arrow type Timestamp(NANOSECOND, UTC). SQLSTATE: 0A000.{code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org