[jira] [Updated] (SPARK-24546) InsertIntoDataSourceCommand make dataframe with wrong schema

["yangz (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-24546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

yangz updated SPARK-24546:
--------------------------
    Description: 
I have a hdfs table with schema 
{code:java}
hdfs_table(a int, b int, c int){code}
 

and a kudu table with schema

 
{code:java}
kudu_table(b int primary key, a int,c int)
{code}
 

When I have a sql insert, I got data misorder.
{code:java}
insert into kudu_table from hdfs_table
{code}
The reason to cause the problem is create data frame with wrong schema

  was:
I have a hdfs table with schema 
{code:java}
hdfs_table(a int, b int, c int){code}
 

and a kudu table with schema

 
{code:java}
kudu_table(b int primary key, a int,c int)
{code}
 

When I have a sql such as
{code:java}
insert into kudu_table from hdfs_table{code}


> InsertIntoDataSourceCommand make dataframe with wrong schema
> ------------------------------------------------------------
>
>                 Key: SPARK-24546
>                 URL: https://issues.apache.org/jira/browse/SPARK-24546
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.2.1, 2.3.0, 2.3.1, 3.0.0
>            Reporter: yangz
>            Priority: Major
>
> I have a hdfs table with schema 
> {code:java}
> hdfs_table(a int, b int, c int){code}
>  
> and a kudu table with schema
>  
> {code:java}
> kudu_table(b int primary key, a int,c int)
> {code}
>  
> When I have a sql insert, I got data misorder.
> {code:java}
> insert into kudu_table from hdfs_table
> {code}
> The reason to cause the problem is create data frame with wrong schema



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org