You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Wentao-Zhao (via GitHub)" <gi...@apache.org> on 2025/12/31 02:39:10 UTC

[I] [Bug] org.apache.doris.shaded.org.apache.arrow.vector.VectorSchemaRoot#getFieldVectors中获取到了__DORIS_DELETE_SIGN__, 导致字段数量比较异常 [doris-spark-connector]

Wentao-Zhao opened a new issue, #349:
URL: https://github.com/apache/doris-spark-connector/issues/349

   ### Search before asking
   
   - [x] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Version
   
   spark: 3.1.4
   doris: doris-2.0.2.1-b387ac2
   connector: spark-doris-connector-spark-3.1, version: 25.1.0
   
   ### What's Wrong?
   
   org.apache.doris.spark.client.read.RowBatch#readBatch 
   this.fieldVectors contains  __DORIS_DELETE_SIGN__
   
   
   ### What You Expected?
   
   spark read doris table, compare field size need filter invisible_col
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [I] [Bug] org.apache.doris.shaded.org.apache.arrow.vector.VectorSchemaRoot#getFieldVectors中获取到了__DORIS_DELETE_SIGN__, 导致字段数量比较异常 [doris-spark-connector]

Posted by "dingyufei615 (via GitHub)" <gi...@apache.org>.
dingyufei615 commented on issue #349:
URL: https://github.com/apache/doris-spark-connector/issues/349#issuecomment-3816810563

   I encountered the same problem, and I submitted a fix PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [I] [Bug] org.apache.doris.shaded.org.apache.arrow.vector.VectorSchemaRoot#getFieldVectors中获取到了__DORIS_DELETE_SIGN__, 导致字段数量比较异常 [doris-spark-connector]

Posted by "JNSimba (via GitHub)" <gi...@apache.org>.
JNSimba commented on issue #349:
URL: https://github.com/apache/doris-spark-connector/issues/349#issuecomment-3844937012

   How about trying the latest version 2.0?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [I] [Bug] org.apache.doris.shaded.org.apache.arrow.vector.VectorSchemaRoot#getFieldVectors中获取到了__DORIS_DELETE_SIGN__, 导致字段数量比较异常 [doris-spark-connector]

Posted by "dingyufei615 (via GitHub)" <gi...@apache.org>.
dingyufei615 commented on issue #349:
URL: https://github.com/apache/doris-spark-connector/issues/349#issuecomment-3816877721

   I'm also using the latest version of Doris 4.0, and I also need to be compatible with Doris 2.0.x. I upgraded the spark-doris-connector and encountered the same problem. Reading and writing to Doris 4.0 is normal, but I encountered problems when reading and writing to Doris 2.0.x.
   
   ```
   org.apache.doris.spark.exception.DorisException: Load Doris data failed, schema size of fetch data is wrong.
   at org.apache.doris.spark.client.read.RowBatch.<init> (RowBatch.java:123)
   ```
   After repair and verification https://github.com/apache/doris-spark-connector/pull/351   it is now running normally.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org