You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2023/01/05 04:57:39 UTC

[GitHub] [incubator-seatunnel] lucas666666 opened a new issue, #3869: The maxcompute source does not support the conversion of date type

lucas666666 opened a new issue, #3869:
URL: https://github.com/apache/incubator-seatunnel/issues/3869

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   The maxcompute source does not support the conversion of date type ,when batch job running 。
   
   
   ### SeaTunnel Version
   
   v2.3.0
   
   ### SeaTunnel Config
   
   ```conf
   env {
     spark.app.name = "seatunnel"
     spark.executor.instances = 2
     spark.executor.cores = 1
     spark.executor.memory = "1g"
     // 这个配置必需填写
      #spark.sql.catalogImplementation = "hive"
   }
   source {
     Maxcompute {
       accessId="accessId"
       accesskey="accesskey"
       endpoint="http://service.cn-shanghai.maxcompute.aliyun.com/api"
       project="noah_ods"
       table_name="bak_go_goal_new_t_index_info"
       #partition_spec="<your partition spec>"
       #split_row = 10000
     }
   }
   
   
   sink {
     Console {}
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/start-seatunnel-spark-connector-v2.sh --config config/maxcompute2rds1.conf -e client -m 'local[2]'
   ```
   
   
   ### Error Exception
   
   ```log
   "ERROR ParallelBatchPartitionReader: BatchPartitionReader execute failed.
   org.apache.seatunnel.connectors.seatunnel.maxcompute.exception.MaxcomputeConnectorException: ErrorCode:[COMMON-12], ErrorDescription:[Source reader operation failed, such as (open, close) etc...] - java.lang.ClassCastException: java.util.Date cannot be cast to java.lang.Long
     at org.apache.seatunnel.connectors.seatunnel.maxcompute.util.MaxcomputeTypeMapper.resolveObject(MaxcomputeTypeMapper.java:285)"
   ```
   
   
   ### Flink or Spark Version
   
    spark-2.4.8
   
   ### Java or Scala Version
   
   scala-2.13.10
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #3869: The maxcompute source does not support the conversion of date type

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #3869: The maxcompute source does not support the conversion of date type
URL: https://github.com/apache/incubator-seatunnel/issues/3869


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] sunnyzhu92 commented on issue #3869: The maxcompute source does not support the conversion of date type

Posted by GitBox <gi...@apache.org>.
sunnyzhu92 commented on issue #3869:
URL: https://github.com/apache/incubator-seatunnel/issues/3869#issuecomment-1372022487

   can you assign it to me? thanks a lot


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3869: The maxcompute source does not support the conversion of date type

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3869:
URL: https://github.com/apache/incubator-seatunnel/issues/3869#issuecomment-1449131092

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3869: The maxcompute source does not support the conversion of date type

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #3869:
URL: https://github.com/apache/incubator-seatunnel/issues/3869#issuecomment-1437698103

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] lucas666666 commented on issue #3869: The maxcompute source does not support the conversion of date type

Posted by GitBox <gi...@apache.org>.
lucas666666 commented on issue #3869:
URL: https://github.com/apache/incubator-seatunnel/issues/3869#issuecomment-1371793424

   maxcompute 2.0 date type , You can view this connection .
   https://help.aliyun.com/document_detail/159541.html
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] maruko-code commented on issue #3869: The maxcompute source does not support the conversion of date type

Posted by "maruko-code (via GitHub)" <gi...@apache.org>.
maruko-code commented on issue #3869:
URL: https://github.com/apache/incubator-seatunnel/issues/3869#issuecomment-1399197028

   I want to try this 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org