You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 23:52:47 UTC

[GitHub] [beam] kennknowles opened a new issue, #19392: EmbeddedMetastoreService fails executing inserts

kennknowles opened a new issue, #19392:
URL: https://github.com/apache/beam/issues/19392

   I am reusing an `EmbeddedMetastoreService` form hcatalog tests artifact for my own unit testing of Hive dependent code. When I am trying to insert values into the table via `executeQuery(..)` I see exception in logs
   ```
   
   java.lang.ClassCastException: org.apache.hadoop.hive.ql.optimizer.calcite.HiveTypeSystemImpl cannot
   be cast to org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.rel.type.RelDataTypeSystem
   at
   org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.jdbc.CalciteConnectionImpl.<init>(CalciteConnectionImpl.java:125)
   at
   org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.jdbc.CalciteJdbc41Factory$CalciteJdbc41Connection.<init>(CalciteJdbc41Factory.java:115)
   at
   org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:59)
   at
   org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.jdbc.CalciteJdbc41Factory.newConnection(CalciteJdbc41Factory.java:44)
   at
   org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.jdbc.CalciteFactory.newConnection(CalciteFactory.java:53)
   at
   org.apache.beam.repackaged.beam_sdks_java_extensions_sql.org.apache.calcite.avatica.UnregisteredDriver.connect(UnregisteredDriver.java:138)
   at
   java.sql.DriverManager.getConnection(DriverManager.java:664)
   at java.sql.DriverManager.getConnection(DriverManager.java:208)
   at
   org.apache.calcite.tools.Frameworks.withPrepare(Frameworks.java:140)
   at org.apache.calcite.tools.Frameworks.withPlanner(Frameworks.java:105)
   at
   org.apache.hadoop.hive.ql.parse.CalcitePlanner.getOptimizedAST(CalcitePlanner.java:609)
   at org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:246)
   at
   org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10133)
   at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:209)
   at
   org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227)
   at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
   ...
   ```
   
   I realise this component is not an API but wanted to ask / point this out. Internally, hcatalog test code is inserting data via DataTransferFactory and not via executeQuery(). 
   
   Could this exception be fixed somehow?
   
   Imported from Jira [BEAM-7057](https://issues.apache.org/jira/browse/BEAM-7057). Original Jira may contain additional context.
   Reported by: JozoVilcek.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] kennknowles commented on issue #19392: EmbeddedMetastoreService fails executing inserts

Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #19392:
URL: https://github.com/apache/beam/issues/19392#issuecomment-1167609238

   I don't have any context on it so I will trust your assessment. If someone else encounters it they could reopen or file a new bug.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] kennknowles closed issue #19392: EmbeddedMetastoreService fails executing inserts

Posted by GitBox <gi...@apache.org>.
kennknowles closed issue #19392: EmbeddedMetastoreService fails executing inserts
URL: https://github.com/apache/beam/issues/19392


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] JozoVilcek commented on issue #19392: EmbeddedMetastoreService fails executing inserts

Posted by GitBox <gi...@apache.org>.
JozoVilcek commented on issue #19392:
URL: https://github.com/apache/beam/issues/19392#issuecomment-1166961655

   I believe this is fixed in recent Beam version.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org