You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@shardingsphere.apache.org by GitBox <gi...@apache.org> on 2022/09/26 09:35:30 UTC

[GitHub] [shardingsphere] FlyingZC opened a new issue, #21198: Execution of federation report exception in transaction

FlyingZC opened a new issue, #21198:
URL: https://github.com/apache/shardingsphere/issues/21198

   ## Bug Report
   
   ### Which version of ShardingSphere did you use?
   master
   
   ### Which project did you use? ShardingSphere-JDBC or ShardingSphere-Proxy?
   proxy
   
   ### Expected behavior
   Execute query normally in a transaction.
   
   ### Actual behavior
   Throw an exception,`relation "t_order_0" does not exist on gaussdb`.
   
   ### Reason analyze (If you can)
   
   ### Steps to reproduce the behavior, such as: SQL to execute, sharding rule configuration, when exception occur etc.
   execute sqls:
   ```sql
   begin;
   
   -- error occured
   select t_order.*, t_order_item.* from t_order,t_order_item 
   where t_order.order_id = t_order_item.item_id;
   ```
   
   config files:
   ```yaml
   schemaName: sharding_db
   dataSources:
     ds_0:
       connectionTimeoutMilliseconds: 30000
       idleTimeoutMilliseconds: 60000
       maxLifetimeMilliseconds: 1800000
       maxPoolSize: 260
       minPoolSize: 1
       url: jdbc:opengauss://localhost:15432/postgres?batchMode=on
       username: gaussdb
       password: Sphere@123
     ds_1:
       connectionTimeoutMilliseconds: 30000
       idleTimeoutMilliseconds: 60000
       maxLifetimeMilliseconds: 1800000
       maxPoolSize: 260
       minPoolSize: 1
       url: jdbc:opengauss://localhost:15432/zc?batchMode=on
       username: gaussdb
       password: Sphere@123
   rules:
     - !SHARDING
       tables:
         t_order:
           actualDataNodes: ds_${0..1}.t_order_${0..1}
           tableStrategy:
             standard:
               shardingColumn: order_id
               shardingAlgorithmName: t_order_inline
           keyGenerateStrategy:
             column: order_id
             keyGeneratorName: snowflake
         t_order_item:
           actualDataNodes: ds_${0..1}.t_order_item_${0..1}
           tableStrategy:
             standard:
               shardingColumn: order_id
               shardingAlgorithmName: t_order_item_inline
           keyGenerateStrategy:
             column: order_item_id
             keyGeneratorName: snowflake
         account:
           actualDataNodes: ds_${0..1}.account_${0..1}
           databaseStrategy:
             standard:
               shardingColumn: id
               shardingAlgorithmName: database_id_inline
           tableStrategy:
             standard:
               shardingColumn: id
               shardingAlgorithmName: account_inline
           keyGenerateStrategy:
             column: id
             keyGeneratorName: snowflake
       defaultDatabaseStrategy:
         standard:
           shardingColumn: user_id
           shardingAlgorithmName: database_inline
       defaultTableStrategy:
         none:
       
       shardingAlgorithms:
         database_inline:
           type: INLINE
           props:
             algorithm-expression: ds_${user_id % 2}
         database_id_inline:
           type: INLINE
           props:
             algorithm-expression: ds_${id % 2}
         t_order_inline:
           type: INLINE
           props:
             algorithm-expression: t_order_${order_id % 2}
         t_order_item_inline:
           type: INLINE
           props:
             algorithm-expression: t_order_item_${order_id % 2}
         account_inline:
           type: INLINE
           props:
             algorithm-expression: account_${Math.floorMod(Math.floorDiv(id.longValue(), 2L), 2L)}
       
       keyGenerators:
         snowflake:
           type: SNOWFLAKE
   ```
   
   stacktrace:
   ```
   [INFO ] 2022-09-26 17:19:37.998 [Connection-1-ThreadExecutor] o.a.s.p.b.h.a.e.AbstractDatabaseMetadataExecutor$DefaultDatabaseMetadataExecutor - Actual SQL: ds_0 ::: select name, setting from pg_settings where name in ('connection_info')
   [ERROR] 2022-09-26 17:19:54.863 [Connection-1-ThreadExecutor] o.a.s.p.f.c.CommandExecutorTask - Exception occur: 
   org.opengauss.util.PSQLException: [127.0.0.1:50022/ocalhost/127.0.0.1:15432] ERROR: relation "t_order_0" does not exist on gaussdb
     位置:13
   	at org.opengauss.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2901)
   	at org.opengauss.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2630)
   	at org.opengauss.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:362)
   	at org.opengauss.jdbc.PgStatement.runQueryExecutor(PgStatement.java:562)
   	at org.opengauss.jdbc.PgStatement.executeInternal(PgStatement.java:539)
   	at org.opengauss.jdbc.PgStatement.execute(PgStatement.java:397)
   	at org.opengauss.jdbc.PgStatement.executeWithFlags(PgStatement.java:339)
   	at org.opengauss.jdbc.PgStatement.executeCachedSql(PgStatement.java:325)
   	at org.opengauss.jdbc.PgStatement.executeWithFlags(PgStatement.java:302)
   	at org.opengauss.jdbc.PgStatement.execute(PgStatement.java:298)
   	at org.opengauss.jdbc.PgStatement.execute(PgStatement.java:1458)
   	at com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:103)
   	at com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.executor.callback.impl.ProxyStatementExecutorCallback.execute(ProxyStatementExecutorCallback.java:41)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.executor.callback.ProxyJDBCExecutorCallback.executeSQL(ProxyJDBCExecutorCallback.java:74)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.executor.callback.ProxyJDBCExecutorCallback.executeSQL(ProxyJDBCExecutorCallback.java:67)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.executor.callback.ProxyJDBCExecutorCallback.executeSQL(ProxyJDBCExecutorCallback.java:44)
   	at org.apache.shardingsphere.infra.executor.sql.execute.engine.driver.jdbc.JDBCExecutorCallback.execute(JDBCExecutorCallback.java:95)
   	at org.apache.shardingsphere.infra.executor.sql.execute.engine.driver.jdbc.JDBCExecutorCallback.execute(JDBCExecutorCallback.java:75)
   	at org.apache.shardingsphere.infra.executor.kernel.ExecutorEngine.syncExecute(ExecutorEngine.java:135)
   	at org.apache.shardingsphere.infra.executor.kernel.ExecutorEngine.parallelExecute(ExecutorEngine.java:131)
   	at org.apache.shardingsphere.infra.executor.kernel.ExecutorEngine.execute(ExecutorEngine.java:116)
   	at org.apache.shardingsphere.infra.executor.sql.execute.engine.driver.jdbc.JDBCExecutor.execute(JDBCExecutor.java:65)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.executor.ProxyJDBCExecutor.execute(ProxyJDBCExecutor.java:74)
   	at org.apache.shardingsphere.proxy.backend.communication.ProxySQLExecutor.useDriverToExecute(ProxySQLExecutor.java:195)
   	at org.apache.shardingsphere.proxy.backend.communication.ProxySQLExecutor.execute(ProxySQLExecutor.java:153)
   	at org.apache.shardingsphere.proxy.backend.communication.ProxySQLExecutor.execute(ProxySQLExecutor.java:147)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.JDBCDatabaseCommunicationEngine.execute(JDBCDatabaseCommunicationEngine.java:130)
   	at org.apache.shardingsphere.proxy.frontend.opengauss.command.query.simple.OpenGaussComQueryExecutor.execute(OpenGaussComQueryExecutor.java:76)
   	at org.apache.shardingsphere.proxy.frontend.command.CommandExecutorTask.executeCommand(CommandExecutorTask.java:111)
   	at org.apache.shardingsphere.proxy.frontend.command.CommandExecutorTask.run(CommandExecutorTask.java:78)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:750)
   [INFO ] 2022-09-26 17:20:54.033 [HikariPool-1 connection adder] o.o.core.v3.ConnectionFactoryImpl - [33276754-bf09-41a7-a6c8-4fdf6444b585] Try to connect. IP: localhost:15432
   [INFO ] 2022-09-26 17:20:54.048 [HikariPool-1 connection adder] o.o.core.v3.ConnectionFactoryImpl - [127.0.0.1:50163/ocalhost/127.0.0.1:15432] Connection is established. ID: 33276754-bf09-41a7-a6c8-4fdf6444b585
   [INFO ] 2022-09-26 17:20:54.064 [HikariPool-1 connection adder] o.o.core.v3.ConnectionFactoryImpl - Connect complete. ID: 33276754-bf09-41a7-a6c8-4fdf6444b585
   [ERROR] 2022-09-26 17:21:18.348 [Connection-1-ThreadExecutor] o.a.s.p.f.c.CommandExecutorTask - Exception occur: 
   org.apache.calcite.runtime.CalciteContextException: At line 0, column 0: Object 't_order' not found
   	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
   	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
   	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
   	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
   	at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:505)
   	at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:932)
   	at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:917)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:5362)
   	at org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl(IdentifierNamespace.java:183)
   	at org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:188)
   	at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:89)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:1107)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:1078)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3381)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3360)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateJoin(SqlValidatorImpl.java:3485)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3369)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3697)
   	at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:64)
   	at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:89)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:1107)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:1078)
   	at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:248)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:1053)
   	at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:759)
   	at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:592)
   	at org.apache.shardingsphere.sqlfederation.optimizer.SQLOptimizeEngine.optimize(SQLOptimizeEngine.java:50)
   	at org.apache.shardingsphere.sqlfederation.advanced.AdvancedSQLFederationExecutor.execute(AdvancedSQLFederationExecutor.java:141)
   	at org.apache.shardingsphere.sqlfederation.advanced.AdvancedSQLFederationExecutor.executeQuery(AdvancedSQLFederationExecutor.java:110)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.JDBCDatabaseCommunicationEngine.doExecuteFederation(JDBCDatabaseCommunicationEngine.java:163)
   	at org.apache.shardingsphere.proxy.backend.communication.jdbc.JDBCDatabaseCommunicationEngine.execute(JDBCDatabaseCommunicationEngine.java:121)
   	at org.apache.shardingsphere.proxy.frontend.opengauss.command.query.simple.OpenGaussComQueryExecutor.execute(OpenGaussComQueryExecutor.java:76)
   	at org.apache.shardingsphere.proxy.frontend.command.CommandExecutorTask.executeCommand(CommandExecutorTask.java:111)
   	at org.apache.shardingsphere.proxy.frontend.command.CommandExecutorTask.run(CommandExecutorTask.java:78)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:750)
   Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Object 't_order' not found
   	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
   	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
   	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
   	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
   	at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:505)
   	at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:599)
   	... 32 common frames omitted
   ```
   
   ### Example codes for reproduce this issue (such as a github link).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [shardingsphere] strongduanmu commented on issue #21198: Execution of federation report exception in transaction

Posted by GitBox <gi...@apache.org>.
strongduanmu commented on issue #21198:
URL: https://github.com/apache/shardingsphere/issues/21198#issuecomment-1257864423

   @FlyingZC Thank you for your feedback, I will investigate this issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [shardingsphere] FlyingZC commented on issue #21198: Execution of federation report exception in transaction

Posted by GitBox <gi...@apache.org>.
FlyingZC commented on issue #21198:
URL: https://github.com/apache/shardingsphere/issues/21198#issuecomment-1257924938

   It's OK,maybe I have some problem in my configuration.
   <img width="965" alt="image" src="https://user-images.githubusercontent.com/19788130/192270983-ce412f8f-7594-428d-bde7-10ab200fc23e.png">
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [shardingsphere] FlyingZC closed issue #21198: Execution of federation report exception in transaction

Posted by GitBox <gi...@apache.org>.
FlyingZC closed issue #21198: Execution of federation report exception in transaction
URL: https://github.com/apache/shardingsphere/issues/21198


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [shardingsphere] strongduanmu commented on issue #21198: Execution of federation report exception in transaction

Posted by GitBox <gi...@apache.org>.
strongduanmu commented on issue #21198:
URL: https://github.com/apache/shardingsphere/issues/21198#issuecomment-1257908842

   I have test with following sql, but I can't reproduce this exception.
   
   ```sql
   CREATE TABLE t_order(order_id INT, user_id INT, status VARCHAR);
   
   INSERT INTO t_order(order_id, user_id, status) VALUES(1, 1, 'init'), (2, 2, 'init'), (3, 3, 'init');
   
   CREATE TABLE t_order_item(item_id INT, order_id INT, user_id INT, status VARCHAR);
   
   INSERT INTO t_order_item(item_id, order_id, user_id, status) VALUES(1, 1, 1, 'init'), (2, 2, 2, 'init'), (3, 3, 3, 'init');
   
   select t_order.*, t_order_item.* from t_order,t_order_item 
   where t_order.order_id = t_order_item.item_id;
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@shardingsphere.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org