You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/04/11 13:46:00 UTC
[jira] [Commented] (YARN-11810) Fix SQL script in SQLServer/FederationStateStoreTables.sql
[ https://issues.apache.org/jira/browse/YARN-11810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17943565#comment-17943565 ]
ASF GitHub Bot commented on YARN-11810:
---------------------------------------
p-szucs opened a new pull request, #7605:
URL: https://github.com/apache/hadoop/pull/7605
Change-Id: I5b2a4f6436b1d55984f0420321a62b6d0b4b087b
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g., 'HADOOP-17799. Your PR title ...'.
-->
### Description of PR
The SQLServer/FederationStateStoreTables.sql script contains duplicated create statements and SQL syntax errors which makes TestFederationSQLServerScriptAccuracy#checkSqlServerScriptAccuracy unit test fail. Details can be found in [YARN-11810](https://issues.apache.org/jira/browse/YARN-11810).
### How was this patch tested?
Unit tests
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
> Fix SQL script in SQLServer/FederationStateStoreTables.sql
> ----------------------------------------------------------
>
> Key: YARN-11810
> URL: https://issues.apache.org/jira/browse/YARN-11810
> Project: Hadoop YARN
> Issue Type: Bug
> Components: federation
> Affects Versions: 3.4.1
> Reporter: Peter Szucs
> Assignee: Peter Szucs
> Priority: Major
>
> The SQLServer/FederationStateStoreTables.sql script contains duplicated create statements and SQL syntax errors which makes _TestFederationSQLServerScriptAccuracy#checkSqlServerScriptAccuracy_ unit test fail.
>
> I see 2 issues which cause this test failure:
> # *Duplicated create statements*
> ** the test creates a SQLServerFederationStateStore class, which extracts and stores the "CREATE TABLE" statements from FederationStateStoreTables.sql with the [extractCreateTableSQL method|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/server/federation/store/impl/SQLServerFederationStateStore.java#L43].
> ** then iterates through the collected statements and executes them as a prepared statement [here|https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/test/java/org/apache/hadoop/yarn/server/federation/store/sql/TestFederationSQLServerScriptAccuracy.java#L53]
> ** the create statements for _masterKeys_ and _delegationTokens_ tables are duplicated in the script, so these will be collected and attempted to be executed twice, which results in the following error during the test runs:
> {code:java}
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0.991 s <<< FAILURE! - in org.apache.hadoop.yarn.server.federation.store.sql.TestFederationSQLServerScriptAccuracy
> [ERROR] checkSqlServerScriptAccuracy(org.apache.hadoop.yarn.server.federation.store.sql.TestFederationSQLServerScriptAccuracy) Time elapsed: 0.91 s <<< ERROR!
> java.sql.SQLSyntaxErrorException:
> object name already exists: MASTERKEYS in statement [CREATE TABLE masterKeys(
> keyId BIGINT NOT NULL,
> masterKey VARCHAR(1024) NOT NULL,
> CONSTRAINT pk_keyId PRIMARY KEY
> (
> keyId
> )
> )]
> at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
> at org.hsqldb.jdbc.JDBCUtil.sqlException(Unknown Source)
> at org.hsqldb.jdbc.JDBCPreparedStatement.fetchResult(Unknown Source)
> at org.hsqldb.jdbc.JDBCPreparedStatement.execute(Unknown Source)
> at com.zaxxer.hikari.pool.ProxyPreparedStatement.execute(ProxyPreparedStatement.java:44){code}
>
> # *Syntax errors in the SQL script*
> ** the create statements for _sequenceTable_ and versions are missing a comma before the constraints are defined here:
> {code:java}
> CREATE TABLE [dbo].[sequenceTable](
> sequenceName VARCHAR(255) NOT NULL,
> nextVal bigint NOT NULL
> CONSTRAINT [pk_sequenceName] PRIMARY KEY
> (
> [sequenceName]
> )
> ){code}
> and here:
> {code:java}
> CREATE TABLE [dbo].[versions](
> fedVersion VARBINARY(1024) NOT NULL,
> versionComment VARCHAR(255) NOT NULL
> CONSTRAINT [pk_fedVersion] PRIMARY KEY
> (
> [fedVersion]
> )
> ){code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org