You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "puchengy (via GitHub)" <gi...@apache.org> on 2023/07/06 18:58:41 UTC

[GitHub] [iceberg] puchengy opened a new issue, #8004: Can not parse sort order when there are more than one sql extensions specified

puchengy opened a new issue, #8004:
URL: https://github.com/apache/iceberg/issues/8004

   ### Apache Iceberg version
   
   1.3.0 (latest release)
   
   ### Query engine
   
   Spark
   
   ### Please describe the bug 🐞
   
   running data file rewrite with sort option and encountered 
   ```
   java.lang.IllegalStateException: Cannot parse order: parser is not an Iceberg ExtendedParser
   	at org.apache.iceberg.spark.ExtendedParser.parseSortOrder(ExtendedParser.java:64)
   	at org.apache.iceberg.spark.procedures.RewriteDataFilesProcedure.checkAndApplyStrategy(RewriteDataFilesProcedure.java:160)
   	at org.apache.iceberg.spark.procedures.RewriteDataFilesProcedure.lambda$call$0(RewriteDataFilesProcedure.java:111)
   	at org.apache.iceberg.spark.procedures.BaseProcedure.execute(BaseProcedure.java:100)
   	at org.apache.iceberg.spark.procedures.BaseProcedure.modifyIcebergTable(BaseProcedure.java:81)
   	at org.apache.iceberg.spark.procedures.RewriteDataFilesProcedure.call(RewriteDataFilesProcedure.java:100)
   ```
   
   This is due to there are more than one sql extensions specified ```
   spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions,x.y.secondExtensions
   ```
   
   Line that broke
   https://github.com/apache/iceberg/blob/1f1ec4be478feae79b04bcea3e9a8556d8076054/spark/v3.2/spark/src/main/java/org/apache/iceberg/spark/ExtendedParser.java#L55


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Can not parse sort order when there are more than one sql extensions specified and iceberg extension is not placed at the right most position [iceberg]

Posted by "ajantha-bhat (via GitHub)" <gi...@apache.org>.
ajantha-bhat commented on issue #8004:
URL: https://github.com/apache/iceberg/issues/8004#issuecomment-2094841965

   Yeah, this problem is only for sort order parsing of REWRITE call procedure because Iceberg uses some custom parsing code to parse sort order as of now. 
   
   From spark, parser from rightmost position extension will be the main parser. if it fails to parse it, it will pass to other parser that it wraps and so on. But in case of custom parser logic, this passing logic cannot be implemented as the interface is not standard. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Can not parse sort order when there are more than one sql extensions specified and iceberg extension is not placed at the right most position [iceberg]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #8004: Can not parse sort order when there are more than one sql extensions specified and iceberg extension is not placed at the right most position
URL: https://github.com/apache/iceberg/issues/8004


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Can not parse sort order when there are more than one sql extensions specified and iceberg extension is not placed at the right most position [iceberg]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8004:
URL: https://github.com/apache/iceberg/issues/8004#issuecomment-2625997887

   This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Can not parse sort order when there are more than one sql extensions specified and iceberg extension is not placed at the right most position [iceberg]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8004:
URL: https://github.com/apache/iceberg/issues/8004#issuecomment-2594191789

   This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org