You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/01/21 01:11:36 UTC

[GitHub] [iceberg] jackye1995 opened a new pull request #2127: Spark: add extension to spark 3 runtime

jackye1995 opened a new pull request #2127:
URL: https://github.com/apache/iceberg/pull/2127


   tested with AWS EMR:
   
   ```
   spark-sql> ALTER TABLE prod.db8.sample3 ADD PARTITION FIELD bucket(id,16);
   21/01/21 01:06:46 INFO BaseMetastoreTableOperations: Refreshing table metadata from new version: s3://iceberg-test-yzhaoqin/db8.db/sample3/metadata/00001-60f23197-414e-49a8-97e3-00ea40297412.metadata.json
   21/01/21 01:06:58 INFO BaseMetastoreTableOperations: Successfully committed to table prod.db8.sample3 in 11492 ms
   Time taken: 11.693 seconds
   21/01/21 01:06:58 INFO SparkSQLCLIDriver: Time taken: 11.693 seconds
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] rdblue commented on pull request #2127: Spark: add extension to spark 3 runtime

Posted by GitBox <gi...@apache.org>.
rdblue commented on pull request #2127:
URL: https://github.com/apache/iceberg/pull/2127#issuecomment-764219379


   Thanks, @jackye1995!


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] rdblue commented on pull request #2127: Spark: add extension to spark 3 runtime

Posted by GitBox <gi...@apache.org>.
rdblue commented on pull request #2127:
URL: https://github.com/apache/iceberg/pull/2127#issuecomment-764154236


   @jackye1995, I think we need to update the LICENSE for the `iceberg-spark3-extensions` module with the recent changes from the main LICENSE. We added a couple of new entries under the Spark section and a new section for Delta. Those now affect the extensions module so we should update the LICENSE included in the Jar.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] rdblue merged pull request #2127: Spark: add extension to spark 3 runtime

Posted by GitBox <gi...@apache.org>.
rdblue merged pull request #2127:
URL: https://github.com/apache/iceberg/pull/2127


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] rdblue merged pull request #2127: Spark: add extension to spark 3 runtime

Posted by GitBox <gi...@apache.org>.
rdblue merged pull request #2127:
URL: https://github.com/apache/iceberg/pull/2127


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


[GitHub] [iceberg] rdblue commented on pull request #2127: Spark: add extension to spark 3 runtime

Posted by GitBox <gi...@apache.org>.
rdblue commented on pull request #2127:
URL: https://github.com/apache/iceberg/pull/2127#issuecomment-764154236






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org