You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "Fokko (via GitHub)" <gi...@apache.org> on 2024/04/25 13:01:08 UTC

[I] `field-id`'s missing in generated Avro files [iceberg-rust]

Fokko opened a new issue, #353:
URL: https://github.com/apache/iceberg-rust/issues/353

   Looks like the `field-id` is missing in the Avro metadata generated by iceberg-rust. This should conform the spec: https://iceberg.apache.org/spec/#avro
   
   ```
   avro-tools getschema snap-0-1-a0c0a37d-6828-47c6-80e8-64b0a013fe44.avro
   24/04/25 14:58:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   {
     "type" : "record",
     "name" : "manifest_file",
     "fields" : [ {
       "name" : "manifest_path",
       "type" : "string"
     }, {
       "name" : "manifest_length",
       "type" : "long"
     }, {
       "name" : "partition_spec_id",
       "type" : "int"
     }, {
       "name" : "content",
       "type" : "int"
     }, {
       "name" : "sequence_number",
       "type" : "long"
     }, {
       "name" : "min_sequence_number",
       "type" : "long"
     }, {
       "name" : "added_snapshot_id",
       "type" : "long"
     }, {
       "name" : "added_data_files_count",
       "type" : "int"
     }, {
       "name" : "existing_data_files_count",
       "type" : "int"
     }, {
       "name" : "deleted_data_files_count",
       "type" : "int"
     }, {
       "name" : "added_rows_count",
       "type" : "long"
     }, {
       "name" : "existing_rows_count",
       "type" : "long"
     }, {
       "name" : "deleted_rows_count",
       "type" : "long"
     }, {
       "name" : "partitions",
       "type" : [ "null", {
         "type" : "array",
         "items" : {
           "type" : "record",
           "name" : "r508",
           "fields" : [ {
             "name" : "contains_null",
             "type" : "boolean"
           }, {
             "name" : "contains_nan",
             "type" : [ "null", "boolean" ],
             "default" : null
           }, {
             "name" : "lower_bound",
             "type" : [ "null", "bytes" ],
             "default" : null
           }, {
             "name" : "upper_bound",
             "type" : [ "null", "bytes" ],
             "default" : null
           } ]
         }
       } ],
       "default" : null
     }, {
       "name" : "key_metadata",
       "type" : [ "null", "bytes" ],
       "default" : null
     } ]
   }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] `field-id`'s missing in generated Avro files [iceberg-rust]

Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko closed issue #353: `field-id`'s missing in generated Avro files
URL: https://github.com/apache/iceberg-rust/issues/353


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] `field-id`'s missing in generated Avro files [iceberg-rust]

Posted by "liurenjie1024 (via GitHub)" <gi...@apache.org>.
liurenjie1024 commented on issue #353:
URL: https://github.com/apache/iceberg-rust/issues/353#issuecomment-2288982050

   Thanks @ZENOTME !


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] `field-id`'s missing in generated Avro files [iceberg-rust]

Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #353:
URL: https://github.com/apache/iceberg-rust/issues/353#issuecomment-2288005581

   Yes!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] `field-id`'s missing in generated Avro files [iceberg-rust]

Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #353:
URL: https://github.com/apache/iceberg-rust/issues/353#issuecomment-2287846778

   Hi, I beleive this can be closed not?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] `field-id`'s missing in generated Avro files [iceberg-rust]

Posted by "s-akhtar-baig (via GitHub)" <gi...@apache.org>.
s-akhtar-baig commented on issue #353:
URL: https://github.com/apache/iceberg-rust/issues/353#issuecomment-2077159481

   @Fokko, can you please assign this to me? Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] `field-id`'s missing in generated Avro files [iceberg-rust]

Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #353:
URL: https://github.com/apache/iceberg-rust/issues/353#issuecomment-2077166551

   @s-akhtar-baig Certainly 🙌 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org