You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/10/12 19:56:26 UTC
[GitHub] [iceberg] kbendick commented on a change in pull request #3284: Spec - Add -1 to Manifest Entry's data_file.record_count to indicate unknown
kbendick commented on a change in pull request #3284:
URL: https://github.com/apache/iceberg/pull/3284#discussion_r727450562
##########
File path: site/docs/spec.md
##########
@@ -379,7 +379,7 @@ The schema of a manifest file is a struct called `manifest_entry` with the follo
| _required_ | _required_ | **`100 file_path`** | `string` | Full URI for the file with FS scheme |
| _required_ | _required_ | **`101 file_format`** | `string` | String file format name, avro, orc or parquet |
| _required_ | _required_ | **`102 partition`** | `struct<...>` | Partition data tuple, schema based on the partition spec output using partition field ids for the struct field ids |
-| _required_ | _required_ | **`103 record_count`** | `long` | Number of records in this file |
+| _required_ | _required_ | **`103 record_count`** | `long` with special value: `-1: Record count unknown` | Number of records in this file. |
Review comment:
I did that initially, but there are a few places that place it under description.
However, those are arguably placed under `Type` and not `Description` because they're enums, whereas this is just one possible magic value (so I personally agree that `description` is the better column for this).
That's mostly why I made this a draft actually 😅
Here's an example of the values being in `Type`:
https://github.com/apache/iceberg/blob/86350db9507d6b0d19643beae25de0a758b6d3cb/site/docs/spec.md#L488
As well as here:
https://github.com/apache/iceberg/blob/86350db9507d6b0d19643beae25de0a758b6d3cb/site/docs/spec.md#L374-L378
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org