You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "danielcweeks (via GitHub)" <gi...@apache.org> on 2026/02/03 17:26:27 UTC

Re: [PR] [SPEC] Add finer grained read restrictions as part of loadTable [iceberg]

danielcweeks commented on code in PR #13879:
URL: https://github.com/apache/iceberg/pull/13879#discussion_r2760180338


##########
open-api/rest-catalog-open-api.yaml:
##########
@@ -3347,6 +3347,105 @@ components:
           additionalProperties:
             type: string
 
+    ReadRestrictions:
+      type: object
+      description: >
+          Read restrictions for a table, including column projections and row filter expressions.
+
+          A client MUST enforce the restrictions defined in this object when reading data
+          from the table.
+
+          These restrictions apply only to the authenticated principal, user, or account
+          associated with the request. They MUST NOT be interpreted as global policy and
+          MUST NOT be applied beyond the entity identified by the Authentication header
+          (or other applicable authentication mechanism).
+      properties:
+        required-column-projections:
+          description: >
+            A list of projections that MUST be applied prior to any query-specified
+            projections.
+            If this property is absent, no mandatory projection applies,
+            and a reader MAY project any subset of columns of the table, including all columns.
+
+            1. A reader MUST project only columns listed in the required-column-projections.
+              - If a listed column has a transform, the reader MUST apply it and replace
+                all references to the underlying column with the transformed value
+                (for example, truncate[4](cc) MUST be projected as truncate[4](cc) AS cc,
+                and all references to cc during query evaluation post applying required-row-filter MUST resolve to this alias).
+              - Columns not listed in the required-column-projections MUST NOT be read.
+
+            2. A column MUST appear at most once in the required-column-projections.
+
+            3. If a projected column's corresponding entry includes an action that the reader cannot evaluate,
+              the reader MUST fail rather than ignore the transform.
+
+            4. An identity transform is equivalent to projecting the column directly.
+
+            5. The data type of the projected column MUST match the data type defined for the transform result.
+
+          type: array
+          items:
+            $ref: '#/components/schemas/Projection'
+        required-row-filter:
+          description: >
+            An expression that filters rows in the table that the authenticated principal does not have access to.
+
+            1. A reader MUST discard any row for which the filter evaluates to false or null, and
+              no information derived from discarded rows MAY be included in the query result.
+
+            2. Row filters MUST be evaluated against the original, untransformed column values.
+              Required projections MUST be applied only after row filters are applied.
+
+            3. If a client cannot interpret or evaluate a provided filter expression, it MUST fail.
+
+            4. If this property is absent, null, or always true then no mandatory filtering is required.
+          $ref: '#/components/schemas/Expression'
+
+    Projection:
+      type: object
+      description: >
+        Defines a projection for a column.
+        If action is not specified, the column is projected as-is.
+      properties:
+        field-id:
+          type: integer
+          description: field id of the column being projected.
+        action:
+          $ref: '#/components/schemas/Action'
+      required:
+        - field-id
+
+    Action:
+      description: Defines the specific action to be executed for computing the projection.
+      oneOf:
+        - $ref: '#/components/schemas/MaskHashSha256'
+        - $ref: '#/components/schemas/ReplaceWithNull'
+        - $ref: '#/components/schemas/MaskAlphanumeric'

Review Comment:
   I don't think we want to enumerate specific actions in the REST spec.  I would support using expressions/udfs to represent the transforms on the column, but this approach will lead to inconsistencies and may force engines that do not support these exact transforms to be non-compliant.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org