[I] Write Support: Aligning Column Order in pyarrow.Table with Iceberg Table Schema for Write Operations [iceberg-python]

["HonahX (via GitHub)" <gi...@apache.org>]

HonahX opened a new issue, #199:
URL: https://github.com/apache/iceberg-python/issues/199

   ### Feature Request / Improvement
   
   This feature request arises from the discussion in [#183](https://github.com/apache/iceberg-python/pull/183#issuecomment-1848669009) and is contingent upon the implementation of write support as outlined in [#41](https://github.com/apache/iceberg-python/pull/41). Upon the merger of PR #41, the following challenge is observed:
   
   When attempting to write or overwrite new data to an Iceberg table, it is crucial that the column order in the `pyarrow.Table` dataframe or a Parquet file (without field-ids) aligns with the existing table schema. Discrepancies in column order can lead to issues during the process of writing data to a Parquet file using the Iceberg table's schema or when appending an existing Parquet file to our table, leading to incorrect data reads in subsequent operations.
   
   To mitigate this issue,we might want a mechanism to establish a correspondence between the column names in `pyarrow.Table` and the Iceberg table schema. This will enable us to correctly assign field-ids to the respective columns when writing data.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

Re: [I] Write Support: Aligning Column Order in pyarrow.Table with Iceberg Table Schema for Write Operations [iceberg-python]

["github-actions[bot] (via GitHub)" <gi...@apache.org>]

github-actions[bot] commented on issue #199:
URL: https://github.com/apache/iceberg-python/issues/199#issuecomment-2155716455

   This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org