You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "hussein-awala (via GitHub)" <gi...@apache.org> on 2023/06/09 07:25:54 UTC

[GitHub] [airflow] hussein-awala commented on issue #31750: BaseSQLToGCSOperator creates row group for each rows during parquet generation

hussein-awala commented on issue #31750:
URL: https://github.com/apache/airflow/issues/31750#issuecomment-1584102613

   This is normal, since we read the rows and we write them to the parquet one by one.
   I have a solution for this problem, I will implement it and let you test it before merging the PR, but I see the issue more like a feature request (specify the row group size) rather than a bug.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org