You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/08/25 10:26:01 UTC

[GitHub] [airflow] bhirsz commented on pull request #25466: Auto ML assets

bhirsz commented on PR #25466:
URL: https://github.com/apache/airflow/pull/25466#issuecomment-1227073499

   > > Yeah 45K lines of .csv file is NOT something we want. Few options:
   > > 
   > > 1. what happens when you zip the file ? how big it is going to get
   > > 2. Do we REALLY need as big of a file?
   > > 3. We could easily place it it in our Amazon S3 bucket to download it for the test when needed, we could make it publicly available
   > 
   > This .csv is needed for training an AutoML model, in order to start the training .csv should consist more then 1000 rows. For our test I can reduce the file to 2100 rows. @potiuk what do you think about reducing the file size?
   
   @potiuk Catching attention :) I think 2100 is okayish (not the best but certainly better than 50k). Please comment if you still think it should be stored in the external storage.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org