You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2024/02/27 12:37:49 UTC

[I] Intermittent failure on `dataframe::write_partitioned_parquet_results` [arrow-datafusion]

alamb opened a new issue, #9368:
URL: https://github.com/apache/arrow-datafusion/issues/9368

   ### Describe the bug
   
   `dataframe::write_partitioned_parquet_results` sometimes passes and sometimes fails
   
   This test was recently added in https://github.com/apache/arrow-datafusion/pull/9316
   
   ### To Reproduce
   
   Example failure https://github.com/apache/arrow-datafusion/actions/runs/8063185942/job/22024675172
   
   ```
   
   
   ---- dataframe::write_partitioned_parquet_results stdout ----
   thread 'dataframe::write_partitioned_parquet_results' panicked at datafusion/core/tests/dataframe/mod.rs:1978:5:
   assertion `left == right` failed: 
   
   expected:
   
   [
       "+-----+-----+",
       "| c1  | c2  |",
       "+-----+-----+",
       "| abc | 123 |",
       "| def | 456 |",
       "+-----+-----+",
   ]
   actual:
   
   [
       "+-----+-----+",
       "| c1  | c2  |",
       "+-----+-----+",
       "| def | 456 |",
       "| abc | 123 |",
       "+-----+-----+",
   ]
   ```
   
   ### Expected behavior
   
   I think we can just update the test to use `assert_batches_sorted_eq`  https://docs.rs/datafusion/latest/datafusion/macro.assert_batches_sorted_eq.html so that the ordering is normalized
   
   ### Additional context
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Intermittent failure on `dataframe::write_partitioned_parquet_results` [arrow-datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #9368:
URL: https://github.com/apache/arrow-datafusion/issues/9368#issuecomment-1966457535

   Dupe of  #9358 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Intermittent failure on `dataframe::write_partitioned_parquet_results` [arrow-datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #9368: Intermittent failure on `dataframe::write_partitioned_parquet_results`
URL: https://github.com/apache/arrow-datafusion/issues/9368


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Intermittent failure on `dataframe::write_partitioned_parquet_results` [arrow-datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #9368:
URL: https://github.com/apache/arrow-datafusion/issues/9368#issuecomment-1966454990

   I think this is a good first issue as it would let someone figure out how to run the tests / make a PR


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Intermittent failure on `dataframe::write_partitioned_parquet_results` [arrow-datafusion]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #9368:
URL: https://github.com/apache/arrow-datafusion/issues/9368#issuecomment-1969505420

   > Eeek, sorry for introducing this
   
   No worries -- it was fixed asap!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Intermittent failure on `dataframe::write_partitioned_parquet_results` [arrow-datafusion]

Posted by "tshauck (via GitHub)" <gi...@apache.org>.
tshauck commented on issue #9368:
URL: https://github.com/apache/arrow-datafusion/issues/9368#issuecomment-1969438804

   Eeek, sorry for introducing this


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org