[I] Unable to create `ParquetRecordBatchStreamBuilder` due to runtime issues [arrow-rs]

["DrewMcArthur (via GitHub)" <gi...@apache.org>]

DrewMcArthur opened a new issue, #8231:
URL: https://github.com/apache/arrow-rs/issues/8231

   **Describe the bug**
   Attempting to create a `ParquetRecordBatchStreamBuilder`, reading from S3 panics with the following error: `there is no reactor running, must be called from the context of a Tokio 1.x runtime`.  The confusion for me is that the code is running within a Tokio runtime, v1.47.
   
   **To Reproduce**
   ```rust
   #[tokio::main]
   async fn main() {
       let path = "path/to/key";
       let s3_store: Arc<AmazonS3> = Arc::new(
           AmazonS3Builder::from_env()
               .with_bucket_name(BUCKET_NAME)
               .build()?,
       );
   
       let path = Path::from(key);
       let reader = ParquetObjectReader::new(s3_store, path);
       let builder = ParquetRecordBatchStreamBuilder::new(reader).await?;
   }
   ```
   The code panics on the last line, and a backtrace leads me to [this function](https://github.com/apache/arrow-rs/blob/1dacecba8e11cac307eea5d1a0f10c22d7f4a8b7/parquet/src/arrow/async_reader/store.rs#L197), which has a comment above it referencing something about async/IO.  
   
   **Expected behavior**
   I'd expect the code above to *just work*^tm - am I doing something wrong here?
   
   **Additional context**
   There's a decent likelihood that I'm just misconfiguring something, but I figured I'd post this here either way so that someone else (or me, in the future) has the troubleshooting that will follow as a reference.  


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Unable to create `ParquetRecordBatchStreamBuilder` due to runtime issues [arrow-rs]

["DrewMcArthur (via GitHub)" <gi...@apache.org>]

DrewMcArthur commented on issue #8231:
URL: https://github.com/apache/arrow-rs/issues/8231#issuecomment-3225279320

   I think the solution might be something to do with the features I had enabled for `tokio`.  Having all of these enabled still led to the error:
   ```
   tokio = { version = "1.47.1", features = ["fs", "io-std", "io-util", "macros", "rt", "rt-multi-thread", "time"]}
   ```
   
   but adding `cargo add tokio -F full` now seems to work.  I'll leave this open for y'all to deal with as you see fit!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org