You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "natbprice (via GitHub)" <gi...@apache.org> on 2023/09/21 14:14:50 UTC
[GitHub] [arrow] natbprice commented on issue #37816: [R] open_dataset(..., unify_schemas=FALSE) opens all files
natbprice commented on issue #37816:
URL: https://github.com/apache/arrow/issues/37816#issuecomment-1729672708
I have not tested opening bucket with a uri because Azure Blob storage is not supported. I am using [blobfuse2](https://github.com/Azure/azure-storage-fuse). A listing operation (e.g., `ls`) does not trigger file downloads. From arrow's perspective, I don't think there is any requirement for specialized listing code. In Python arrow, I have verified I can create the dataset while only downloading 1 file and then run queries to trigger downloads of correct partitions.
I think a good next step would to be to see if we can replicate the issue using a local directory without cloud storage, but I am not sure how to log when R arrow is opening a file and how to differentiate that from simply listing files. Maybe `ls -l --time=atime` or `strace`? Maybe there is a way to create a mock filesystem in order to verify what operations R arrow is performing? Any advice is appreciated.
The blobfuse2 log for the mounted directory indicates that R arrow is opening all the files:
```
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_CRIT [mount.go (405)]: Starting Blobfuse2 Mount : 2.1.1-preview.1 on [Ubuntu 22.04.2 LTS]
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_CRIT [mount.go (406)]: Logging level set to : LOG_INFO
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [libfuse.go (244)]: Libfuse::Validate : UID 0, GID 0
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [libfuse.go (305)]: Libfuse::Configure : read-only true, allow-other true, allow-root false, default-perm 511, entry-timeout 600, attr-time 600, negative-timeout 600, ignore-open-flags true, nonempty false, direct_io false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [file_cache.go (282)]: FileCache::Configure : Using default eviction policy
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [file_cache.go (304)]: FileCache::Configure : create-empty false, cache-timeout 86400, tmp-path /workingdir/cache, max-size-mb 4096, high-mark 80, low-mark 60, refresh-sec 0, max-eviction 5000
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [attr_cache.go (156)]: AttrCache::Configure : cache-timeout 86400, symlink false, cache-on-list false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [config.go (388)]: ParseAndValidateConfig : using the following proxy address from the config file:
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [config.go (392)]: ParseAndValidateConfig : sdk logging from the config file: false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [config.go (485)]: ParseAndValidateConfig : Account: accountname, Container: nyc-taxi, AccountType: ADLS, Auth: KEY, Prefix: , Endpoint: https://accountname.dfs.core.windows.net/, ListBlock: 0, MD5 : false false, Virtual Directory: true, Max Results For List 2, Disable Compression: false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [config.go (489)]: ParseAndValidateConfig : Retry Config: Retry count 5, Max Timeout 900, BackOff Time 4, Max Delay 60
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [config.go (492)]: ParseAndValidateConfig : Telemetry :
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [mount.go (415)]: mount: Mounting blobfuse2 on /workingdir/nyc-taxi
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_CRIT [mount.go (405)]: Starting Blobfuse2 Mount : 2.1.1-preview.1 on [Ubuntu 22.04.2 LTS]
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_CRIT [mount.go (406)]: Logging level set to : LOG_INFO
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse.go (244)]: Libfuse::Validate : UID 0, GID 0
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse.go (305)]: Libfuse::Configure : read-only true, allow-other true, allow-root false, default-perm 511, entry-timeout 600, attr-time 600, negative-timeout 600, ignore-open-flags true, nonempty false, direct_io false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (282)]: FileCache::Configure : Using default eviction policy
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (304)]: FileCache::Configure : create-empty false, cache-timeout 86400, tmp-path /workingdir/cache, max-size-mb 4096, high-mark 80, low-mark 60, refresh-sec 0, max-eviction 5000
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [attr_cache.go (156)]: AttrCache::Configure : cache-timeout 86400, symlink false, cache-on-list false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [config.go (388)]: ParseAndValidateConfig : using the following proxy address from the config file:
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [config.go (392)]: ParseAndValidateConfig : sdk logging from the config file: false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [config.go (485)]: ParseAndValidateConfig : Account: accountname, Container: nyc-taxi, AccountType: ADLS, Auth: KEY, Prefix: , Endpoint: https://accountname.dfs.core.windows.net/, ListBlock: 0, MD5 : false false, Virtual Directory: true, Max Results For List 2, Disable Compression: false
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [config.go (489)]: ParseAndValidateConfig : Retry Config: Retry count 5, Max Timeout 900, BackOff Time 4, Max Delay 60
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [config.go (492)]: ParseAndValidateConfig : Telemetry :
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [mount.go (415)]: mount: Mounting blobfuse2 on /workingdir/nyc-taxi
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [lru_policy.go (139)]: lruPolicy::StartPolicy : Policy set with 86400 timeout
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (178)]: Libfuse::initFuse : Mounting with fuse3 library
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (258)]: Libfuse::NotifyMountToParent : Notifying parent for successful mount
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (265)]: Libfuse::libfuse_init : Kernel Caps : 60817371
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (272)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_PARALLEL_DIROPS
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (278)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_AUTO_INVAL_DATA
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (285)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_READDIRPLUS
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (291)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_ASYNC_READ
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (297)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_SPLICE_WRITE
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7088] : LOG_INFO [libfuse_handler.go (309)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_WRITEBACK_CACHE
Thu Sep 21 09:45:47 EDT 2023 : blobfuse2[7076] : LOG_INFO [mount.go (467)]: mount: Child [7088] mounted successfully at /workingdir/nyc-taxi
Thu Sep 21 09:45:58 EDT 2023 : blobfuse2[7088] : LOG_INFO [azstorage.go (290)]: AzStorage::StreamDir : Unblocked List API
Thu Sep 21 09:46:02 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:02 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:02 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:02 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:02 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:03 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2010/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:04 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2011/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:05 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2012/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:06 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2013/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:07 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2014/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:08 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2015/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:09 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2016/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:10 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2017/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2018/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:11 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2019/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:12 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2020/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=10/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=11/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=12/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=2/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=3/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=4/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=5/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=6/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=7/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=8/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2021/month=9/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2022/month=1/part-0.parquet, fd=13
Thu Sep 21 09:46:13 EDT 2023 : blobfuse2[7088] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2022/month=2/part-0.parquet, fd=13
```
In contrast, Python arrow is only opening 1 file:
```
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_CRIT [mount.go (405)]: Starting Blobfuse2 Mount : 2.1.1-preview.1 on [Ubuntu 22.04.2 LTS]
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_CRIT [mount.go (406)]: Logging level set to : LOG_INFO
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [libfuse.go (244)]: Libfuse::Validate : UID 0, GID 0
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [libfuse.go (305)]: Libfuse::Configure : read-only true, allow-other true, allow-root false, default-perm 511, entry-timeout 600, attr-time 600, negative-timeout 600, ignore-open-flags true, nonempty false, direct_io false
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [file_cache.go (282)]: FileCache::Configure : Using default eviction policy
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [file_cache.go (304)]: FileCache::Configure : create-empty false, cache-timeout 86400, tmp-path /workingdir/blobfuse/cache, max-size-mb 4096, high-mark 80, low-mark 60, refresh-sec 0, max-eviction 5000
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [attr_cache.go (156)]: AttrCache::Configure : cache-timeout 86400, symlink false, cache-on-list false
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [config.go (388)]: ParseAndValidateConfig : using the following proxy address from the config file:
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [config.go (392)]: ParseAndValidateConfig : sdk logging from the config file: false
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [config.go (485)]: ParseAndValidateConfig : Account: accountname, Container: nyc-taxi, AccountType: ADLS, Auth: KEY, Prefix: , Endpoint: https://accountname.dfs.core.windows.net/, ListBlock: 0, MD5 : false false, Virtual Directory: true, Max Results For List 2, Disable Compression: false
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [config.go (489)]: ParseAndValidateConfig : Retry Config: Retry count 5, Max Timeout 900, BackOff Time 4, Max Delay 60
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [config.go (492)]: ParseAndValidateConfig : Telemetry :
Thu Sep 21 09:53:37 EDT 2023 : blobfuse2[7998] : LOG_INFO [mount.go (415)]: mount: Mounting blobfuse2 on /workingdir/blobfuse/nyc-taxi
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_CRIT [mount.go (405)]: Starting Blobfuse2 Mount : 2.1.1-preview.1 on [Ubuntu 22.04.2 LTS]
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_CRIT [mount.go (406)]: Logging level set to : LOG_INFO
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse.go (244)]: Libfuse::Validate : UID 0, GID 0
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse.go (305)]: Libfuse::Configure : read-only true, allow-other true, allow-root false, default-perm 511, entry-timeout 600, attr-time 600, negative-timeout 600, ignore-open-flags true, nonempty false, direct_io false
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [file_cache.go (282)]: FileCache::Configure : Using default eviction policy
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [file_cache.go (304)]: FileCache::Configure : create-empty false, cache-timeout 86400, tmp-path /workingdir/blobfuse/cache, max-size-mb 4096, high-mark 80, low-mark 60, refresh-sec 0, max-eviction 5000
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [attr_cache.go (156)]: AttrCache::Configure : cache-timeout 86400, symlink false, cache-on-list false
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [config.go (388)]: ParseAndValidateConfig : using the following proxy address from the config file:
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [config.go (392)]: ParseAndValidateConfig : sdk logging from the config file: false
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [config.go (485)]: ParseAndValidateConfig : Account: accountname, Container: nyc-taxi, AccountType: ADLS, Auth: KEY, Prefix: , Endpoint: https://accountname.dfs.core.windows.net/, ListBlock: 0, MD5 : false false, Virtual Directory: true, Max Results For List 2, Disable Compression: false
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [config.go (489)]: ParseAndValidateConfig : Retry Config: Retry count 5, Max Timeout 900, BackOff Time 4, Max Delay 60
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [config.go (492)]: ParseAndValidateConfig : Telemetry :
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [mount.go (415)]: mount: Mounting blobfuse2 on /workingdir/blobfuse/nyc-taxi
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [lru_policy.go (139)]: lruPolicy::StartPolicy : Policy set with 86400 timeout
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (178)]: Libfuse::initFuse : Mounting with fuse3 library
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (258)]: Libfuse::NotifyMountToParent : Notifying parent for successful mount
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (265)]: Libfuse::libfuse_init : Kernel Caps : 60817371
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (272)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_PARALLEL_DIROPS
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (278)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_AUTO_INVAL_DATA
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (285)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_READDIRPLUS
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (291)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_ASYNC_READ
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (297)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_SPLICE_WRITE
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[8009] : LOG_INFO [libfuse_handler.go (309)]: Libfuse::libfuse_init : Enable Capability : FUSE_CAP_WRITEBACK_CACHE
Thu Sep 21 09:53:38 EDT 2023 : blobfuse2[7998] : LOG_INFO [mount.go (467)]: mount: Child [8009] mounted successfully at /workingdir/blobfuse/nyc-taxi
Thu Sep 21 09:54:25 EDT 2023 : blobfuse2[8009] : LOG_INFO [azstorage.go (290)]: AzStorage::StreamDir : Unblocked List API
Thu Sep 21 09:54:29 EDT 2023 : blobfuse2[8009] : LOG_INFO [file_cache.go (952)]: FileCache::OpenFile : file=year=2009/month=1/part-0.parquet, fd=13
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org