You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "transformandodados (via GitHub)" <gi...@apache.org> on 2025/11/25 12:28:54 UTC
[I] [Bug]: Get File Names dont list files in subfolder for minio (hop)
transformandodados opened a new issue, #6071:
URL: https://github.com/apache/hop/issues/6071
### Apache Hop version?
2.16.0
### Java version?
17.0.2
### Operating system
Windows
### What happened?
The action "Get file names" dont list files from subdirectories, only list when put 1 file in File/Directory.
We need
Example Not OK:
Diretory: minio://ouze-prd-data-lake-transformed/sfmc/stz/journey-4d56f51bc3ef428e921673792c15eda5/data/
Wildcard: .*\.parquet
Include subfolders: Y
Example OK:
Diretory: minio://ouze-prd-data-lake-transformed/sfmc/stz/journey-4d56f51bc3ef428e921673792c15eda5/data/20250901_144303_07172_6aui7-f0e5ab63-c603-4736-a76d-c6b6e02ce5c4.parquet
Wildcard: .*\.parquet
Include subfolders: Y (not interfers in this case)
<img width="1844" height="988" alt="Image" src="https://github.com/user-attachments/assets/59d67869-f0dd-4566-9cca-350a584fa932" />
We need all the files to be listed; only then will it make sense to have the option to connect with Minio.
### Issue Priority
Priority: 2
### Issue Component
Component: Actions
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names dont list files in subfolder for minio (hop)
Posted by "steewel (via GitHub)" <gi...@apache.org>.
steewel commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3598412323
Same thing happens here using CSV files, I can open specific files, but can't list any files over the bucket even on root, withot creating subfolders
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "sramazzina (via GitHub)" <gi...@apache.org>.
sramazzina commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3700875002
@transformandodados @steewel I just added a PR that will solve this issue. Please give Hop snapshot's a try immediately after the PR will be merged in the main branch and let us know if everything is fine. Thanks a lot for your cooperation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3627423593
@sramazzina let me know if you need help on this one. I can add a failing integration test for this scenario if needed.
https://github.com/apache/hop/tree/main/integration-tests/minio
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva closed issue #6071: [Bug]: Get File Names don't list files in subfolder for minio
URL: https://github.com/apache/hop/issues/6071
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "sramazzina (via GitHub)" <gi...@apache.org>.
sramazzina commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3628490300
Yes we are working on that I can confirm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "sramazzina (via GitHub)" <gi...@apache.org>.
sramazzina commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3880929838
The issue was solved in 2.17 and we also wrote a set of tests around that. Therefore it sounds strange to me. Let me check what happens I'll be back to you. Please can you file a new issue for this to keep things separated and clean?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "steewel (via GitHub)" <gi...@apache.org>.
steewel commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3922126877
I added the issue #6608 to report that we can now list files, as we couldn't before, but the "folders" inside the bucket are not listed and files inside any "folder" are not listed as well. Seems like the VFS is looking only to the buckets root level path.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "transformandodados (via GitHub)" <gi...@apache.org>.
transformandodados commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3880523757
I'm testing Apache version 2.17 today, and from what I've seen, the situation I reported in this issue still persists. I saw that there's a PR for version 2.17, so I imagine that should resolve it. Correct?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Get File Names don't list files in subfolder for minio (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #6071:
URL: https://github.com/apache/hop/issues/6071#issuecomment-3880643960
As you can see in the last comment we asked to test it, it could be the problem is still there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org