[I] bug: python operator.list with start_after does not work for local file system [opendal]

["heman026 (via GitHub)" <gi...@apache.org>]

heman026 opened a new issue, #6676:
URL: https://github.com/apache/opendal/issues/6676

   ### Describe the bug
   
   Open dal operator list method with start_after arugment works fine with s3 but not with local file system. It always list all the files from the path. Eg. code given below.
   
   ```
   operator = Operator("fs", root="tmp")
   files = list(operator.list("", start_after = files[-1].path))
   ```
   
   files has all entire list of files from the path in case of local file system. In case of s3, it only gives the new file.
   Please help me resolve this issue
   
   ### Steps to Reproduce
   
   Explained in the bug details
   
   ### Expected Behavior
   
   The method should list only the new files in the path.
   
   ### Additional Context
   
   _No response_
   
   ### Are you willing to submit a PR to fix this bug?
   
   - [ ] Yes, I would like to submit a PR.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] bug: python operator.list with start_after does not work for local file system [opendal]

["0lai0 (via GitHub)" <gi...@apache.org>]

0lai0 commented on issue #6676:
URL: https://github.com/apache/opendal/issues/6676#issuecomment-3566845597

   I think the filtering logic of start_after can be implemented in FsLister (after reading all items, skip the items before start_after).
   Please let me know if this approach makes sense. I could help to do this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] bug: python operator.list with start_after does not work for local file system [opendal]

["Xuanwo (via GitHub)" <gi...@apache.org>]

Xuanwo commented on issue #6676:
URL: https://github.com/apache/opendal/issues/6676#issuecomment-3409869316

   Thanks for the report. This is actually expected behavior, since `fs` does not support listing with `start_after`. Users may find the listing much slower than they expect. I’m open to implementing this if we can provide a clear way to inform users about this limitation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org