[GitHub] [arrow] jorisvandenbossche commented on a change in pull request #8413: ARROW-10175: [CI] Fix nightly HDFS integration tests (ensure to use legacy dataset)

[GitBox <gi...@apache.org>]

jorisvandenbossche commented on a change in pull request #8413:
URL: https://github.com/apache/arrow/pull/8413#discussion_r502441529



##########
File path: python/pyarrow/tests/test_hdfs.py
##########
@@ -321,7 +321,8 @@ def test_read_multiple_parquet_files_with_uri(self):
 
         expected = self._write_multiple_hdfs_pq_files(tmpdir)
         path = _get_hdfs_uri(tmpdir)
-        result = pq.read_table(path)
+        # TODO for URI it should not be needed to pass this argument
+        result = pq.read_table(path, use_legacy_dataset=True)

Review comment:
       This _should_ not be necessary, I would think, since reading from a URI should work with the new datasets implementation as well. 
   
   The error is `pyarrow.lib.ArrowInvalid: Path '/tmp/pyarrow-test-838/multi-parquet-uri-48569714efc74397816722c9c6723191/0.parquet' is not relative to '/user/root'`




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org