You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 15:28:11 UTC

[GitHub] [beam] damccorm opened a new issue, #20110: Hadoop Downloader Range not correct

damccorm opened a new issue, #20110:
URL: https://github.com/apache/beam/issues/20110

   I found that the `HdfsDownloader.get_range(self, start, end)' get range {color:#ff0000}[start, end]{color} rather than {color:#ff0000}[start, end){color}. This will cause an error while reading hdfs file.
   
    
   
   File "/data/anaconda3/envs/tfdv1.15/lib/python3.7/site-packages/apache_beam/io/tfrecordio.py", line 127, in read_record
    buf = file_handle.read(buf_length_expected)
    File "/data/anaconda3/envs/tfdv1.15/lib/python3.7/site-packages/apache_beam/io/filesystemio.py", line 123, in readinto
    b[:len(data)] = data
    ValueError: memoryview assignment: lvalue and rvalue have different structures
   
   Imported from Jira [BEAM-9152](https://issues.apache.org/jira/browse/BEAM-9152). Original Jira may contain additional context.
   Reported by: Benjzhou.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] chamikaramj commented on issue #20110: Hadoop Downloader Range not correct

Posted by GitBox <gi...@apache.org>.
chamikaramj commented on issue #20110:
URL: https://github.com/apache/beam/issues/20110#issuecomment-1151426780

   @Abacn will you be able to look into this ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] kennknowles commented on issue #20110: Hadoop Downloader Range not correct

Posted by GitBox <gi...@apache.org>.
kennknowles commented on issue #20110:
URL: https://github.com/apache/beam/issues/20110#issuecomment-1151420659

   @chamikaramj @udim this is a reopened recently, despite the Jira having a very early number. Seems like P1 is right if people are having data problems? Not a release blocker if it has been broken forever I guess?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] Abacn commented on issue #20110: Hadoop Downloader Range not correct

Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #20110:
URL: https://github.com/apache/beam/issues/20110#issuecomment-1151433522

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] chamikaramj closed issue #20110: Hadoop Downloader Range not correct

Posted by GitBox <gi...@apache.org>.
chamikaramj closed issue #20110: Hadoop Downloader Range not correct
URL: https://github.com/apache/beam/issues/20110


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org