You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@knox.apache.org by "Sean Chow (Jira)" <ji...@apache.org> on 2019/11/23 12:22:00 UTC
[jira] [Updated] (KNOX-2139) Can not handle 8GB file when using
webhdfs
[ https://issues.apache.org/jira/browse/KNOX-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Chow updated KNOX-2139:
----------------------------
Description:
I use knox with webhdfs for a long time, andI uprade my knox version from 0.8 to 1.2 recent days. It's really strange that knox can't handle file with size *8589934592 bytes* when I upload my splited file to hdfs.
It's easy to reproduce and both knox1.1 and 1.2 have this issue. But is works fine in knox0.8.
Any error log found in gateway.log? No, all logs is clean. From the client side (curl), I saw the the url is redirected correctly and failed with {{curl: (55) Send failure: Connection reset by peer}} or {{curl: (55) Send failure: Broken pipe}}
I'm sure my network is ok. Any files with other size(smaller or larger) can be upload successfully.
was:
I use knox with webhdfs for a long time, andI uprade my knox version from 0.8 to 1.2 recent days. It's really strange that knox can't handle file with size 8589934592 bytes when I upload my splited file to hdfs.
It's easy to reproduce and both knox1.1 and 1.2 have this issue. But is works fine in knox0.8.
Any error log found in gateway.log? No, all logs is clean. From the client side (curl), I saw the the url is redirected correctly and failed with {{curl: (55) Send failure: Connection reset by peer
}} or {{curl: (55) Send failure: Broken pipe}}
I'm sure my network is ok. Any files with other size(smaller or larger) can be upload successfully.
> Can not handle 8GB file when using webhdfs
> ------------------------------------------
>
> Key: KNOX-2139
> URL: https://issues.apache.org/jira/browse/KNOX-2139
> Project: Apache Knox
> Issue Type: Bug
> Components: Server
> Affects Versions: 1.1.0, 1.2.0
> Reporter: Sean Chow
> Priority: Critical
>
> I use knox with webhdfs for a long time, andI uprade my knox version from 0.8 to 1.2 recent days. It's really strange that knox can't handle file with size *8589934592 bytes* when I upload my splited file to hdfs.
> It's easy to reproduce and both knox1.1 and 1.2 have this issue. But is works fine in knox0.8.
> Any error log found in gateway.log? No, all logs is clean. From the client side (curl), I saw the the url is redirected correctly and failed with {{curl: (55) Send failure: Connection reset by peer}} or {{curl: (55) Send failure: Broken pipe}}
> I'm sure my network is ok. Any files with other size(smaller or larger) can be upload successfully.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)