You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@knox.apache.org by "Sean Chow (Jira)" <ji...@apache.org> on 2020/06/16 10:25:00 UTC

[jira] [Commented] (KNOX-2139) Can not handle 8GB file when using webhdfs

    [ https://issues.apache.org/jira/browse/KNOX-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136514#comment-17136514 ] 

Sean Chow commented on KNOX-2139:
---------------------------------

Hi [~krisden], it's easy to reproduce again in version 1.1 and 1.2. And I test it with the latest version 1.4,  it's gone!

> Can not handle 8GB file when using webhdfs
> ------------------------------------------
>
>                 Key: KNOX-2139
>                 URL: https://issues.apache.org/jira/browse/KNOX-2139
>             Project: Apache Knox
>          Issue Type: Bug
>          Components: Server
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Sean Chow
>            Assignee: Kevin Risden
>            Priority: Critical
>         Attachments: cdp-proxy-api.xml
>
>
> I use knox with webhdfs for a long time, andI uprade my knox version from 0.8 to 1.2 recent days. It's really strange that knox can't handle file with size *8589934592 bytes* when I upload my splited file to hdfs.
> It's easy to reproduce and both knox1.1 and 1.2 have this issue. But is works fine in knox0.8.
> Any error log found in gateway.log? No, all logs is clean. From the client side (curl), I saw the the url is redirected correctly and failed with {{curl: (55) Send failure: Connection reset by peer}} or {{curl: (55) Send failure: Broken pipe}}
> I'm sure my network is ok. Any files with other size(smaller or larger) can be  upload successfully.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)