[jira] [Assigned] (HDFS-14092) Remove two-step create/append in WebHdfsFileSystem

["Siyao Meng (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-14092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siyao Meng reassigned HDFS-14092:
---------------------------------

    Assignee: Siyao Meng

> Remove two-step create/append in WebHdfsFileSystem
> --------------------------------------------------
>
>                 Key: HDFS-14092
>                 URL: https://issues.apache.org/jira/browse/HDFS-14092
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: webhdfs
>    Affects Versions: 3.2.0
>            Reporter: Daniel Templeton
>            Assignee: Siyao Meng
>            Priority: Major
>
> Per the javadoc on the {{WebHdfsFileSystem.connect()}} method:
> {code}    /**
>      * Two-step requests redirected to a DN
>      *
>      * Create/Append:
>      * Step 1) Submit a Http request with neither auto-redirect nor data.
>      * Step 2) Submit another Http request with the URL from the Location header
>      * with data.
>      *
>      * The reason of having two-step create/append is for preventing clients to
>      * send out the data before the redirect. This issue is addressed by the
>      * "Expect: 100-continue" header in HTTP/1.1; see RFC 2616, Section 8.2.3.
>      * Unfortunately, there are software library bugs (e.g. Jetty 6 http server
>      * and Java 6 http client), which do not correctly implement "Expect:
>      * 100-continue". The two-step create/append is a temporary workaround for
>      * the software library bugs.
>      *
>      * Open/Checksum
>      * Also implements two-step connects for other operations redirected to
>      * a DN such as open and checksum
>      */{code}
> We should validate that it's safe to remove the two-step process and do so.  FYI, [~smeng].



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org