You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2023/09/07 16:40:00 UTC

[jira] [Created] (HADOOP-18884) [ABFS] Support VectorIO in ABFS Input Stream

Steve Loughran created HADOOP-18884:
---------------------------------------

             Summary: [ABFS] Support VectorIO in ABFS Input Stream
                 Key: HADOOP-18884
                 URL: https://issues.apache.org/jira/browse/HADOOP-18884
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/azure
    Affects Versions: 3.3.9
            Reporter: Steve Loughran


the hadoop vector IO APIs are supported in file;// and s3a://; there's a hive ORC patch for this and PARQUET-2171 adds it for parquet -after which all apps using the library with a matching hadoop version and the feature enabled will get a significant speedup.

abfs needs to support too, which needs support for parallel GET requests for different ranges



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org