[jira] [Created] (IMPALA-10708) Expose FileReader/FileWriter Interface to allow user define implement to improve io performance

["Qing Cai (Jira)" <ji...@apache.org>]

Qing Cai created IMPALA-10708:
---------------------------------

             Summary: Expose FileReader/FileWriter  Interface to allow user define implement to improve io performance
                 Key: IMPALA-10708
                 URL: https://issues.apache.org/jira/browse/IMPALA-10708
             Project: IMPALA
          Issue Type: New Feature
          Components: Backend
            Reporter: Qing Cai


Currently, Impala only supports Hadoop FileSystem base FS and reads it via java, if a filesystem is not HDFS, it will get bad performance because can't use shortcircuit. to improve performance I want to implement a c++ reader and writer.
 # add a new flag to the config io plugin
 # add io plugin manage, to dynamic load user lib and keep a memory mapping, schema-> implement
 # if some fs  implement reader or writer, use the implement to read/writer data



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org