[jira] [Created] (DRILL-566) Storage provider for Azure Cloud Storage

["Andy Cross (JIRA)" <ji...@apache.org>]

Andy Cross created DRILL-566:
--------------------------------

             Summary: Storage provider for Azure Cloud Storage
                 Key: DRILL-566
                 URL: https://issues.apache.org/jira/browse/DRILL-566
             Project: Apache Drill
          Issue Type: New Feature
            Reporter: Andy Cross


An Azure cloud storage plugin; the idea being that a user of the storage plugin would be able to address Azure blob storage in a similar way to they might address a LocalFileSystem. 

This is a model that is similar to that developed for Azure's HDInsight service and in EMR, where WASB:// or S3:// schemes allow access to cloud storage in Hadoop rather than using the hdfs:// scheme. I realise the implementation as a plugin differs, and indeed is cleaner in Drill to my mind (before the project commences!). 

Performance and data locality trade-offs are significant in all of these cloud storage services, so concepts like spanning multiple accounts (to maximise IOPs) would be built into the plugin. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)