[PR] DRILL-8407: Add Support for SFTP File Systems (drill)

["cgivre (via GitHub)" <gi...@apache.org>]

cgivre opened a new pull request, #2770:
URL: https://github.com/apache/drill/pull/2770

   # [DRILL-8407](https://issues.apache.org/jira/browse/DRILL-XXXX): Add Support for SFTP File Systems
   
   ## Description
   This PR enables Drill to query files stored in SFTP file systems.
   
   ## Documentation
   An SFTP file system behaves exactly as any other file system. 
   
   ## Configuration
   To query data from an SFTP file system, follow the instructions for any other file system.  For the URL, provide the host as shown below:
   
   ```json
   {
     "type": "file",
     "connection": "sftp://<your sftp server URL>",
     "workspaces": {
       "test": {
         "location": "<path to test data>",
         "writable": true,
         "defaultInputFormat": null,
         "allowAccessOutsideWorkspace": false
       },
     ...
   ```
   ### Authentication
   
   The SFTP plugin requires a username and password to authenticate.  The best way to do this is to provide the information via a `credentialProvider` as shown below.   SFTP file systems can be used with `USER_TRANSLATION` enabled, but not `USER_IMPERSONATION`.  
   
   ```json
    "credentialsProvider": {
       "credentialsProviderType": "PlainCredentialsProvider",
       "credentials": {
         "username": "<username>",
         "password": "<password>"
       },
       "userCredentials": {}
     },
   ```
   
   If you need to pass additional configuration variables to the SFTP server, you can do so in the `config` parameter in the file system.  You will need to prefix any parameters with `fs.sftp`.  
   
   
   ## Testing
   Manually Tested


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] DRILL-8407: Add Support for SFTP File Systems (drill)

["cgivre (via GitHub)" <gi...@apache.org>]

cgivre merged PR #2770:
URL: https://github.com/apache/drill/pull/2770


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@drill.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org