[jira] [Commented] (DRILL-8407) Add Support for SFTP File Systems

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17696593#comment-17696593 ] 

ASF GitHub Bot commented on DRILL-8407:
---------------------------------------

cgivre opened a new pull request, #2770:
URL: https://github.com/apache/drill/pull/2770

   # [DRILL-8407](https://issues.apache.org/jira/browse/DRILL-XXXX): Add Support for SFTP File Systems
   
   ## Description
   This PR enables Drill to query files stored in SFTP file systems.
   
   ## Documentation
   An SFTP file system behaves exactly as any other file system. 
   
   ## Configuration
   To query data from an SFTP file system, follow the instructions for any other file system.  For the URL, provide the host as shown below:
   
   ```json
   {
     "type": "file",
     "connection": "sftp://<your sftp server URL>",
     "workspaces": {
       "test": {
         "location": "<path to test data>",
         "writable": true,
         "defaultInputFormat": null,
         "allowAccessOutsideWorkspace": false
       },
     ...
   ```
   ### Authentication
   
   The SFTP plugin requires a username and password to authenticate.  The best way to do this is to provide the information via a `credentialProvider` as shown below.   SFTP file systems can be used with `USER_TRANSLATION` enabled, but not `USER_IMPERSONATION`.  
   
   ```json
    "credentialsProvider": {
       "credentialsProviderType": "PlainCredentialsProvider",
       "credentials": {
         "username": "<username>",
         "password": "<password>"
       },
       "userCredentials": {}
     },
   ```
   
   If you need to pass additional configuration variables to the SFTP server, you can do so in the `config` parameter in the file system.  You will need to prefix any parameters with `fs.sftp`.  
   
   
   ## Testing
   Manually Tested




> Add Support for SFTP File Systems
> ---------------------------------
>
>                 Key: DRILL-8407
>                 URL: https://issues.apache.org/jira/browse/DRILL-8407
>             Project: Apache Drill
>          Issue Type: Improvement
>          Components: Storage - File
>    Affects Versions: 1.20.0
>            Reporter: Charles Givre
>            Assignee: Charles Givre
>            Priority: Major
>             Fix For: Future
>
>
> Add support for SFTP File Systems. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)