[jira] [Created] (DRILL-7014) Format plugin for LTSV files

["Takako Shimamoto (JIRA)" <ji...@apache.org>]

Takako Shimamoto created DRILL-7014:
---------------------------------------

             Summary: Format plugin for LTSV files
                 Key: DRILL-7014
                 URL: https://issues.apache.org/jira/browse/DRILL-7014
             Project: Apache Drill
          Issue Type: New Feature
          Components: Storage - Other
    Affects Versions: 1.15.0
            Reporter: Takako Shimamoto


I would like to contribute [this plugin|https://github.com/bizreach/drill-ltsv-plugin] to Drill.

h4. Abstract
storage-plugins-override.conf
{code:json}
"storage":{
  dfs: {
    type: "file",
    connection: "file:///",
    formats: {
      "ltsv": {
        "type": "ltsv",
        "extensions": [
          "ltsv"
        ]
      }
    },
    enabled: true
  }
}
{code}
sample.ltsv
{code}
time:30/Nov/2016:00:55:08 +0900 host:xxx.xxx.xxx.xxx  forwardedfor:-  req:GET /v1/xxx HTTP/1.1  status:200  size:4968 referer:- ua:Java/1.8.0_131 reqtime:2.532 apptime:2.532 vhost:api.example.com
time:30/Nov/2016:00:56:37 +0900 host:xxx.xxx.xxx.xxx  forwardedfor:-  req:GET /v1/yyy HTTP/1.1  status:200  size:412  referer:- ua:Java/1.8.0_201 reqtime:3.580 apptime:3.580 vhost:api.example.com
{code}
Run query
{code:sh}
root@1805183e9b65:/apache-drill-1.15.0# ./bin/drill-embedded 
Apache Drill 1.15.0
"Drill must go on."
0: jdbc:drill:zk=local> SELECT * FROM dfs.`/apache-drill-1.15.0/sample-data/sample.ltsv` WHERE reqtime > 3.0;
+-----------------------------+------------------+---------------+-----------------------+---------+-------+----------+-----------------+----------+----------+------------------+
|            time             |       host       | forwardedfor  |          req          | status  | size  | referer  |       ua        | reqtime  | apptime  |      vhost       |
+-----------------------------+------------------+---------------+-----------------------+---------+-------+----------+-----------------+----------+----------+------------------+
| 30/Nov/2016:00:56:37 +0900  | xxx.xxx.xxx.xxx  | -             | GET /v1/yyy HTTP/1.1  | 200     | 412   | -        | Java/1.8.0_201  | 3.580    | 3.580    | api.example.com  |
+-----------------------------+------------------+---------------+-----------------------+---------+-------+----------+-----------------+----------+----------+------------------+
1 row selected (6.074 seconds)
0: jdbc:drill:zk=local> 
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)