You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/09/14 18:05:21 UTC
[jira] [Commented] (CARBONDATA-240) Use SQLContext to query
CarbonData directly without creating table
[ https://issues.apache.org/jira/browse/CARBONDATA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15491077#comment-15491077 ]
ASF GitHub Bot commented on CARBONDATA-240:
-------------------------------------------
GitHub user jackylk opened a pull request:
https://github.com/apache/incubator-carbondata/pull/157
[CARBONDATA-240] Use SQLContext to query CarbonData directly without creating table
When using Spark 1.6, user can use SQLContext to query CarbonData files directly without creating table:
```
// This requires Spark 1.6 or later version to run
val sqlContext = new SQLContext(sc)
sqlContext.sql(
"""
| SELECT c1, c2, count(*)
| FROM carbondata.`./examples/target/store/default/table1`
| WHERE c3 > 100
| GROUP BY c1, c2
""".stripMargin).show
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jackylk/incubator-carbondata direct
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-carbondata/pull/157.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #157
----
commit 9293e1b5c0c6c14b5f3d8f7aec89a812d785a452
Author: jackylk <ja...@huawei.com>
Date: 2016-09-05T15:36:04Z
use SqlContext for read
commit f0f7a4a2f0144dc1088ba2e8c6d4a606dc50a36a
Author: jackylk <ja...@huawei.com>
Date: 2016-09-05T15:43:30Z
revert CarbonScan
commit cc6c749115c35effed493d9064d982438c11cb59
Author: jackylk <ja...@huawei.com>
Date: 2016-09-05T15:45:33Z
add class
commit c53b2ef268b487f602350d4c93bc3cdda70e8c39
Author: jackylk <ja...@huawei.com>
Date: 2016-09-05T16:36:13Z
fix stylecheck
commit acb3ac2d0a5caf665835f08a69fbe375a7c00c40
Author: jackylk <ja...@huawei.com>
Date: 2016-09-06T12:30:24Z
use path only
commit 2fad8ba0ad99f9a36d67592342ddcb741dcde7a0
Author: jackylk <ja...@huawei.com>
Date: 2016-09-10T00:26:25Z
directly run SQL
commit 5421475642c94d0eba7a676afb98247ada7091fd
Author: jackylk <ja...@huawei.com>
Date: 2016-09-10T04:11:24Z
add CarbonDataFrameWriter
commit 89ef52816a5b5c5fc465206805a11cace41817bd
Author: jackylk <ja...@huawei.com>
Date: 2016-09-10T04:31:54Z
rebase
commit b9a40eb33545b4842e20353d657b125cd55b8c41
Author: jackylk <ja...@huawei.com>
Date: 2016-09-10T04:48:14Z
modify testcase
commit c29288d5b5e092afea9e5cd10053b7829ba44b17
Author: jackylk <ja...@huawei.com>
Date: 2016-09-12T15:13:40Z
revert API
commit d7af4603b2df4fc2593413bbb90a495084c88010
Author: jackylk <ja...@huawei.com>
Date: 2016-09-12T15:14:20Z
Merge branch 'master' of https://github.com/apache/incubator-carbondata into ds1
commit f158f84b8336780fb2960191e4b1b238707c6d54
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T01:45:38Z
Merge branch 'direct' of https://github.com/jackylk/incubator-carbondata into direct
commit 8c26ab03103939c13d4b941887024f3231477be8
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T01:55:57Z
add testcase
commit 7a7728bdd8ed1f5c6d9ef63d2b4e5231677ad60e
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T02:56:20Z
add testcase
commit 7588b1113ab18f180002813eff4452a6040dee17
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T08:54:13Z
modify testcase
commit d66cb8b1bc811bd72f0109ba9bb096175a39698c
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T08:56:37Z
support windows
commit 53f32bd8577f50043c677a3ab1b3bedde2f8f0ed
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T14:17:02Z
Merge branch 'ds1' of https://github.com/jackylk/incubator-carbondata into direct
commit adb6a57192688d65461dfe7e649f392190e29426
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T14:26:09Z
add example
commit d648ff57b882dc022f6c58e94a8b1b312ce2fccb
Author: jackylk <ja...@huawei.com>
Date: 2016-09-13T14:26:46Z
change pom.xml
commit 856ee529ab2f9d1814efbb9d6cdfc7a9f518a287
Author: jackylk <ja...@huawei.com>
Date: 2016-09-14T16:52:03Z
rebase
commit 90f7eaa2b57140e04feb092308c68c2ee71bd378
Author: jackylk <ja...@huawei.com>
Date: 2016-09-14T17:44:07Z
fix style
----
> Use SQLContext to query CarbonData directly without creating table
> ------------------------------------------------------------------
>
> Key: CARBONDATA-240
> URL: https://issues.apache.org/jira/browse/CARBONDATA-240
> Project: CarbonData
> Issue Type: New Feature
> Reporter: Jacky Li
> Fix For: 0.2.0-incubating
>
>
> When using Spark 1.6, user can use SQLContext to query CarbonData files directly without creating table
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)