You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by ashwini-krishnakumar <gi...@git.apache.org> on 2017/08/29 08:38:37 UTC
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
GitHub user ashwini-krishnakumar opened a pull request:
https://github.com/apache/carbondata/pull/1296
[CARBONDATA-649] fix for update with rand function
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[CARBONDATA-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
- [ ] Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests are required?
- What manual testing you have done?
- Any additional information to help reviewers in testing this change.
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ashwini-krishnakumar/carbondata master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1296.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1296
----
commit 40e897008fdb4922f5db84a239d9af482fec03d8
Author: ashwini-krishnakumar <as...@gmail.com>
Date: 2017-08-28T13:31:00Z
Changes for CARBONDATA-649
commit 5e162d315e9b38a427e5ecad43a5bdd6a973fb3d
Author: ashwini-krishnakumar <as...@gmail.com>
Date: 2017-08-29T08:14:46Z
deleted redundant data file
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/596/
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
Can one of the admins verify this patch?
---
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/carbondata/pull/1296
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by CarbonDataQA <gi...@git.apache.org>.
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1296
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
@ashwini-krishnakumar Please amend all comments as single comment. There is an issue while merging to master.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by CarbonDataQA <gi...@git.apache.org>.
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1296
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
LGTM
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ashwini-krishnakumar <gi...@git.apache.org>.
Github user ashwini-krishnakumar commented on the issue:
https://github.com/apache/carbondata/pull/1296
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ashwini-krishnakumar <gi...@git.apache.org>.
Github user ashwini-krishnakumar commented on the issue:
https://github.com/apache/carbondata/pull/1296
@ravipesala please review
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ashwini-krishnakumar <gi...@git.apache.org>.
Github user ashwini-krishnakumar commented on the issue:
https://github.com/apache/carbondata/pull/1296
Updated UpdateCarbonTableTestCase.scala to use an existing csv file
---
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
Posted by ashwini-krishnakumar <gi...@git.apache.org>.
Github user ashwini-krishnakumar closed the pull request at:
https://github.com/apache/carbondata/pull/1296
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
Can one of the admins verify this patch?
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by CarbonDataQA <gi...@git.apache.org>.
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1296
SDV Build Success with Spark 2.1, Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/364/
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by CarbonDataQA <gi...@git.apache.org>.
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1296
Can one of the admins verify this patch?
---
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1296#discussion_r137919323
--- Diff: integration/spark-common-test/src/test/scala/org/apache/carbondata/spark/testsuite/iud/UpdateCarbonTableTestCase.scala ---
@@ -434,6 +434,43 @@ class UpdateCarbonTableTestCase extends QueryTest with BeforeAndAfterAll {
sql("DROP TABLE IF EXISTS default.carbon1")
}
+ test("update table in carbondata with rand() ") {
+ sql(
+ s"""CREATE TABLE if not exists rand (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string,
+ | DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,
+ | DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double,
+ | Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format'
+ | TBLPROPERTIES('DICTIONARY_INCLUDE'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,
+ | BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1')"""
+ .stripMargin).collect()
+
+ sql(s"""LOAD DATA INPATH '$resourcesPath/IUD/2000_UniqData.csv' into table rand OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1')""").collect
--- End diff --
Try to use the csv files which are already existed for this testcase. I don't see any reason to add new csv for this simple testcase.
---
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on a diff in the pull request:
https://github.com/apache/carbondata/pull/1296#discussion_r136291191
--- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/optimizer/CarbonLateDecodeRule.scala ---
@@ -841,3 +868,45 @@ case class CarbonDecoderRelation(
lazy val dictionaryMap = carbonRelation.carbonRelation.metaData.dictionaryMap
}
+
--- End diff --
Move this class dummy class out of this class
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by CarbonDataQA <gi...@git.apache.org>.
Github user CarbonDataQA commented on the issue:
https://github.com/apache/carbondata/pull/1296
Can one of the admins verify this patch?
---
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
Posted by ashwini-krishnakumar <gi...@git.apache.org>.
GitHub user ashwini-krishnakumar reopened a pull request:
https://github.com/apache/carbondata/pull/1296
[CARBONDATA-649] fix for update with rand function
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[CARBONDATA-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
- [ ] Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests are required?
- What manual testing you have done?
- Any additional information to help reviewers in testing this change.
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ashwini-krishnakumar/carbondata master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1296.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1296
----
commit 91c593ded84642a25cd35454bf2230d162d6e27b
Author: ashwini-krishnakumar <as...@gmail.com>
Date: 2017-09-07T07:36:32Z
CARBONDATA-649 fix for update with rand()
----
---
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
Posted by ashwini-krishnakumar <gi...@git.apache.org>.
GitHub user ashwini-krishnakumar reopened a pull request:
https://github.com/apache/carbondata/pull/1296
[CARBONDATA-649] fix for update with rand function
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[CARBONDATA-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
- [ ] Testing done
Please provide details on
- Whether new unit test cases have been added or why no new tests are required?
- What manual testing you have done?
- Any additional information to help reviewers in testing this change.
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ashwini-krishnakumar/carbondata master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1296.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1296
----
commit dac71d967f65e600d85c7d89729dbcc604106698
Author: ashwini-krishnakumar <as...@gmail.com>
Date: 2017-09-07T07:36:32Z
CARBONDATA-649 fix for update with rand()
updated testcase to reuse the existing data file
----
---
[GitHub] carbondata pull request #1296: [CARBONDATA-649] fix for update with rand fun...
Posted by ashwini-krishnakumar <gi...@git.apache.org>.
Github user ashwini-krishnakumar closed the pull request at:
https://github.com/apache/carbondata/pull/1296
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
LGTM
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/653/
---
[GitHub] carbondata issue #1296: [CARBONDATA-649] fix for update with rand function
Posted by ravipesala <gi...@git.apache.org>.
Github user ravipesala commented on the issue:
https://github.com/apache/carbondata/pull/1296
@ashwini-krishnakumar Please amend all comments as single comment. There is an issue while merging to master.
---