You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by GitBox <gi...@apache.org> on 2020/05/06 09:24:00 UTC

[GitHub] [carbondata] Indhumathi27 opened a new pull request #3747: [WIP] Load data to SI and MV after insert stage command

Indhumathi27 opened a new pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747


    ### Why is this PR needed?
    
    
    ### What changes were proposed in this PR?
   
       
    ### Does this PR introduce any user interface change?
    - No
    - Yes. (please explain the change and update document)
   
    ### Is any new testcase added?
    - No
    - Yes
   
       
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] Indhumathi27 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
Indhumathi27 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-626613653


   retest this please


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [WIP] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-624600274


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1231/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-626613469


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2992/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-624701113


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2957/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] Indhumathi27 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
Indhumathi27 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-626147659


   @akashrn5 @kunal642 Please help to review and merge


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-626676584


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2999/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-624769982


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2962/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] niuge01 commented on a change in pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
niuge01 commented on a change in pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#discussion_r420840109



##########
File path: integration/spark/src/main/scala/org/apache/spark/sql/events/MergeIndexEventListener.scala
##########
@@ -43,6 +43,11 @@ class MergeIndexEventListener extends OperationEventListener with Logging {
   override def onEvent(event: Event, operationContext: OperationContext): Unit = {
     event match {
       case preStatusUpdateEvent: LoadTablePreStatusUpdateEvent =>
+        // skip merge index in case of insert stage flow
+        if (null != operationContext.getProperty("isInsertStage") &&

Review comment:
       Define "isInsertStage" as a constant will be better.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [WIP] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-624594647


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2949/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-626612748


   Build Failed  with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1273/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] akashrn5 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
akashrn5 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-626518707


   @Indhumathi27 please resolve conflicts


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] niuge01 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
niuge01 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-624687020


   so much control properties


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] Indhumathi27 commented on a change in pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
Indhumathi27 commented on a change in pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#discussion_r420849896



##########
File path: integration/spark/src/main/scala/org/apache/spark/sql/events/MergeIndexEventListener.scala
##########
@@ -43,6 +43,11 @@ class MergeIndexEventListener extends OperationEventListener with Logging {
   override def onEvent(event: Event, operationContext: OperationContext): Unit = {
     event match {
       case preStatusUpdateEvent: LoadTablePreStatusUpdateEvent =>
+        // skip merge index in case of insert stage flow
+        if (null != operationContext.getProperty("isInsertStage") &&

Review comment:
       done




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-626676809


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1280/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3747: [CARBONDATA-3800] Load data to SI and MV after insert stage command

Posted by GitBox <gi...@apache.org>.
CarbonDataQA1 commented on pull request #3747:
URL: https://github.com/apache/carbondata/pull/3747#issuecomment-624770423


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1243/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org