You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/04/28 04:43:52 UTC

[GitHub] [incubator-dolphinscheduler] wanghongwei9538 opened a new issue #2551: 执行sql节点问题

wanghongwei9538 opened a new issue #2551:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2551


   执行sql节点配置成非查询的，怎么set hive/spark的参数信息，没有找到相关的文档说明


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] liukunyuan commented on issue #2551: Problems in executing SQL nodes（执行sql节点问题）

Posted by GitBox <gi...@apache.org>.
liukunyuan commented on issue #2551:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2551#issuecomment-750867174


   you can execute it with a shell node
   你可以把你sql写到一个文件中，通过hive -f执行这个sql文件


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] chengshiwen commented on issue #2551: Problems in executing SQL nodes（执行sql节点问题）

Posted by GitBox <gi...@apache.org>.
chengshiwen commented on issue #2551:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2551#issuecomment-817119799


   Close the issue since it has been solved


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #2551: Problems in executing SQL nodes（执行sql节点问题）

Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #2551:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2551#issuecomment-620480548


   which paramters do you want to set?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] liukunyuan commented on issue #2551: Problems in executing SQL nodes（执行sql节点问题）

Posted by GitBox <gi...@apache.org>.
liukunyuan commented on issue #2551:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2551#issuecomment-750718259


   set parameters before SQL.for example
   set mapred.max.split.size= 536870912;set mapred.min.split.size.per.node= 536870912;select '1';


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] chengshiwen closed issue #2551: Problems in executing SQL nodes（执行sql节点问题）

Posted by GitBox <gi...@apache.org>.
chengshiwen closed issue #2551:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2551


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] wanghongwei9538 commented on issue #2551: Problems in executing SQL nodes（执行sql节点问题）

Posted by GitBox <gi...@apache.org>.
wanghongwei9538 commented on issue #2551:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2551#issuecomment-620483367


   I want to set up：
   set mapred.max.split.size= 536870912;
   set mapred.min.split.size.per.node= 536870912;
   set mapred.min.split.size.per.rack= 536870912;
   set hive.input.format=org.apache.hadoop.hive.ql.io.CombineHiveInputFormat;
   set hive.exec.dynamic.partition=true;
   set hive.exec.dynamic.partition.mode=nostrick;
   set hive.exec.max.dynamic.partitions.pernode=2000;
   set hive.exec.reducers.max=200;
   set spark.sql.adaptive.enabled=true; 
   set spark.sql.adaptive.shuffle.targetPostShuffleInputSize=128000000;
   Before executing SQL


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org