You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 林志佳,
,
Forest,
,
Fo...@trendy-global.com on 2019/02/01 07:18:22 UTC
Re:where to put the jdbc driver jar for pushdown
Hi,
select count(*) from KYLIN_CAL_DT won’t pushdown to presto, while I’d want to resolve the problem of pushdown query from kylin to presto.
The problem seems is kylin transforming double quote (“) to back quote (`)
Regards
Forest
发件人: JiaTao Tao [mailto:taojiatao@gmail.com]
发送时间: 2019年1月29日 13:49
收件人: user@kylin.apache.org
抄送: nichunen
主题: Re: Re:where to put the jdbc driver jar for pushdown
Hi, just try "select count(*) from KYLIN_CAL_DT" in Kylin. You don't have to write database name if it is "DEFAULT".
By the way, Kylin is not for "select *" style query. See http://kylin.apache.org/docs/gettingstarted/faq.html (Why I got an error when running a “select * “ query?
)
林志佳[Forest Lin] <Fo...@trendy-global.com>> 于2019年1月29日周二 上午4:32写道：
Hi shaofeng,
Thanks advice. I run the query: select * from "DEFAULT"."KYLIN_CAL_DT" in kylin , which return error:
Query failed (#20190129_042512_00057_fft3i): line 1:15: backquoted identifiers are not supported; use double quotes to quote identifiers
In presto ui, seems kylin(Calcite) turn double quotes to backqoute which presto not supported.
[cid:image001.png@01D4BA41.5DE7CD20]
Thanks
Forest
发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org<ma...@apache.org>]
发送时间: 2019年1月28日 22:50
收件人: user
抄送: nichunen
主题: Re: Re:where to put the jdbc driver jar for pushdown
"default" is a keyword of Calcite. Please quote it with double quotation marks + in upper case: "DEFAULT"."KYLIN_CAL_DT"
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Work email: shaofeng.shi@kyligence.io
<ma...@kyligence.io>
Kyligence Inc: https://kyligence.io/
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>
林志佳[Forest Lin] <Fo...@trendy-global.com>> 于2019年1月28日周一 上午10:36写道：
I am using kylin 2.6.
Found that It is caused by the latest presto-jdbc-300.jar since the jdbc.drive is changed to “io.presto..” instead of “com.facebook..”
Kylin can connect to presto after using presto-jdbc-0.208.jar. However it can’t execute the pushdown query: select * from hive.default.KYLIN_CAL_DT to presto
With below error:
Encountered ". default" at line 1, column 19. Was expecting one of: <EOF> "ORDER" ... "LIMIT" ... "OFFSET" ... "FETCH" ... "NATURAL" ... "JOIN" ... "INNER" ... "LEFT" ... "RIGHT" ... "FULL" ... "CROSS" ... "," ... "OUTER" ... "EXTEND" ... "(" ... "MATCH_RECOGNIZE" ... "." ... "AS" ... <IDENTIFIER> ... <QUOTED_IDENTIFIER> ... <BACK_QUOTED_IDENTIFIER> ... <BRACKET_QUOTED_IDENTIFIER> ... <UNICODE_QUOTED_IDENTIFIER> ... "TABLESAMPLE" ... "WHERE" ... "GROUP" ... "HAVING" ... "WINDOW" ... "UNION" ... "INTERSECT" ... "EXCEPT" ... "MINUS" ... "." <IDENTIFIER> ... "." <QUOTED_IDENTIFIER> ... "." <BACK_QUOTED_IDENTIFIER> ... "." <BRACKET_QUOTED_IDENTIFIER> ... "." <UNICODE_QUOTED_IDENTIFIER> ... "." "*" ...
Best Regards,
Forest
发件人: ShaoFeng Shi [mailto:shaofengshi@apache.org<ma...@apache.org>]
发送时间: 2019年1月28日 9:28
收件人: user
抄送: nichunen
主题: Re: Re:where to put the jdbc driver jar for pushdown
zhijia,
What's your Kylin version? Did you ever modify Kylin's bash script? You can also try to put the jar into tomcat/webapps/kylin/WEB-INF/lib .
Best regards,
Shaofeng Shi 史少锋
Apache Kylin PMC
Work email: shaofeng.shi@kyligence.io
<ma...@kyligence.io>
Kyligence Inc: https://kyligence.io/
Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Join Kylin dev mail group: dev-subscribe@kylin.apache.org<ma...@kylin.apache.org>
Iñigo Martínez <im...@telecoming.com>> 于2019年1月24日周四 下午10:52写道：
At kylin.sh, you can see that you should locate new jar in $KYLIN_HOME/ext or $KYLIN_HOME/lib
export HBASE_CLASSPATH_PREFIX=${KYLIN_HOME}/conf:${KYLIN_HOME}/lib/*:${KYLIN_HOME}/ext/*:${HBASE_CLASSPATH_PREFIX}
However, if want to be sure, just add your extra library here:
#additionally add tomcat libs to HBASE_CLASSPATH_PREFIX
export HBASE_CLASSPATH_PREFIX=${tomcat_root}/bin/bootstrap.jar:${tomcat_root}/bin/tomcat-juli.jar:${tomcat_root}/lib/*:${HBASE_CLASSPATH_PREFIX}:/PATH/TO/YOUR/LIBRARY.jar
El jue., 24 ene. 2019 a las 15:37, 林志佳[Forest Lin] (<Fo...@trendy-global.com>>) escribió:
Yes, i did the restart but it does not work
thx,
Forest
---Original---
From: "nichunen"<ni...@apache.org>>
Date: Thu, Jan 24, 2019 20:10 PM
To: "user@kylin.apache.org<ma...@kylin.apache.org>>;
Subject: Re:where to put the jdbc driver jar for pushdown
Hi Forest,
As I know, put the jar to $KYLIN_HOME/ext should work, have you restarted your Kylin after that?
--
Best regards,
Ni Chunen / George
At 2019-01-24 18:54:42, "林志佳[Forest Lin]" <Fo...@trendy-global.com>> wrote:
Hi all,
I’d like to set kylin pushdown to presto, below is my setting.
kylin.query.pushdown.runner-class-name=org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl
#
kylin.query.pushdown.update-enabled=true
kylin.query.pushdown.jdbc.url=jdbc:presto://emr-header-1:9090/hive
kylin.query.pushdown.jdbc.driver=com.facebook.presto.jdbc.PrestoDriver
kylin.query.pushdown.jdbc.username=hive
kylin.query.pushdown.jdbc.password=
#
kylin.query.pushdown.jdbc.pool-max-total=8
kylin.query.pushdown.jdbc.pool-max-idle=8
kylin.query.pushdown.jdbc.pool-min-idle=0
However, in run time, it has error:
java.lang.RuntimeException: com.facebook.presto.jdbc.PrestoDriver
Caused by: java.lang.ClassNotFoundException: com.facebook.presto.jdbc.PrestoDriver
May I know where the presto-jdbc-300.jar should be put to ? I have try $KYLIN_HOME/ext and $KYLIN_HOME/lib, but no luck
Thanks
Forest
--
Íñigo Martínez
SYSTEMS MANAGER
imartinez@telecoming.com<mailto:imartinez@telecoming.com%3C>
[Telecoming - Make it digital]
[5000_empresas]
[1000_empresas]
Paseo de la Castellana, 95. Torre Europa, pl 16. 28046 Madrid, Spain |
telecoming.com<http://www.telecoming.com/>
Este correo electrónico y sus archivos adjuntos están dirigidos únicamente a la(s) dirección(es) indicada(s) anteriormente. El carácter confidencial, personal e intransferible del mismo está protegido legalmente. Cualquier publicación, reproducción, distribución o retransmisión no autorizada, ya sea completa o en parte, se encuentra prohibida. Si ha recibido este mensaje por equivocación, notifíquelo inmediatamente a la persona que lo ha enviado y borre el mensaje original junto con sus ficheros anexos sin leerlo ni grabarlo en modo alguno.
--
Regards!
Aron Tao