You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by mayankshete <ma...@yash.com> on 2016/04/29 07:43:33 UTC
Create multiple output files from Thriftserver
Is there a way to create multiple output files when connected from beeline to
the Thriftserver ?
Right now i am using beeline -e 'query' > output.txt which is not efficient
as it uses linux operator to combine output files .
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Create-multiple-output-files-from-Thriftserver-tp26845.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Create multiple output files from Thriftserver
Posted by Mich Talebzadeh <mi...@gmail.com>.
Hi,
Two points here.
1) Beeline uses JDBC connection to connect to hive server. You can actually
put your code in an hql file and run it as
beeline -u jdbc:hive2://<HOST>:10010/default
org.apache.hive.jdbc.HiveDriver -n hduser -p xxxxx -f mycode,hql
2) How do you want to split your output file. Is is based on the results of
your query?
HTH
Dr Mich Talebzadeh
LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
On 29 April 2016 at 06:43, mayankshete <ma...@yash.com> wrote:
> Is there a way to create multiple output files when connected from beeline
> to
> the Thriftserver ?
> Right now i am using beeline -e 'query' > output.txt which is not efficient
> as it uses linux operator to combine output files .
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Create-multiple-output-files-from-Thriftserver-tp26845.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>