You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by 251469031 <25...@qq.com> on 2016/12/19 06:32:56 UTC
How to compile the latest source code of carbondata
Hi all:
I've tried to comple the latest source code followed by the toturial: https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start , but it doesn't work on the latest source code on the github.
Would you send me some toturial about how to do this or tell me how to use carbondata, thx~
回复： How to compile the latest source code of carbondata
Posted by 251469031 <25...@qq.com>.
Thx liang.
I solve the problem.
In the file carbon-spark-shell, FWDIR was set to $SPARK_HOME. I have configure the $SPARK_HOME in /etc/profile and the output of command "echo $SPARK_HOME" is correct, which mean the $SPARK_HOME has been set.
But if I don't run the command "export $SPARK_HOME=...." before running the command "./bin/carbon-spark-shell", the variable FWDIR can't be set. I doult why it is.
------------------ 原始邮件 ------------------
发件人: "";<25...@qq.com>;
发送时间: 2016年12月19日(星期一) 下午4:02
收件人: "dev"<de...@carbondata.incubator.apache.org>;
主题: 回复： How to compile the latest source code of carbondata
I can visit spark web-ui http://master:8080/
if there are any other environment that I should config.
------------------ 原始邮件 ------------------
发件人: "Liang Chen";<ch...@gmail.com>;
发送时间: 2016年12月19日(星期一) 下午3:40
收件人: "dev"<de...@carbondata.incubator.apache.org>;
主题: Re: How to compile the latest source code of carbondata
Hi
Please check your spark environment if it is ready ?
2016-12-19 15:34 GMT+08:00 251469031 <25...@qq.com>:
> the privileges of the folder "carbondata" is:
>
>
> drwxr-xr-x 18 hadoop hadoop 4096 Dec 19 14:56 carbondata
>
>
> and hadoop is the user who run maven.
>
>
> well, after run mvn command, I get the info from console as follows:
>
>
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache CarbonData :: Parent ........................ SUCCESS [
> 1.012 s]
> [INFO] Apache CarbonData :: Common ........................ SUCCESS [
> 2.066 s]
> [INFO] Apache CarbonData :: Core .......................... SUCCESS [
> 5.512 s]
> [INFO] Apache CarbonData :: Processing .................... SUCCESS [
> 1.892 s]
> [INFO] Apache CarbonData :: Hadoop ........................ SUCCESS [
> 0.789 s]
> [INFO] Apache CarbonData :: Spark Common .................. SUCCESS [
> 17.121 s]
> [INFO] Apache CarbonData :: Spark ......................... SUCCESS [
> 33.269 s]
> [INFO] Apache CarbonData :: Assembly ...................... SUCCESS [
> 17.700 s]
> [INFO] Apache CarbonData :: Spark Examples ................ SUCCESS [
> 7.741 s]
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 01:27 min
> [INFO] Finished at: 2016-12-19T14:57:26+08:00
> [INFO] Final Memory: 83M/1623M
> [INFO] ------------------------------------------------------------
> ------------
>
>
>
> but I didn't find a file names spark-submit under the path carbondata/bin/:
>
>
> [hadoop@master ~]$ cd carbondata/bin/
> [hadoop@master bin]$ ll
> total 8
> -rwxrwxr-x 1 hadoop hadoop 3879 Dec 19 14:54 carbon-spark-shell
> -rwxrwxr-x 1 hadoop hadoop 2820 Dec 19 14:54 carbon-spark-sql
>
>
>
> is this phenomenon normal ?
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Liang Chen";<ch...@gmail.com>;
> 发送时间: 2016年12月19日(星期一) 下午3:19
> 收件人: "dev"<de...@carbondata.incubator.apache.org>;
>
> 主题: Re: How to compile the latest source code of carbondata
>
>
>
> Hi
>
> Please check if you have added the enough right for folder "carbondata"?
> ------------------------------------------------------------
> ---------------
> For spark 1.5, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
> step 1: git clone https://github.com/apache/incubator-carbondata.git
> carbondata
> step 2: mvn clean package -DskipTests -Pspark-1.5
> step 3: ./bin/carbon-spark-shell, and it turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
> 2016-12-19 15:05 GMT+08:00 251469031 <25...@qq.com>:
>
> > thx liang.
> >
> >
> > I've tried spark 2.0.0 and spark 1.5.0, my step & script is:
> >
> >
> > For spark 2.0, the compile process has no issue, but carbon-spark-shell
> > can not run correctly:
> >
> >
> > step 1: git clone https://github.com/apache/incubator-carbondata.git
> > carbondata
> > step 2: mvn clean package -DskipTests -Pspark-2.0
> > step 3: ./bin/carbon-spark-shell, and is turns out:
> >
> >
> > [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> > such file or directory
> > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> > such file or directory
> > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> > directory
> >
> >
> >
> > For spark 1.5, the compile process has no issue, but carbon-spark-shell
> > can not run correctly:
> > step 1: git clone https://github.com/apache/incubator-carbondata.git
> > carbondata
> > step 2: mvn clean package -DskipTests -Pspark-1.5
> > step 3: ./bin/carbon-spark-shell, and it turns out:
> >
> >
> > [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> > directory
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > ------------------ 原始邮件 ------------------
> > 发件人: "Liang Chen";<ch...@gmail.com>;
> > 发送时间: 2016年12月19日(星期一) 下午2:37
> > 收件人: "dev"<de...@carbondata.incubator.apache.org>;
> >
> > 主题: Re: How to compile the latest source code of carbondata
> >
> >
> >
> > Hi
> >
> > Can you share : do you get what errors and using which compile command?
> >
> > Regards
> > Liang
> >
> > 2016-12-19 14:32 GMT+08:00 251469031 <25...@qq.com>:
> >
> > > Hi all:
> > >
> > > I've tried to comple the latest source code followed by the
> toturial:
> > > https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start ,
> but
> > > it doesn't work on the latest source code on the github.
> > >
> > >
> > > Would you send me some toturial about how to do this or tell me how
> > to
> > > use carbondata, thx~
> >
> >
> >
> >
> > --
> > Regards
> > Liang
>
>
>
>
> --
> Regards
> Liang
--
Regards
Liang
回复： How to compile the latest source code of carbondata
Posted by 251469031 <25...@qq.com>.
I can visit spark web-ui http://master:8080/
if there are any other environment that I should config.
------------------ 原始邮件 ------------------
发件人: "Liang Chen";<ch...@gmail.com>;
发送时间: 2016年12月19日(星期一) 下午3:40
收件人: "dev"<de...@carbondata.incubator.apache.org>;
主题: Re: How to compile the latest source code of carbondata
Hi
Please check your spark environment if it is ready ?
2016-12-19 15:34 GMT+08:00 251469031 <25...@qq.com>:
> the privileges of the folder "carbondata" is:
>
>
> drwxr-xr-x 18 hadoop hadoop 4096 Dec 19 14:56 carbondata
>
>
> and hadoop is the user who run maven.
>
>
> well, after run mvn command, I get the info from console as follows:
>
>
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache CarbonData :: Parent ........................ SUCCESS [
> 1.012 s]
> [INFO] Apache CarbonData :: Common ........................ SUCCESS [
> 2.066 s]
> [INFO] Apache CarbonData :: Core .......................... SUCCESS [
> 5.512 s]
> [INFO] Apache CarbonData :: Processing .................... SUCCESS [
> 1.892 s]
> [INFO] Apache CarbonData :: Hadoop ........................ SUCCESS [
> 0.789 s]
> [INFO] Apache CarbonData :: Spark Common .................. SUCCESS [
> 17.121 s]
> [INFO] Apache CarbonData :: Spark ......................... SUCCESS [
> 33.269 s]
> [INFO] Apache CarbonData :: Assembly ...................... SUCCESS [
> 17.700 s]
> [INFO] Apache CarbonData :: Spark Examples ................ SUCCESS [
> 7.741 s]
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 01:27 min
> [INFO] Finished at: 2016-12-19T14:57:26+08:00
> [INFO] Final Memory: 83M/1623M
> [INFO] ------------------------------------------------------------
> ------------
>
>
>
> but I didn't find a file names spark-submit under the path carbondata/bin/:
>
>
> [hadoop@master ~]$ cd carbondata/bin/
> [hadoop@master bin]$ ll
> total 8
> -rwxrwxr-x 1 hadoop hadoop 3879 Dec 19 14:54 carbon-spark-shell
> -rwxrwxr-x 1 hadoop hadoop 2820 Dec 19 14:54 carbon-spark-sql
>
>
>
> is this phenomenon normal ?
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Liang Chen";<ch...@gmail.com>;
> 发送时间: 2016年12月19日(星期一) 下午3:19
> 收件人: "dev"<de...@carbondata.incubator.apache.org>;
>
> 主题: Re: How to compile the latest source code of carbondata
>
>
>
> Hi
>
> Please check if you have added the enough right for folder "carbondata"?
> ------------------------------------------------------------
> ---------------
> For spark 1.5, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
> step 1: git clone https://github.com/apache/incubator-carbondata.git
> carbondata
> step 2: mvn clean package -DskipTests -Pspark-1.5
> step 3: ./bin/carbon-spark-shell, and it turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
> 2016-12-19 15:05 GMT+08:00 251469031 <25...@qq.com>:
>
> > thx liang.
> >
> >
> > I've tried spark 2.0.0 and spark 1.5.0, my step & script is:
> >
> >
> > For spark 2.0, the compile process has no issue, but carbon-spark-shell
> > can not run correctly:
> >
> >
> > step 1: git clone https://github.com/apache/incubator-carbondata.git
> > carbondata
> > step 2: mvn clean package -DskipTests -Pspark-2.0
> > step 3: ./bin/carbon-spark-shell, and is turns out:
> >
> >
> > [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> > such file or directory
> > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> > such file or directory
> > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> > directory
> >
> >
> >
> > For spark 1.5, the compile process has no issue, but carbon-spark-shell
> > can not run correctly:
> > step 1: git clone https://github.com/apache/incubator-carbondata.git
> > carbondata
> > step 2: mvn clean package -DskipTests -Pspark-1.5
> > step 3: ./bin/carbon-spark-shell, and it turns out:
> >
> >
> > [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> > directory
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > ------------------ 原始邮件 ------------------
> > 发件人: "Liang Chen";<ch...@gmail.com>;
> > 发送时间: 2016年12月19日(星期一) 下午2:37
> > 收件人: "dev"<de...@carbondata.incubator.apache.org>;
> >
> > 主题: Re: How to compile the latest source code of carbondata
> >
> >
> >
> > Hi
> >
> > Can you share : do you get what errors and using which compile command?
> >
> > Regards
> > Liang
> >
> > 2016-12-19 14:32 GMT+08:00 251469031 <25...@qq.com>:
> >
> > > Hi all:
> > >
> > > I've tried to comple the latest source code followed by the
> toturial:
> > > https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start ,
> but
> > > it doesn't work on the latest source code on the github.
> > >
> > >
> > > Would you send me some toturial about how to do this or tell me how
> > to
> > > use carbondata, thx~
> >
> >
> >
> >
> > --
> > Regards
> > Liang
>
>
>
>
> --
> Regards
> Liang
--
Regards
Liang
Re: How to compile the latest source code of carbondata
Posted by Liang Chen <ch...@gmail.com>.
Hi
Please check your spark environment if it is ready ?
2016-12-19 15:34 GMT+08:00 251469031 <25...@qq.com>:
> the privileges of the folder "carbondata" is:
>
>
> drwxr-xr-x 18 hadoop hadoop 4096 Dec 19 14:56 carbondata
>
>
> and hadoop is the user who run maven.
>
>
> well, after run mvn command, I get the info from console as follows:
>
>
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache CarbonData :: Parent ........................ SUCCESS [
> 1.012 s]
> [INFO] Apache CarbonData :: Common ........................ SUCCESS [
> 2.066 s]
> [INFO] Apache CarbonData :: Core .......................... SUCCESS [
> 5.512 s]
> [INFO] Apache CarbonData :: Processing .................... SUCCESS [
> 1.892 s]
> [INFO] Apache CarbonData :: Hadoop ........................ SUCCESS [
> 0.789 s]
> [INFO] Apache CarbonData :: Spark Common .................. SUCCESS [
> 17.121 s]
> [INFO] Apache CarbonData :: Spark ......................... SUCCESS [
> 33.269 s]
> [INFO] Apache CarbonData :: Assembly ...................... SUCCESS [
> 17.700 s]
> [INFO] Apache CarbonData :: Spark Examples ................ SUCCESS [
> 7.741 s]
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Total time: 01:27 min
> [INFO] Finished at: 2016-12-19T14:57:26+08:00
> [INFO] Final Memory: 83M/1623M
> [INFO] ------------------------------------------------------------
> ------------
>
>
>
> but I didn't find a file names spark-submit under the path carbondata/bin/:
>
>
> [hadoop@master ~]$ cd carbondata/bin/
> [hadoop@master bin]$ ll
> total 8
> -rwxrwxr-x 1 hadoop hadoop 3879 Dec 19 14:54 carbon-spark-shell
> -rwxrwxr-x 1 hadoop hadoop 2820 Dec 19 14:54 carbon-spark-sql
>
>
>
> is this phenomenon normal ?
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Liang Chen";<ch...@gmail.com>;
> 发送时间: 2016年12月19日(星期一) 下午3:19
> 收件人: "dev"<de...@carbondata.incubator.apache.org>;
>
> 主题: Re: How to compile the latest source code of carbondata
>
>
>
> Hi
>
> Please check if you have added the enough right for folder "carbondata"?
> ------------------------------------------------------------
> ---------------
> For spark 1.5, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
> step 1: git clone https://github.com/apache/incubator-carbondata.git
> carbondata
> step 2: mvn clean package -DskipTests -Pspark-1.5
> step 3: ./bin/carbon-spark-shell, and it turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
> 2016-12-19 15:05 GMT+08:00 251469031 <25...@qq.com>:
>
> > thx liang.
> >
> >
> > I've tried spark 2.0.0 and spark 1.5.0, my step & script is:
> >
> >
> > For spark 2.0, the compile process has no issue, but carbon-spark-shell
> > can not run correctly:
> >
> >
> > step 1: git clone https://github.com/apache/incubator-carbondata.git
> > carbondata
> > step 2: mvn clean package -DskipTests -Pspark-2.0
> > step 3: ./bin/carbon-spark-shell, and is turns out:
> >
> >
> > [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> > such file or directory
> > ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> > such file or directory
> > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> > directory
> >
> >
> >
> > For spark 1.5, the compile process has no issue, but carbon-spark-shell
> > can not run correctly:
> > step 1: git clone https://github.com/apache/incubator-carbondata.git
> > carbondata
> > step 2: mvn clean package -DskipTests -Pspark-1.5
> > step 3: ./bin/carbon-spark-shell, and it turns out:
> >
> >
> > [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> > ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> > directory
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > ------------------ 原始邮件 ------------------
> > 发件人: "Liang Chen";<ch...@gmail.com>;
> > 发送时间: 2016年12月19日(星期一) 下午2:37
> > 收件人: "dev"<de...@carbondata.incubator.apache.org>;
> >
> > 主题: Re: How to compile the latest source code of carbondata
> >
> >
> >
> > Hi
> >
> > Can you share : do you get what errors and using which compile command?
> >
> > Regards
> > Liang
> >
> > 2016-12-19 14:32 GMT+08:00 251469031 <25...@qq.com>:
> >
> > > Hi all:
> > >
> > > I've tried to comple the latest source code followed by the
> toturial:
> > > https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start ,
> but
> > > it doesn't work on the latest source code on the github.
> > >
> > >
> > > Would you send me some toturial about how to do this or tell me how
> > to
> > > use carbondata, thx~
> >
> >
> >
> >
> > --
> > Regards
> > Liang
>
>
>
>
> --
> Regards
> Liang
--
Regards
Liang
回复： How to compile the latest source code of carbondata
Posted by 251469031 <25...@qq.com>.
the privileges of the folder "carbondata" is:
drwxr-xr-x 18 hadoop hadoop 4096 Dec 19 14:56 carbondata
and hadoop is the user who run maven.
well, after run mvn command, I get the info from console as follows:
[INFO] Reactor Summary:
[INFO]
[INFO] Apache CarbonData :: Parent ........................ SUCCESS [ 1.012 s]
[INFO] Apache CarbonData :: Common ........................ SUCCESS [ 2.066 s]
[INFO] Apache CarbonData :: Core .......................... SUCCESS [ 5.512 s]
[INFO] Apache CarbonData :: Processing .................... SUCCESS [ 1.892 s]
[INFO] Apache CarbonData :: Hadoop ........................ SUCCESS [ 0.789 s]
[INFO] Apache CarbonData :: Spark Common .................. SUCCESS [ 17.121 s]
[INFO] Apache CarbonData :: Spark ......................... SUCCESS [ 33.269 s]
[INFO] Apache CarbonData :: Assembly ...................... SUCCESS [ 17.700 s]
[INFO] Apache CarbonData :: Spark Examples ................ SUCCESS [ 7.741 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:27 min
[INFO] Finished at: 2016-12-19T14:57:26+08:00
[INFO] Final Memory: 83M/1623M
[INFO] ------------------------------------------------------------------------
but I didn't find a file names spark-submit under the path carbondata/bin/:
[hadoop@master ~]$ cd carbondata/bin/
[hadoop@master bin]$ ll
total 8
-rwxrwxr-x 1 hadoop hadoop 3879 Dec 19 14:54 carbon-spark-shell
-rwxrwxr-x 1 hadoop hadoop 2820 Dec 19 14:54 carbon-spark-sql
is this phenomenon normal ?
------------------ 原始邮件 ------------------
发件人: "Liang Chen";<ch...@gmail.com>;
发送时间: 2016年12月19日(星期一) 下午3:19
收件人: "dev"<de...@carbondata.incubator.apache.org>;
主题: Re: How to compile the latest source code of carbondata
Hi
Please check if you have added the enough right for folder "carbondata"?
---------------------------------------------------------------------------
For spark 1.5, the compile process has no issue, but carbon-spark-shell
can not run correctly:
step 1: git clone https://github.com/apache/incubator-carbondata.git
carbondata
step 2: mvn clean package -DskipTests -Pspark-1.5
step 3: ./bin/carbon-spark-shell, and it turns out:
[hadoop@master carbondata]$ ./bin/carbon-spark-shell
./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
directory
2016-12-19 15:05 GMT+08:00 251469031 <25...@qq.com>:
> thx liang.
>
>
> I've tried spark 2.0.0 and spark 1.5.0, my step & script is:
>
>
> For spark 2.0, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
>
>
> step 1: git clone https://github.com/apache/incubator-carbondata.git
> carbondata
> step 2: mvn clean package -DskipTests -Pspark-2.0
> step 3: ./bin/carbon-spark-shell, and is turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> such file or directory
> ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> such file or directory
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
>
>
> For spark 1.5, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
> step 1: git clone https://github.com/apache/incubator-carbondata.git
> carbondata
> step 2: mvn clean package -DskipTests -Pspark-1.5
> step 3: ./bin/carbon-spark-shell, and it turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
>
>
>
>
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Liang Chen";<ch...@gmail.com>;
> 发送时间: 2016年12月19日(星期一) 下午2:37
> 收件人: "dev"<de...@carbondata.incubator.apache.org>;
>
> 主题: Re: How to compile the latest source code of carbondata
>
>
>
> Hi
>
> Can you share : do you get what errors and using which compile command?
>
> Regards
> Liang
>
> 2016-12-19 14:32 GMT+08:00 251469031 <25...@qq.com>:
>
> > Hi all:
> >
> > I've tried to comple the latest source code followed by the toturial:
> > https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start , but
> > it doesn't work on the latest source code on the github.
> >
> >
> > Would you send me some toturial about how to do this or tell me how
> to
> > use carbondata, thx~
>
>
>
>
> --
> Regards
> Liang
--
Regards
Liang
Re: How to compile the latest source code of carbondata
Posted by Liang Chen <ch...@gmail.com>.
Hi
Please check if you have added the enough right for folder "carbondata"?
---------------------------------------------------------------------------
For spark 1.5, the compile process has no issue, but carbon-spark-shell
can not run correctly:
step 1: git clone https://github.com/apache/incubator-carbondata.git
carbondata
step 2: mvn clean package -DskipTests -Pspark-1.5
step 3: ./bin/carbon-spark-shell, and it turns out:
[hadoop@master carbondata]$ ./bin/carbon-spark-shell
./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
directory
2016-12-19 15:05 GMT+08:00 251469031 <25...@qq.com>:
> thx liang.
>
>
> I've tried spark 2.0.0 and spark 1.5.0, my step & script is:
>
>
> For spark 2.0, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
>
>
> step 1: git clone https://github.com/apache/incubator-carbondata.git
> carbondata
> step 2: mvn clean package -DskipTests -Pspark-2.0
> step 3: ./bin/carbon-spark-shell, and is turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> such file or directory
> ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> such file or directory
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
>
>
> For spark 1.5, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
> step 1: git clone https://github.com/apache/incubator-carbondata.git
> carbondata
> step 2: mvn clean package -DskipTests -Pspark-1.5
> step 3: ./bin/carbon-spark-shell, and it turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
>
>
>
>
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Liang Chen";<ch...@gmail.com>;
> 发送时间: 2016年12月19日(星期一) 下午2:37
> 收件人: "dev"<de...@carbondata.incubator.apache.org>;
>
> 主题: Re: How to compile the latest source code of carbondata
>
>
>
> Hi
>
> Can you share : do you get what errors and using which compile command?
>
> Regards
> Liang
>
> 2016-12-19 14:32 GMT+08:00 251469031 <25...@qq.com>:
>
> > Hi all:
> >
> > I've tried to comple the latest source code followed by the toturial:
> > https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start , but
> > it doesn't work on the latest source code on the github.
> >
> >
> > Would you send me some toturial about how to do this or tell me how
> to
> > use carbondata, thx~
>
>
>
>
> --
> Regards
> Liang
--
Regards
Liang
回复： How to compile the latest source code of carbondata
Posted by 251469031 <25...@qq.com>.
thx liang.
I've tried spark 2.0.0 and spark 1.5.0, my step & script is:
For spark 2.0, the compile process has no issue, but carbon-spark-shell can not run correctly:
step 1: git clone https://github.com/apache/incubator-carbondata.git carbondata
step 2: mvn clean package -DskipTests -Pspark-2.0
step 3: ./bin/carbon-spark-shell, and is turns out:
[hadoop@master carbondata]$ ./bin/carbon-spark-shell
ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No such file or directory
ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No such file or directory
./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or directory
For spark 1.5, the compile process has no issue, but carbon-spark-shell can not run correctly:
step 1: git clone https://github.com/apache/incubator-carbondata.git carbondata
step 2: mvn clean package -DskipTests -Pspark-1.5
step 3: ./bin/carbon-spark-shell, and it turns out:
[hadoop@master carbondata]$ ./bin/carbon-spark-shell
./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or directory
------------------ 原始邮件 ------------------
发件人: "Liang Chen";<ch...@gmail.com>;
发送时间: 2016年12月19日(星期一) 下午2:37
收件人: "dev"<de...@carbondata.incubator.apache.org>;
主题: Re: How to compile the latest source code of carbondata
Hi
Can you share : do you get what errors and using which compile command?
Regards
Liang
2016-12-19 14:32 GMT+08:00 251469031 <25...@qq.com>:
> Hi all:
>
> I've tried to comple the latest source code followed by the toturial:
> https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start , but
> it doesn't work on the latest source code on the github.
>
>
> Would you send me some toturial about how to do this or tell me how to
> use carbondata, thx~
--
Regards
Liang
Re: How to compile the latest source code of carbondata
Posted by Liang Chen <ch...@gmail.com>.
Hi
Can you share : do you get what errors and using which compile command?
Regards
Liang
2016-12-19 14:32 GMT+08:00 251469031 <25...@qq.com>:
> Hi all:
>
> I've tried to comple the latest source code followed by the toturial:
> https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start , but
> it doesn't work on the latest source code on the github.
>
>
> Would you send me some toturial about how to do this or tell me how to
> use carbondata, thx~
--
Regards
Liang