You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by Srigopal Mohanty <sr...@gmail.com> on 2017/04/07 07:16:46 UTC
Getting Error in Cloudera Distribution
Hi Team,
Getting error after building the carbon data git repo the in Cloudera
distribution.
in spark-shell console -
<console>:25: error: object CarbonContext is not a member of package
org.apache.spark.sql
import org.apache.spark.sql.CarbonContext
Any pointers.
Thanks,
Srigopal
Re: Getting Error in Cloudera Distribution
Posted by Lu Cao <wh...@gmail.com>.
You only need to add the assembly jar, instead of the others you list.
4e.g.
assembly/target/scala-2.10/carbondata_2.10-1.1.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar
On Fri, Apr 7, 2017 at 4:28 PM, Srigopal Mohanty <sr...@gmail.com>
wrote:
> Spark version is 1.6
>
> Yes i am using spark-shell --jars <assembly jar path>
>
> The jars present are -
>
> - carbondata-common-1.1.0-incubating-SNAPSHOT.jar
> - carbondata-core-1.1.0-incubating-SNAPSHOT.jar
> - carbondata-hadoop-1.1.0-incubating-SNAPSHOT.jar
> - carbondata-processing-1.1.0-incubating-SNAPSHOT.jar
>
>
> On 07-Apr-2017 1:36 pm, "Lu Cao" <wh...@gmail.com> wrote:
>
> What's the spark version you're using?
> Did you add "--jars <carbon assembly jar>" when you start the spark shell?
>
> On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <
> srigopalmohanty@gmail.com>
> wrote:
>
> > Hi Lionel,
> >
> > I followed the same link. I am using cloudera sandbox, which is
> > preconfigured.
> >
> > CarbonData is cloned it from git URL specified. And maven build was done
> > as per the steps mentioned.
> >
> > Thanks,
> > Srigopal
> >
> > On 07-Apr-2017 1:05 pm, "Lu Cao" <wh...@gmail.com> wrote:
> >
> > Hi Srigopal,
> > You can follow this:
> > https://github.com/apache/incubator-carbondata/blob/
> > master/docs/quick-start-guide.md
> > Make sure you have correctly configured carbon and spark.
> >
> > Thanks,
> > Lionel
> >
> > On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <
> > srigopalmohanty@gmail.com>
> > wrote:
> >
> > > Hi Team,
> > >
> > > Getting error after building the carbon data git repo the in Cloudera
> > > distribution.
> > >
> > > in spark-shell console -
> > >
> > > <console>:25: error: object CarbonContext is not a member of package
> > > org.apache.spark.sql
> > > import org.apache.spark.sql.CarbonContext
> > >
> > >
> > > Any pointers.
> > >
> > > Thanks,
> > > Srigopal
> > >
> >
>
Re: Getting Error in Cloudera Distribution
Posted by Srigopal Mohanty <sr...@gmail.com>.
Spark version is 1.6
Yes i am using spark-shell --jars <assembly jar path>
The jars present are -
- carbondata-common-1.1.0-incubating-SNAPSHOT.jar
- carbondata-core-1.1.0-incubating-SNAPSHOT.jar
- carbondata-hadoop-1.1.0-incubating-SNAPSHOT.jar
- carbondata-processing-1.1.0-incubating-SNAPSHOT.jar
On 07-Apr-2017 1:36 pm, "Lu Cao" <wh...@gmail.com> wrote:
What's the spark version you're using?
Did you add "--jars <carbon assembly jar>" when you start the spark shell?
On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <sr...@gmail.com>
wrote:
> Hi Lionel,
>
> I followed the same link. I am using cloudera sandbox, which is
> preconfigured.
>
> CarbonData is cloned it from git URL specified. And maven build was done
> as per the steps mentioned.
>
> Thanks,
> Srigopal
>
> On 07-Apr-2017 1:05 pm, "Lu Cao" <wh...@gmail.com> wrote:
>
> Hi Srigopal,
> You can follow this:
> https://github.com/apache/incubator-carbondata/blob/
> master/docs/quick-start-guide.md
> Make sure you have correctly configured carbon and spark.
>
> Thanks,
> Lionel
>
> On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <
> srigopalmohanty@gmail.com>
> wrote:
>
> > Hi Team,
> >
> > Getting error after building the carbon data git repo the in Cloudera
> > distribution.
> >
> > in spark-shell console -
> >
> > <console>:25: error: object CarbonContext is not a member of package
> > org.apache.spark.sql
> > import org.apache.spark.sql.CarbonContext
> >
> >
> > Any pointers.
> >
> > Thanks,
> > Srigopal
> >
>
Re: Getting Error in Cloudera Distribution
Posted by Lu Cao <wh...@gmail.com>.
What's the spark version you're using?
Did you add "--jars <carbon assembly jar>" when you start the spark shell?
On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <sr...@gmail.com>
wrote:
> Hi Lionel,
>
> I followed the same link. I am using cloudera sandbox, which is
> preconfigured.
>
> CarbonData is cloned it from git URL specified. And maven build was done
> as per the steps mentioned.
>
> Thanks,
> Srigopal
>
> On 07-Apr-2017 1:05 pm, "Lu Cao" <wh...@gmail.com> wrote:
>
> Hi Srigopal,
> You can follow this:
> https://github.com/apache/incubator-carbondata/blob/
> master/docs/quick-start-guide.md
> Make sure you have correctly configured carbon and spark.
>
> Thanks,
> Lionel
>
> On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <
> srigopalmohanty@gmail.com>
> wrote:
>
> > Hi Team,
> >
> > Getting error after building the carbon data git repo the in Cloudera
> > distribution.
> >
> > in spark-shell console -
> >
> > <console>:25: error: object CarbonContext is not a member of package
> > org.apache.spark.sql
> > import org.apache.spark.sql.CarbonContext
> >
> >
> > Any pointers.
> >
> > Thanks,
> > Srigopal
> >
>
Re: Getting Error in Cloudera Distribution
Posted by Srigopal Mohanty <sr...@gmail.com>.
Hi Lionel,
I followed the same link. I am using cloudera sandbox, which is
preconfigured.
CarbonData is cloned it from git URL specified. And maven build was done
as per the steps mentioned.
Thanks,
Srigopal
On 07-Apr-2017 1:05 pm, "Lu Cao" <wh...@gmail.com> wrote:
Hi Srigopal,
You can follow this:
https://github.com/apache/incubator-carbondata/blob/
master/docs/quick-start-guide.md
Make sure you have correctly configured carbon and spark.
Thanks,
Lionel
On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <sr...@gmail.com>
wrote:
> Hi Team,
>
> Getting error after building the carbon data git repo the in Cloudera
> distribution.
>
> in spark-shell console -
>
> <console>:25: error: object CarbonContext is not a member of package
> org.apache.spark.sql
> import org.apache.spark.sql.CarbonContext
>
>
> Any pointers.
>
> Thanks,
> Srigopal
>
Re: Getting Error in Cloudera Distribution
Posted by Lu Cao <wh...@gmail.com>.
Hi Srigopal,
You can follow this:
https://github.com/apache/incubator-carbondata/blob/master/docs/quick-start-guide.md
Make sure you have correctly configured carbon and spark.
Thanks,
Lionel
On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <sr...@gmail.com>
wrote:
> Hi Team,
>
> Getting error after building the carbon data git repo the in Cloudera
> distribution.
>
> in spark-shell console -
>
> <console>:25: error: object CarbonContext is not a member of package
> org.apache.spark.sql
> import org.apache.spark.sql.CarbonContext
>
>
> Any pointers.
>
> Thanks,
> Srigopal
>