You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@zeppelin.apache.org by "Balachandar R.A." <ba...@gmail.com> on 2015/10/07 06:17:05 UTC

Question on converting pandas dataframe to spark frame

Hello

I am new to zeppelin. Quite interested to make some progress in my usecase
with the help of zeppelin capabilities. I have posted a question in stack
overflow. I guess this is the right forum to ask
Hence sharing the question

http://stackoverflow.com/questions/32966344/converting-pandas-dataframes-to-spark-dataframe-in-zeppelin

Will be more than happy if I could get help

Thanks
Bala

Re: Question on converting pandas dataframe to spark frame

Posted by moon soo Lee <mo...@apache.org>.

Somehow, I can not reproduce the problem anymore.
Can anyone reproduce this problem?

I tried with Spark 1.4.1, 1.5.1 local mode / standalone cluster mode.
python 2.6.6, 2.7.6, with latest master branch of Zeppelin.

Thanks,
moon

On Wed, Oct 14, 2015 at 7:01 AM Felix Cheung <fe...@hotmail.com>
wrote:

> let me know if I could help...
>
>
> ------------------------------
> From: moon@apache.org
> Date: Tue, 13 Oct 2015 08:20:52 +0000
> Subject: Re: Question on converting pandas dataframe to spark frame
> To: users@zeppelin.incubator.apache.org
>
>
> Hi Bala,
>
> Thanks for sharing the problem.
> I reproduced the same error, the same code works in bin/pyspark but not in
> Zeppelin.
> I'm going to take a look and keep you updated here.
>
> Thanks,
> moon
>
> On Wed, Oct 7, 2015 at 6:17 AM Balachandar R.A. <ba...@gmail.com>
> wrote:
>
> Hello
>
> I am new to zeppelin. Quite interested to make some progress in my usecase
> with the help of zeppelin capabilities. I have posted a question in stack
> overflow. I guess this is the right forum to ask
> Hence sharing the question
>
>
> http://stackoverflow.com/questions/32966344/converting-pandas-dataframes-to-spark-dataframe-in-zeppelin
>
> Will be more than happy if I could get help
>
> Thanks
> Bala
>
>

RE: Question on converting pandas dataframe to spark frame

Posted by Felix Cheung <fe...@hotmail.com>.

let me know if I could help...

From: moon@apache.org
Date: Tue, 13 Oct 2015 08:20:52 +0000
Subject: Re: Question on converting pandas dataframe to spark frame
To: users@zeppelin.incubator.apache.org

Hi Bala,
Thanks for sharing the problem.I reproduced the same error, the same code works in bin/pyspark but not in Zeppelin.I'm going to take a look and keep you updated here.
Thanks,moon
On Wed, Oct 7, 2015 at 6:17 AM Balachandar R.A. <ba...@gmail.com> wrote:
Hello
I am new to zeppelin. Quite interested to make some progress in my usecase with the help of zeppelin capabilities. I have posted a question in stack overflow. I guess this is the right forum to ask

 Hence sharing the question 
http://stackoverflow.com/questions/32966344/converting-pandas-dataframes-to-spark-dataframe-in-zeppelin
Will be more than happy if I could get help
Thanks 

Bala

Re: Question on converting pandas dataframe to spark frame

Posted by "Balachandar R.A." <ba...@gmail.com>.

Thanks for your response.  Looking forward for any update.

Thanks
Bala
On 13-Oct-2015 1:51 pm, "moon soo Lee" <mo...@apache.org> wrote:

> Hi Bala,
>
> Thanks for sharing the problem.
> I reproduced the same error, the same code works in bin/pyspark but not in
> Zeppelin.
> I'm going to take a look and keep you updated here.
>
> Thanks,
> moon
>
> On Wed, Oct 7, 2015 at 6:17 AM Balachandar R.A. <ba...@gmail.com>
> wrote:
>
>> Hello
>>
>> I am new to zeppelin. Quite interested to make some progress in my
>> usecase with the help of zeppelin capabilities. I have posted a question in
>> stack overflow. I guess this is the right forum to ask
>> Hence sharing the question
>>
>>
>> http://stackoverflow.com/questions/32966344/converting-pandas-dataframes-to-spark-dataframe-in-zeppelin
>>
>> Will be more than happy if I could get help
>>
>> Thanks
>> Bala
>>
>

Re: Question on converting pandas dataframe to spark frame

Posted by moon soo Lee <mo...@apache.org>.

Hi Bala,

Thanks for sharing the problem.
I reproduced the same error, the same code works in bin/pyspark but not in
Zeppelin.
I'm going to take a look and keep you updated here.

Thanks,
moon

On Wed, Oct 7, 2015 at 6:17 AM Balachandar R.A. <ba...@gmail.com>
wrote:

> Hello
>
> I am new to zeppelin. Quite interested to make some progress in my usecase
> with the help of zeppelin capabilities. I have posted a question in stack
> overflow. I guess this is the right forum to ask
> Hence sharing the question
>
>
> http://stackoverflow.com/questions/32966344/converting-pandas-dataframes-to-spark-dataframe-in-zeppelin
>
> Will be more than happy if I could get help
>
> Thanks
> Bala
>