You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Chintan Bhatt <ch...@charusat.ac.in> on 2015/10/03 08:56:12 UTC
Re: Contribution in Apche Spark
While typing following line into Hortonworks terminal, I'm getting *Syntax
Error:invalid syntax*
myLines_filtered = myLines.filter( lambda x: len(x) > 0 )
On Wed, Sep 9, 2015 at 12:56 PM, Chintan Bhatt <
chintanbhatt.ce@charusat.ac.in> wrote:
> Thanx Akhil
> Can you provide me any industry related def. my MLlib in Spark for my
> research?
> We are allowed to do such research in PhD.
>
> On Wed, Sep 9, 2015 at 12:34 PM, Akhil Das <ak...@sigmoidanalytics.com>
> wrote:
>
>> Have a look
>> https://issues.apache.org/jira/browse/spark/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel
>>
>> Thanks
>> Best Regards
>>
>> On Wed, Sep 9, 2015 at 9:50 AM, Chintan Bhatt <
>> chintanbhatt.ce@charusat.ac.in> wrote:
>>
>>> I want to contribute in Apache dspark especially in MLlib in Spark.
>>> pls suggest me any open issue/use case/problem.
>>>
>>> --
>>> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
>>> Assistant Professor,
>>> U & P U Patel Department of Computer Engineering,
>>> Chandubhai S. Patel Institute of Technology,
>>> Charotar University of Science And Technology (CHARUSAT),
>>> Changa-388421, Gujarat, INDIA.
>>> http://www.charusat.ac.in
>>> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>>>
>>> [image: IBM]
>>> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>>>
>>>
>>> DISCLAIMER: The information transmitted is intended only for the person
>>> or entity to which it is addressed and may contain confidential and/or
>>> privileged material which is the intellectual property of Charotar
>>> University of Science & Technology (CHARUSAT). Any review, retransmission,
>>> dissemination or other use of, or taking of any action in reliance upon
>>> this information by persons or entities other than the intended recipient
>>> is strictly prohibited. If you are not the intended recipient, or the
>>> employee, or agent responsible for delivering the message to the intended
>>> recipient and/or if you have received this in error, please contact the
>>> sender and delete the material from the computer or device. CHARUSAT does
>>> not take any liability or responsibility for any malicious codes/software
>>> and/or viruses/Trojan horses that may have been picked up during the
>>> transmission of this message. By opening and solely relying on the contents
>>> or part thereof this message, and taking action thereof, the recipient
>>> relieves the CHARUSAT of all the liabilities including any damages done to
>>> the recipient's pc/laptop/peripherals and other communication devices due
>>> to any reason.
>>>
>>
>>
>
>
> --
> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
> Assistant Professor,
> U & P U Patel Department of Computer Engineering,
> Chandubhai S. Patel Institute of Technology,
> Charotar University of Science And Technology (CHARUSAT),
> Changa-388421, Gujarat, INDIA.
> http://www.charusat.ac.in
> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>
> [image: IBM]
> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>
>
--
CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
Assistant Professor,
U & P U Patel Department of Computer Engineering,
Chandubhai S. Patel Institute of Technology,
Charotar University of Science And Technology (CHARUSAT),
Changa-388421, Gujarat, INDIA.
http://www.charusat.ac.in
*Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
[image: IBM]
<https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
--
DISCLAIMER: The information transmitted is intended only for the person or
entity to which it is addressed and may contain confidential and/or
privileged material which is the intellectual property of Charotar
University of Science & Technology (CHARUSAT). Any review, retransmission,
dissemination or other use of, or taking of any action in reliance upon
this information by persons or entities other than the intended recipient
is strictly prohibited. If you are not the intended recipient, or the
employee, or agent responsible for delivering the message to the intended
recipient and/or if you have received this in error, please contact the
sender and delete the material from the computer or device. CHARUSAT does
not take any liability or responsibility for any malicious codes/software
and/or viruses/Trojan horses that may have been picked up during the
transmission of this message. By opening and solely relying on the contents
or part thereof this message, and taking action thereof, the recipient
relieves the CHARUSAT of all the liabilities including any damages done to
the recipient's pc/laptop/peripherals and other communication devices due
to any reason.
Re: Contribution in Apche Spark
Posted by vaquar khan <va...@gmail.com>.
Hi Chintan,
Please share complete code ,error logs also mention version of spark etc.
If you are new in spark development ,please start with following doc.
http://spark.apache.org/docs/latest/quick-start.html
Regards,
Vaquar khan
On 3 Oct 2015 20:39, "Ted Yu" <yu...@gmail.com> wrote:
> Please more of your code snippet and the complete error.
>
> See als python/pyspark/tests.py for examples.
>
> Cheers
>
> On Fri, Oct 2, 2015 at 11:56 PM, Chintan Bhatt <
> chintanbhatt.ce@charusat.ac.in> wrote:
>
>> While typing following line into Hortonworks terminal, I'm getting *Syntax
>> Error:invalid syntax*
>>
>> myLines_filtered = myLines.filter( lambda x: len(x) > 0 )
>>
>>
>> On Wed, Sep 9, 2015 at 12:56 PM, Chintan Bhatt <
>> chintanbhatt.ce@charusat.ac.in> wrote:
>>
>>> Thanx Akhil
>>> Can you provide me any industry related def. my MLlib in Spark for my
>>> research?
>>> We are allowed to do such research in PhD.
>>>
>>> On Wed, Sep 9, 2015 at 12:34 PM, Akhil Das <ak...@sigmoidanalytics.com>
>>> wrote:
>>>
>>>> Have a look
>>>> https://issues.apache.org/jira/browse/spark/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel
>>>>
>>>> Thanks
>>>> Best Regards
>>>>
>>>> On Wed, Sep 9, 2015 at 9:50 AM, Chintan Bhatt <
>>>> chintanbhatt.ce@charusat.ac.in> wrote:
>>>>
>>>>> I want to contribute in Apache dspark especially in MLlib in Spark.
>>>>> pls suggest me any open issue/use case/problem.
>>>>>
>>>>> --
>>>>> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
>>>>> Assistant Professor,
>>>>> U & P U Patel Department of Computer Engineering,
>>>>> Chandubhai S. Patel Institute of Technology,
>>>>> Charotar University of Science And Technology (CHARUSAT),
>>>>> Changa-388421, Gujarat, INDIA.
>>>>> http://www.charusat.ac.in
>>>>> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>>>>>
>>>>> [image: IBM]
>>>>> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>>>>>
>>>>>
>>>>> DISCLAIMER: The information transmitted is intended only for the
>>>>> person or entity to which it is addressed and may contain confidential
>>>>> and/or privileged material which is the intellectual property of Charotar
>>>>> University of Science & Technology (CHARUSAT). Any review, retransmission,
>>>>> dissemination or other use of, or taking of any action in reliance upon
>>>>> this information by persons or entities other than the intended recipient
>>>>> is strictly prohibited. If you are not the intended recipient, or the
>>>>> employee, or agent responsible for delivering the message to the intended
>>>>> recipient and/or if you have received this in error, please contact the
>>>>> sender and delete the material from the computer or device. CHARUSAT does
>>>>> not take any liability or responsibility for any malicious codes/software
>>>>> and/or viruses/Trojan horses that may have been picked up during the
>>>>> transmission of this message. By opening and solely relying on the contents
>>>>> or part thereof this message, and taking action thereof, the recipient
>>>>> relieves the CHARUSAT of all the liabilities including any damages done to
>>>>> the recipient's pc/laptop/peripherals and other communication devices due
>>>>> to any reason.
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
>>> Assistant Professor,
>>> U & P U Patel Department of Computer Engineering,
>>> Chandubhai S. Patel Institute of Technology,
>>> Charotar University of Science And Technology (CHARUSAT),
>>> Changa-388421, Gujarat, INDIA.
>>> http://www.charusat.ac.in
>>> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>>>
>>> [image: IBM]
>>> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>>>
>>>
>>
>>
>> --
>> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
>> Assistant Professor,
>> U & P U Patel Department of Computer Engineering,
>> Chandubhai S. Patel Institute of Technology,
>> Charotar University of Science And Technology (CHARUSAT),
>> Changa-388421, Gujarat, INDIA.
>> http://www.charusat.ac.in
>> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>>
>> [image: IBM]
>> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>>
>>
>> DISCLAIMER: The information transmitted is intended only for the person
>> or entity to which it is addressed and may contain confidential and/or
>> privileged material which is the intellectual property of Charotar
>> University of Science & Technology (CHARUSAT). Any review, retransmission,
>> dissemination or other use of, or taking of any action in reliance upon
>> this information by persons or entities other than the intended recipient
>> is strictly prohibited. If you are not the intended recipient, or the
>> employee, or agent responsible for delivering the message to the intended
>> recipient and/or if you have received this in error, please contact the
>> sender and delete the material from the computer or device. CHARUSAT does
>> not take any liability or responsibility for any malicious codes/software
>> and/or viruses/Trojan horses that may have been picked up during the
>> transmission of this message. By opening and solely relying on the contents
>> or part thereof this message, and taking action thereof, the recipient
>> relieves the CHARUSAT of all the liabilities including any damages done to
>> the recipient's pc/laptop/peripherals and other communication devices due
>> to any reason.
>>
>
>
Re: Contribution in Apche Spark
Posted by Ted Yu <yu...@gmail.com>.
Please more of your code snippet and the complete error.
See als python/pyspark/tests.py for examples.
Cheers
On Fri, Oct 2, 2015 at 11:56 PM, Chintan Bhatt <
chintanbhatt.ce@charusat.ac.in> wrote:
> While typing following line into Hortonworks terminal, I'm getting *Syntax
> Error:invalid syntax*
>
> myLines_filtered = myLines.filter( lambda x: len(x) > 0 )
>
>
> On Wed, Sep 9, 2015 at 12:56 PM, Chintan Bhatt <
> chintanbhatt.ce@charusat.ac.in> wrote:
>
>> Thanx Akhil
>> Can you provide me any industry related def. my MLlib in Spark for my
>> research?
>> We are allowed to do such research in PhD.
>>
>> On Wed, Sep 9, 2015 at 12:34 PM, Akhil Das <ak...@sigmoidanalytics.com>
>> wrote:
>>
>>> Have a look
>>> https://issues.apache.org/jira/browse/spark/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel
>>>
>>> Thanks
>>> Best Regards
>>>
>>> On Wed, Sep 9, 2015 at 9:50 AM, Chintan Bhatt <
>>> chintanbhatt.ce@charusat.ac.in> wrote:
>>>
>>>> I want to contribute in Apache dspark especially in MLlib in Spark.
>>>> pls suggest me any open issue/use case/problem.
>>>>
>>>> --
>>>> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
>>>> Assistant Professor,
>>>> U & P U Patel Department of Computer Engineering,
>>>> Chandubhai S. Patel Institute of Technology,
>>>> Charotar University of Science And Technology (CHARUSAT),
>>>> Changa-388421, Gujarat, INDIA.
>>>> http://www.charusat.ac.in
>>>> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>>>>
>>>> [image: IBM]
>>>> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>>>>
>>>>
>>>> DISCLAIMER: The information transmitted is intended only for the person
>>>> or entity to which it is addressed and may contain confidential and/or
>>>> privileged material which is the intellectual property of Charotar
>>>> University of Science & Technology (CHARUSAT). Any review, retransmission,
>>>> dissemination or other use of, or taking of any action in reliance upon
>>>> this information by persons or entities other than the intended recipient
>>>> is strictly prohibited. If you are not the intended recipient, or the
>>>> employee, or agent responsible for delivering the message to the intended
>>>> recipient and/or if you have received this in error, please contact the
>>>> sender and delete the material from the computer or device. CHARUSAT does
>>>> not take any liability or responsibility for any malicious codes/software
>>>> and/or viruses/Trojan horses that may have been picked up during the
>>>> transmission of this message. By opening and solely relying on the contents
>>>> or part thereof this message, and taking action thereof, the recipient
>>>> relieves the CHARUSAT of all the liabilities including any damages done to
>>>> the recipient's pc/laptop/peripherals and other communication devices due
>>>> to any reason.
>>>>
>>>
>>>
>>
>>
>> --
>> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
>> Assistant Professor,
>> U & P U Patel Department of Computer Engineering,
>> Chandubhai S. Patel Institute of Technology,
>> Charotar University of Science And Technology (CHARUSAT),
>> Changa-388421, Gujarat, INDIA.
>> http://www.charusat.ac.in
>> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>>
>> [image: IBM]
>> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>>
>>
>
>
> --
> CHINTAN BHATT <http://in.linkedin.com/pub/chintan-bhatt/22/b31/336/>
> Assistant Professor,
> U & P U Patel Department of Computer Engineering,
> Chandubhai S. Patel Institute of Technology,
> Charotar University of Science And Technology (CHARUSAT),
> Changa-388421, Gujarat, INDIA.
> http://www.charusat.ac.in
> *Personal Website*: https://sites.google.com/a/ecchanga.ac.in/chintan/
>
> [image: IBM]
> <https://www.youracclaim.com/badges/880ac4e2-99ec-45f5-bc81-3479b91f185e/public_url>
>
>
> DISCLAIMER: The information transmitted is intended only for the person or
> entity to which it is addressed and may contain confidential and/or
> privileged material which is the intellectual property of Charotar
> University of Science & Technology (CHARUSAT). Any review, retransmission,
> dissemination or other use of, or taking of any action in reliance upon
> this information by persons or entities other than the intended recipient
> is strictly prohibited. If you are not the intended recipient, or the
> employee, or agent responsible for delivering the message to the intended
> recipient and/or if you have received this in error, please contact the
> sender and delete the material from the computer or device. CHARUSAT does
> not take any liability or responsibility for any malicious codes/software
> and/or viruses/Trojan horses that may have been picked up during the
> transmission of this message. By opening and solely relying on the contents
> or part thereof this message, and taking action thereof, the recipient
> relieves the CHARUSAT of all the liabilities including any damages done to
> the recipient's pc/laptop/peripherals and other communication devices due
> to any reason.
>