You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Rita RSilva <ri...@gmail.com> on 2021/08/25 07:43:30 UTC
From scala to sql
Good morning,
I have just installed spark Apache, I never used it. I need to change from scala to SQL, but I am having some difficulties in finding the instructions for that. Could you help me with this please?
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: From scala to sql
Posted by Mich Talebzadeh <mi...@gmail.com>.
you are on windows
try where spark-sql
C:\Users\admin>where spark-sql
C:\spark-3.0.1-bin-hadoop2.7\bin\spark-sql
C:\spark-3.0.1-bin-hadoop2.7\bin\spark-sql.cmd
view my Linkedin profile
<https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.
On Wed, 25 Aug 2021 at 15:37, Rita RSilva <ri...@gmail.com> wrote:
> I think my spark installation did not include the sql module... May that
> be the case?
> Rita
>
> On Wed, 25 Aug 2021 at 15:27, Rita RSilva <ri...@gmail.com> wrote:
>
>> Hi Mich,
>>
>> Thank you so much for your answer. I got this:
>> [image: image.png]
>>
>> "WARN ProcfsMetricsGetter: Exception when trying to compute pagesize, as
>> a result reporting of ProcessTree metrics is stopped"
>> What is the problem? How can I solve it?
>>
>> Thanks in advance.
>>
>> Kind regards,
>> Rita
>>
>>
>> On Wed, 25 Aug 2021 at 13:31, Mich Talebzadeh <mi...@gmail.com>
>> wrote:
>>
>>> That is spark on Hive database.table
>>>
>>>
>>>
>>> view my Linkedin profile
>>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 25 Aug 2021 at 13:28, Mich Talebzadeh <mi...@gmail.com>
>>> wrote:
>>>
>>>> which spark-sql
>>>> /opt/spark/bin/spark-sql ## usually $SPARK_HOME/bin/spark-sql
>>>>
>>>> spark-sql
>>>>
>>>> spark-sql> select count(1) from alayer.joint_accounts_view;
>>>>
>>>> 7926
>>>> Time taken: 0.506 seconds, Fetched 1 row(s)
>>>>
>>>>
>>>> HTH
>>>>
>>>>
>>>> view my Linkedin profile
>>>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>>>>
>>>>
>>>>
>>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>>> any loss, damage or destruction of data or any other property which may
>>>> arise from relying on this email's technical content is explicitly
>>>> disclaimed. The author will in no case be liable for any monetary damages
>>>> arising from such loss, damage or destruction.
>>>>
>>>>
>>>>
>>>>
>>>> On Wed, 25 Aug 2021 at 13:16, Rita RSilva <ri...@gmail.com>
>>>> wrote:
>>>>
>>>>> Good morning,
>>>>>
>>>>> I have just installed spark Apache, I never used it. I need to change
>>>>> from scala to SQL, but I am having some difficulties in finding the
>>>>> instructions for that. Could you help me with this please?
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>>>>
>>>>>
Re: From scala to sql
Posted by Rita RSilva <ri...@gmail.com>.
I think my spark installation did not include the sql module... May that be
the case?
Rita
On Wed, 25 Aug 2021 at 15:27, Rita RSilva <ri...@gmail.com> wrote:
> Hi Mich,
>
> Thank you so much for your answer. I got this:
> [image: image.png]
>
> "WARN ProcfsMetricsGetter: Exception when trying to compute pagesize, as a
> result reporting of ProcessTree metrics is stopped"
> What is the problem? How can I solve it?
>
> Thanks in advance.
>
> Kind regards,
> Rita
>
>
> On Wed, 25 Aug 2021 at 13:31, Mich Talebzadeh <mi...@gmail.com>
> wrote:
>
>> That is spark on Hive database.table
>>
>>
>>
>> view my Linkedin profile
>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 25 Aug 2021 at 13:28, Mich Talebzadeh <mi...@gmail.com>
>> wrote:
>>
>>> which spark-sql
>>> /opt/spark/bin/spark-sql ## usually $SPARK_HOME/bin/spark-sql
>>>
>>> spark-sql
>>>
>>> spark-sql> select count(1) from alayer.joint_accounts_view;
>>>
>>> 7926
>>> Time taken: 0.506 seconds, Fetched 1 row(s)
>>>
>>>
>>> HTH
>>>
>>>
>>> view my Linkedin profile
>>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>>>
>>>
>>>
>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>>> any loss, damage or destruction of data or any other property which may
>>> arise from relying on this email's technical content is explicitly
>>> disclaimed. The author will in no case be liable for any monetary damages
>>> arising from such loss, damage or destruction.
>>>
>>>
>>>
>>>
>>> On Wed, 25 Aug 2021 at 13:16, Rita RSilva <ri...@gmail.com>
>>> wrote:
>>>
>>>> Good morning,
>>>>
>>>> I have just installed spark Apache, I never used it. I need to change
>>>> from scala to SQL, but I am having some difficulties in finding the
>>>> instructions for that. Could you help me with this please?
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>>>
>>>>
Re: From scala to sql
Posted by Rita RSilva <ri...@gmail.com>.
Hi Mich,
Thank you so much for your answer. I got this:
[image: image.png]
"WARN ProcfsMetricsGetter: Exception when trying to compute pagesize, as a
result reporting of ProcessTree metrics is stopped"
What is the problem? How can I solve it?
Thanks in advance.
Kind regards,
Rita
On Wed, 25 Aug 2021 at 13:31, Mich Talebzadeh <mi...@gmail.com>
wrote:
> That is spark on Hive database.table
>
>
>
> view my Linkedin profile
> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 25 Aug 2021 at 13:28, Mich Talebzadeh <mi...@gmail.com>
> wrote:
>
>> which spark-sql
>> /opt/spark/bin/spark-sql ## usually $SPARK_HOME/bin/spark-sql
>>
>> spark-sql
>>
>> spark-sql> select count(1) from alayer.joint_accounts_view;
>>
>> 7926
>> Time taken: 0.506 seconds, Fetched 1 row(s)
>>
>>
>> HTH
>>
>>
>> view my Linkedin profile
>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>>
>>
>>
>> *Disclaimer:* Use it at your own risk. Any and all responsibility for
>> any loss, damage or destruction of data or any other property which may
>> arise from relying on this email's technical content is explicitly
>> disclaimed. The author will in no case be liable for any monetary damages
>> arising from such loss, damage or destruction.
>>
>>
>>
>>
>> On Wed, 25 Aug 2021 at 13:16, Rita RSilva <ri...@gmail.com> wrote:
>>
>>> Good morning,
>>>
>>> I have just installed spark Apache, I never used it. I need to change
>>> from scala to SQL, but I am having some difficulties in finding the
>>> instructions for that. Could you help me with this please?
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>>
>>>
Re: From scala to sql
Posted by Mich Talebzadeh <mi...@gmail.com>.
That is spark on Hive database.table
view my Linkedin profile
<https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.
On Wed, 25 Aug 2021 at 13:28, Mich Talebzadeh <mi...@gmail.com>
wrote:
> which spark-sql
> /opt/spark/bin/spark-sql ## usually $SPARK_HOME/bin/spark-sql
>
> spark-sql
>
> spark-sql> select count(1) from alayer.joint_accounts_view;
>
> 7926
> Time taken: 0.506 seconds, Fetched 1 row(s)
>
>
> HTH
>
>
> view my Linkedin profile
> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
>
>
>
> *Disclaimer:* Use it at your own risk. Any and all responsibility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
>
>
> On Wed, 25 Aug 2021 at 13:16, Rita RSilva <ri...@gmail.com> wrote:
>
>> Good morning,
>>
>> I have just installed spark Apache, I never used it. I need to change
>> from scala to SQL, but I am having some difficulties in finding the
>> instructions for that. Could you help me with this please?
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>>
Re: From scala to sql
Posted by Mich Talebzadeh <mi...@gmail.com>.
which spark-sql
/opt/spark/bin/spark-sql ## usually $SPARK_HOME/bin/spark-sql
spark-sql
spark-sql> select count(1) from alayer.joint_accounts_view;
7926
Time taken: 0.506 seconds, Fetched 1 row(s)
HTH
view my Linkedin profile
<https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/>
*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.
On Wed, 25 Aug 2021 at 13:16, Rita RSilva <ri...@gmail.com> wrote:
> Good morning,
>
> I have just installed spark Apache, I never used it. I need to change from
> scala to SQL, but I am having some difficulties in finding the instructions
> for that. Could you help me with this please?
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>