You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Shuja Rehman <sh...@gmail.com> on 2010/06/05 18:15:52 UTC
Not able to run Hive
> Hi
> I have installed hadoop and hive according to starter kits on ubuntu 10.
> hadoop is running fine. but when i write this command
>
> *root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive*
>
> i get this following error.
>
> *Invalid maximum heap size: -Xmx4096m
> The specified size exceeds the maximum representable size.
> Could not create the Java virtual machine.*
>
> Kindly let me know how to solve this problem
> Thanks
>
> --
> Regards
> Shuja-ur-Rehman Baig
> _________________________________
> MS CS - School of Science and Engineering
> Lahore University of Management Sciences (LUMS)
> Sector U, DHA, Lahore, 54792, Pakistan
> Cell: +92 3214207445
>
Re: Not able to run Hive
Posted by Shuja Rehman <sh...@gmail.com>.
Hi
Thanks for replying.previously i changed in hive/bin. now i change in
build/dist and error is gone.
Thanks for answer
On Sun, Jun 6, 2010 at 10:11 PM, Ning Zhang <nz...@facebook.com> wrote:
> Did you changed the file in build/dist/bin directory? Have you rerun ant
> package again? If you run ant package the build/dist/bin directory will be
> overwritten by the files in bin/ directory. So you may want to change files
> in that directory.
>
> On Jun 6, 2010, at 12:33 PM, Shuja Rehman wrote:
>
> Hi all
> Thanks for reply.
> I have changed the heap size to 1024, then 512 then even 100 in the
> specified file. But i am still getting this error.
> I think i need to change the size to some other file also as the error
> message contain the same 4096.
>
> *Invalid maximum heap size: -Xmx4096m*
>
> Kindly let me know if any solution exits ??
>
>
> Thanks
>
>
> On Sat, Jun 5, 2010 at 8:35 PM, Sammy Yu <sy...@brightedge.com> wrote:
>
>> Hi Shuja,
>> I ran into a similar issue on trunk, you can lower the HADOOP_HEAPSIZE
>> value in the file ($hive_directory/bin/ext/util/execHiveCmd.sh) to something
>> smaller than 1024.
>>
>> Cheers,
>> Sammy
>>
>>
>> On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com>wrote:
>>
>>>
>>> Hi
>>>> I have installed hadoop and hive according to starter kits on ubuntu 10.
>>>> hadoop is running fine. but when i write this command
>>>>
>>>> *root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive*
>>>>
>>>> i get this following error.
>>>>
>>>> *Invalid maximum heap size: -Xmx4096m
>>>> The specified size exceeds the maximum representable size.
>>>> Could not create the Java virtual machine.*
>>>>
>>>> Kindly let me know how to solve this problem
>>>> Thanks
>>>>
>>>> --
>>>> Regards
>>>> Shuja-ur-Rehman Baig
>>>> _________________________________
>>>> MS CS - School of Science and Engineering
>>>> Lahore University of Management Sciences (LUMS)
>>>> Sector U, DHA, Lahore, 54792, Pakistan
>>>> Cell: +92 3214207445
>>>>
>>>
>>>
>>>
>>>
>>>
>>
>>
>>
>>
>
>
> --
> Regards
> Shuja-ur-Rehman Baig
> _________________________________
> MS CS - School of Science and Engineering
> Lahore University of Management Sciences (LUMS)
> Sector U, DHA, Lahore, 54792, Pakistan
> Cell: +92 3214207445
>
>
>
--
Regards
Shuja-ur-Rehman Baig
_________________________________
MS CS - School of Science and Engineering
Lahore University of Management Sciences (LUMS)
Sector U, DHA, Lahore, 54792, Pakistan
Cell: +92 3214207445
Re: Not able to run Hive
Posted by Ning Zhang <nz...@facebook.com>.
Did you changed the file in build/dist/bin directory? Have you rerun ant package again? If you run ant package the build/dist/bin directory will be overwritten by the files in bin/ directory. So you may want to change files in that directory.
On Jun 6, 2010, at 12:33 PM, Shuja Rehman wrote:
Hi all
Thanks for reply.
I have changed the heap size to 1024, then 512 then even 100 in the specified file. But i am still getting this error.
I think i need to change the size to some other file also as the error message contain the same 4096.
Invalid maximum heap size: -Xmx4096m
Kindly let me know if any solution exits ??
Thanks
On Sat, Jun 5, 2010 at 8:35 PM, Sammy Yu <sy...@brightedge.com>> wrote:
Hi Shuja,
I ran into a similar issue on trunk, you can lower the HADOOP_HEAPSIZE value in the file ($hive_directory/bin/ext/util/execHiveCmd.sh) to something smaller than 1024.
Cheers,
Sammy
On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com>> wrote:
Hi
I have installed hadoop and hive according to starter kits on ubuntu 10. hadoop is running fine. but when i write this command
root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive
i get this following error.
Invalid maximum heap size: -Xmx4096m
The specified size exceeds the maximum representable size.
Could not create the Java virtual machine.
Kindly let me know how to solve this problem
Thanks
--
Regards
Shuja-ur-Rehman Baig
_________________________________
MS CS - School of Science and Engineering
Lahore University of Management Sciences (LUMS)
Sector U, DHA, Lahore, 54792, Pakistan
Cell: +92 3214207445
--
Regards
Shuja-ur-Rehman Baig
_________________________________
MS CS - School of Science and Engineering
Lahore University of Management Sciences (LUMS)
Sector U, DHA, Lahore, 54792, Pakistan
Cell: +92 3214207445
Re: Not able to run Hive
Posted by Thiruvel Thirumoolan <th...@yahoo-inc.com>.
Hadoop 20.2 has HADOOP_HEAPSIZE (may be commented) defined in $HADOOP_CONF_DIR/hadoop-env.sh. $HADOOP_HOME/bin/hadoop uses this shell variable and constructs the max heap size.
1. Can you change HADOOP_HEAPSIZE and try? Either export on command line or change hadoop-env.sh.
2. Worst case - run 'hadoop' with 'set -x' turned on and you should be able to figure out whats wrong.
On Feb 28, 2011, at 5:16 PM, bharath vissapragada wrote:
> I am also getting this error .. any suggestions?
>
> hive : 0.6
> had :0.20.2
>
> =========
> On Mon, Jun 7, 2010 at 1:03 AM, Shuja Rehman <sh...@gmail.com> wrote:
>> Hi all
>> Thanks for reply.
>> I have changed the heap size to 1024, then 512 then even 100 in the
>> specified file. But i am still getting this error.
>> I think i need to change the size to some other file also as the error
>> message contain the same 4096.
>>
>> Invalid maximum heap size: -Xmx4096m
>>
>> Kindly let me know if any solution exits ??
>>
>>
>> Thanks
>>
>>
>> On Sat, Jun 5, 2010 at 8:35 PM, Sammy Yu <sy...@brightedge.com> wrote:
>>>
>>> Hi Shuja,
>>> I ran into a similar issue on trunk, you can lower the HADOOP_HEAPSIZE
>>> value in the file ($hive_directory/bin/ext/util/execHiveCmd.sh) to something
>>> smaller than 1024.
>>> Cheers,
>>> Sammy
>>>
>>> On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com>
>>> wrote:
>>>>
>>>>> Hi
>>>>> I have installed hadoop and hive according to starter kits on ubuntu 10.
>>>>> hadoop is running fine. but when i write this command
>>>>>
>>>>> root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive
>>>>>
>>>>> i get this following error.
>>>>>
>>>>> Invalid maximum heap size: -Xmx4096m
>>>>> The specified size exceeds the maximum representable size.
>>>>> Could not create the Java virtual machine.
>>>>>
>>>>> Kindly let me know how to solve this problem
>>>>> Thanks
>>>>>
>>>>> --
>>>>> Regards
>>>>> Shuja-ur-Rehman Baig
>>>>> _________________________________
>>>>> MS CS - School of Science and Engineering
>>>>> Lahore University of Management Sciences (LUMS)
>>>>> Sector U, DHA, Lahore, 54792, Pakistan
>>>>> Cell: +92 3214207445
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>>
>>
>>
>>
>> --
>> Regards
>> Shuja-ur-Rehman Baig
>> _________________________________
>> MS CS - School of Science and Engineering
>> Lahore University of Management Sciences (LUMS)
>> Sector U, DHA, Lahore, 54792, Pakistan
>> Cell: +92 3214207445
>>
>
>
>
> --
> Regards,
> Bharath .V
> w:http://research.iiit.ac.in/~bharath.v
Re: Not able to run Hive
Posted by bharath vissapragada <bh...@gmail.com>.
I am also getting this error .. any suggestions?
hive : 0.6
had :0.20.2
=========
On Mon, Jun 7, 2010 at 1:03 AM, Shuja Rehman <sh...@gmail.com> wrote:
> Hi all
> Thanks for reply.
> I have changed the heap size to 1024, then 512 then even 100 in the
> specified file. But i am still getting this error.
> I think i need to change the size to some other file also as the error
> message contain the same 4096.
>
> Invalid maximum heap size: -Xmx4096m
>
> Kindly let me know if any solution exits ??
>
>
> Thanks
>
>
> On Sat, Jun 5, 2010 at 8:35 PM, Sammy Yu <sy...@brightedge.com> wrote:
>>
>> Hi Shuja,
>> I ran into a similar issue on trunk, you can lower the HADOOP_HEAPSIZE
>> value in the file ($hive_directory/bin/ext/util/execHiveCmd.sh) to something
>> smaller than 1024.
>> Cheers,
>> Sammy
>>
>> On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com>
>> wrote:
>>>
>>>> Hi
>>>> I have installed hadoop and hive according to starter kits on ubuntu 10.
>>>> hadoop is running fine. but when i write this command
>>>>
>>>> root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive
>>>>
>>>> i get this following error.
>>>>
>>>> Invalid maximum heap size: -Xmx4096m
>>>> The specified size exceeds the maximum representable size.
>>>> Could not create the Java virtual machine.
>>>>
>>>> Kindly let me know how to solve this problem
>>>> Thanks
>>>>
>>>> --
>>>> Regards
>>>> Shuja-ur-Rehman Baig
>>>> _________________________________
>>>> MS CS - School of Science and Engineering
>>>> Lahore University of Management Sciences (LUMS)
>>>> Sector U, DHA, Lahore, 54792, Pakistan
>>>> Cell: +92 3214207445
>>>
>>>
>>>
>>>
>>
>>
>>
>>
>
>
>
> --
> Regards
> Shuja-ur-Rehman Baig
> _________________________________
> MS CS - School of Science and Engineering
> Lahore University of Management Sciences (LUMS)
> Sector U, DHA, Lahore, 54792, Pakistan
> Cell: +92 3214207445
>
--
Regards,
Bharath .V
w:http://research.iiit.ac.in/~bharath.v
Re: Not able to run Hive
Posted by Shuja Rehman <sh...@gmail.com>.
Hi all
Thanks for reply.
I have changed the heap size to 1024, then 512 then even 100 in the
specified file. But i am still getting this error.
I think i need to change the size to some other file also as the error
message contain the same 4096.
*Invalid maximum heap size: -Xmx4096m*
Kindly let me know if any solution exits ??
Thanks
On Sat, Jun 5, 2010 at 8:35 PM, Sammy Yu <sy...@brightedge.com> wrote:
> Hi Shuja,
> I ran into a similar issue on trunk, you can lower the HADOOP_HEAPSIZE
> value in the file ($hive_directory/bin/ext/util/execHiveCmd.sh) to something
> smaller than 1024.
>
> Cheers,
> Sammy
>
>
> On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com>wrote:
>
>>
>> Hi
>>> I have installed hadoop and hive according to starter kits on ubuntu 10.
>>> hadoop is running fine. but when i write this command
>>>
>>> *root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive*
>>>
>>> i get this following error.
>>>
>>> *Invalid maximum heap size: -Xmx4096m
>>> The specified size exceeds the maximum representable size.
>>> Could not create the Java virtual machine.*
>>>
>>> Kindly let me know how to solve this problem
>>> Thanks
>>>
>>> --
>>> Regards
>>> Shuja-ur-Rehman Baig
>>> _________________________________
>>> MS CS - School of Science and Engineering
>>> Lahore University of Management Sciences (LUMS)
>>> Sector U, DHA, Lahore, 54792, Pakistan
>>> Cell: +92 3214207445
>>>
>>
>>
>>
>>
>>
>
>
>
>
--
Regards
Shuja-ur-Rehman Baig
_________________________________
MS CS - School of Science and Engineering
Lahore University of Management Sciences (LUMS)
Sector U, DHA, Lahore, 54792, Pakistan
Cell: +92 3214207445
Re: Not able to run Hive
Posted by Shuja Rehman <sh...@gmail.com>.
Hi all
Thanks for reply.
I have changed the heap size to 1024, then 512 then even 100 in the
specified file. But i am still getting this error.
I have 1 GB RAM in the system, Kindly let me know if any solution exits ??
Thanks
On Sat, Jun 5, 2010 at 8:35 PM, Sammy Yu <sy...@brightedge.com> wrote:
> Hi Shuja,
> I ran into a similar issue on trunk, you can lower the HADOOP_HEAPSIZE
> value in the file ($hive_directory/bin/ext/util/execHiveCmd.sh) to something
> smaller than 1024.
>
> Cheers,
> Sammy
>
>
> On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com>wrote:
>
>>
>> Hi
>>> I have installed hadoop and hive according to starter kits on ubuntu 10.
>>> hadoop is running fine. but when i write this command
>>>
>>> *root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive*
>>>
>>> i get this following error.
>>>
>>> *Invalid maximum heap size: -Xmx4096m
>>> The specified size exceeds the maximum representable size.
>>> Could not create the Java virtual machine.*
>>>
>>> Kindly let me know how to solve this problem
>>> Thanks
>>>
>>> --
>>> Regards
>>> Shuja-ur-Rehman Baig
>>> _________________________________
>>> MS CS - School of Science and Engineering
>>> Lahore University of Management Sciences (LUMS)
>>> Sector U, DHA, Lahore, 54792, Pakistan
>>> Cell: +92 3214207445
>>>
>>
>>
>>
>>
>>
>
>
>
>
--
Regards
Shuja-ur-Rehman Baig
_________________________________
MS CS - School of Science and Engineering
Lahore University of Management Sciences (LUMS)
Sector U, DHA, Lahore, 54792, Pakistan
Cell: +92 3214207445
Re: Not able to run Hive
Posted by Sammy Yu <sy...@brightedge.com>.
Hi Shuja,
I ran into a similar issue on trunk, you can lower the HADOOP_HEAPSIZE
value in the file ($hive_directory/bin/ext/util/execHiveCmd.sh) to something
smaller than 1024.
Cheers,
Sammy
On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com> wrote:
>
> Hi
>> I have installed hadoop and hive according to starter kits on ubuntu 10.
>> hadoop is running fine. but when i write this command
>>
>> *root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive*
>>
>> i get this following error.
>>
>> *Invalid maximum heap size: -Xmx4096m
>> The specified size exceeds the maximum representable size.
>> Could not create the Java virtual machine.*
>>
>> Kindly let me know how to solve this problem
>> Thanks
>>
>> --
>> Regards
>> Shuja-ur-Rehman Baig
>> _________________________________
>> MS CS - School of Science and Engineering
>> Lahore University of Management Sciences (LUMS)
>> Sector U, DHA, Lahore, 54792, Pakistan
>> Cell: +92 3214207445
>>
>
>
>
>
>
Re: Not able to run Hive
Posted by Yingyi Bu <bu...@gmail.com>.
Check this earlier thread:
---------------------------------------------------------------------------------------------
That change my only be in trunk. Just in case he is referencing this.
be careful about lowering this. Queries with lots of AND/ORS will not
compile if you set this too low.
bin/ext/cli.sh
else
echo "Unable to determine Hadoop version information."
echo "'hadoop version' returned:"
echo `$HADOOP version`
exit 6
fi
HADOOP_HEAPSIZE=4096
HADOOP_OPTS="$HADOOP_OPTS -XX:-UseGCOverheadLimit"
if [ $minor_ver -lt 20 ]; then
exec $HADOOP jar $AUX_JARS_CMD_LINE ${HIVE_LIB}/hive-cli-*.jar
$CLASS $HIVE_OPTS "$@"
else
# hadoop 20 or newer - skip the aux_jars option. picked up from hiveconf
exec $HADOOP jar ${HIVE_LIB}/hive-cli-*.jar $CLASS $HIVE_OPTS "$@"
fi
- Hide quoted text -
On Wed, May 26, 2010 at 2:26 PM, Ning Zhang <nz...@facebook.com> wrote:
It is in bin/ext/cli.sh. search for 4096.
On May 26, 2010, at 11:11 AM, Sai Zhang wrote:
> Hi all:
>
> After I installed hive according to its instructions, and launched it using command ./hive_home/bin/hive, I
> found hive needs at least -Xmx4096 M memory to start. I am wondering is there any way to change this
> configuration to require less memory?
>
> At least, I did not find a valid one using grep. Any suggestion is welcome.
>
> thanks
>
> -Sai
On Sat, Jun 5, 2010 at 9:15 AM, Shuja Rehman <sh...@gmail.com> wrote:
>
>> Hi
>> I have installed hadoop and hive according to starter kits on ubuntu 10.
>> hadoop is running fine. but when i write this command
>>
>> root@digitalvision:/usr/local/hadoop/hive/build/dist# bin/hive
>>
>> i get this following error.
>>
>> Invalid maximum heap size: -Xmx4096m
>> The specified size exceeds the maximum representable size.
>> Could not create the Java virtual machine.
>>
>> Kindly let me know how to solve this problem
>> Thanks
>>
>> --
>> Regards
>> Shuja-ur-Rehman Baig
>> _________________________________
>> MS CS - School of Science and Engineering
>> Lahore University of Management Sciences (LUMS)
>> Sector U, DHA, Lahore, 54792, Pakistan
>> Cell: +92 3214207445
>
>
>
>
>