You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Parth Sawant <pa...@gmail.com> on 2016/01/29 20:34:44 UTC

PhoenixBulkLoader command as generic user.

Hi
I'm trying to run the PhoenixBulkLoader command as user 'X' where user 'X'
!= hbase. Basically the bulkloader waits on loading the HFiles from hdfs if
I run the command as any other user except 'hbase'.
Is there some way to run the command as just any user except 'hbase' on an
un-secure cluster.

Set-up Information:
Hadoop : 2.7.1.2.3.4.0
Phoenix : 4.4
Hbase : 1.1.2.2.3.4.0


Thanks for your help.

Regards
Parth S

Re: PhoenixBulkLoader command as generic user.

Posted by Gabriel Reid <ga...@gmail.com>.
Excellent point James, I'll add it to the bulk load page.

- Gabriel

On Sat, Jan 30, 2016 at 5:40 PM, James Taylor <ja...@apache.org> wrote:
> Thanks, Gabriel. If you have any spare cycles, it might be good to add this
> to the CSV Bulk Load page and/or as an FAQ as it's come up a few times.
>
>     James
>
> On Fri, Jan 29, 2016 at 11:03 PM, Parth Sawant <pa...@gmail.com>
> wrote:
>>
>> Hi Gabriel,
>> This worked perfectly.
>>
>> Thanks a lot.
>> Parth S
>>
>> On Fri, Jan 29, 2016 at 10:29 PM, Gabriel Reid <ga...@gmail.com>
>> wrote:
>>>
>>> Hi Parth,
>>>
>>> Setting the "fs.permissions.umask-mode" config setting to "000" should
>>> do the job. You can do this in your hadoop config on the machine where
>>> you're submitting the job, or just supply it as the leading
>>> command-line parameter as follows:
>>>
>>>     hadoop jar phoenix-client.jar
>>> org.apache.phoenix.mapreduce.CsvBulkLoadTool
>>> -Dfs.permissions.umask-mode=000 <other command line args>
>>>
>>> - Gabriel
>>>
>>>
>>> On Fri, Jan 29, 2016 at 8:34 PM, Parth Sawant <pa...@gmail.com>
>>> wrote:
>>> > Hi
>>> > I'm trying to run the PhoenixBulkLoader command as user 'X' where user
>>> > 'X'
>>> > != hbase. Basically the bulkloader waits on loading the HFiles from
>>> > hdfs if
>>> > I run the command as any other user except 'hbase'.
>>> > Is there some way to run the command as just any user except 'hbase' on
>>> > an
>>> > un-secure cluster.
>>> >
>>> > Set-up Information:
>>> > Hadoop : 2.7.1.2.3.4.0
>>> > Phoenix : 4.4
>>> > Hbase : 1.1.2.2.3.4.0
>>> >
>>> >
>>> > Thanks for your help.
>>> >
>>> > Regards
>>> > Parth S
>>> >
>>
>>
>

Re: PhoenixBulkLoader command as generic user.

Posted by James Taylor <ja...@apache.org>.
Thanks, Gabriel. If you have any spare cycles, it might be good to add this
to the CSV Bulk Load page and/or as an FAQ as it's come up a few times.

    James

On Fri, Jan 29, 2016 at 11:03 PM, Parth Sawant <pa...@gmail.com>
wrote:

> Hi Gabriel,
> This worked perfectly.
>
> Thanks a lot.
> Parth S
>
> On Fri, Jan 29, 2016 at 10:29 PM, Gabriel Reid <ga...@gmail.com>
> wrote:
>
>> Hi Parth,
>>
>> Setting the "fs.permissions.umask-mode" config setting to "000" should
>> do the job. You can do this in your hadoop config on the machine where
>> you're submitting the job, or just supply it as the leading
>> command-line parameter as follows:
>>
>>     hadoop jar phoenix-client.jar
>> org.apache.phoenix.mapreduce.CsvBulkLoadTool
>> -Dfs.permissions.umask-mode=000 <other command line args>
>>
>> - Gabriel
>>
>>
>> On Fri, Jan 29, 2016 at 8:34 PM, Parth Sawant <pa...@gmail.com>
>> wrote:
>> > Hi
>> > I'm trying to run the PhoenixBulkLoader command as user 'X' where user
>> 'X'
>> > != hbase. Basically the bulkloader waits on loading the HFiles from
>> hdfs if
>> > I run the command as any other user except 'hbase'.
>> > Is there some way to run the command as just any user except 'hbase' on
>> an
>> > un-secure cluster.
>> >
>> > Set-up Information:
>> > Hadoop : 2.7.1.2.3.4.0
>> > Phoenix : 4.4
>> > Hbase : 1.1.2.2.3.4.0
>> >
>> >
>> > Thanks for your help.
>> >
>> > Regards
>> > Parth S
>> >
>>
>
>

Re: PhoenixBulkLoader command as generic user.

Posted by Parth Sawant <pa...@gmail.com>.
Hi Gabriel,
This worked perfectly.

Thanks a lot.
Parth S

On Fri, Jan 29, 2016 at 10:29 PM, Gabriel Reid <ga...@gmail.com>
wrote:

> Hi Parth,
>
> Setting the "fs.permissions.umask-mode" config setting to "000" should
> do the job. You can do this in your hadoop config on the machine where
> you're submitting the job, or just supply it as the leading
> command-line parameter as follows:
>
>     hadoop jar phoenix-client.jar
> org.apache.phoenix.mapreduce.CsvBulkLoadTool
> -Dfs.permissions.umask-mode=000 <other command line args>
>
> - Gabriel
>
>
> On Fri, Jan 29, 2016 at 8:34 PM, Parth Sawant <pa...@gmail.com>
> wrote:
> > Hi
> > I'm trying to run the PhoenixBulkLoader command as user 'X' where user
> 'X'
> > != hbase. Basically the bulkloader waits on loading the HFiles from hdfs
> if
> > I run the command as any other user except 'hbase'.
> > Is there some way to run the command as just any user except 'hbase' on
> an
> > un-secure cluster.
> >
> > Set-up Information:
> > Hadoop : 2.7.1.2.3.4.0
> > Phoenix : 4.4
> > Hbase : 1.1.2.2.3.4.0
> >
> >
> > Thanks for your help.
> >
> > Regards
> > Parth S
> >
>

Re: PhoenixBulkLoader command as generic user.

Posted by Gabriel Reid <ga...@gmail.com>.
Hi Parth,

Setting the "fs.permissions.umask-mode" config setting to "000" should
do the job. You can do this in your hadoop config on the machine where
you're submitting the job, or just supply it as the leading
command-line parameter as follows:

    hadoop jar phoenix-client.jar
org.apache.phoenix.mapreduce.CsvBulkLoadTool
-Dfs.permissions.umask-mode=000 <other command line args>

- Gabriel


On Fri, Jan 29, 2016 at 8:34 PM, Parth Sawant <pa...@gmail.com> wrote:
> Hi
> I'm trying to run the PhoenixBulkLoader command as user 'X' where user 'X'
> != hbase. Basically the bulkloader waits on loading the HFiles from hdfs if
> I run the command as any other user except 'hbase'.
> Is there some way to run the command as just any user except 'hbase' on an
> un-secure cluster.
>
> Set-up Information:
> Hadoop : 2.7.1.2.3.4.0
> Phoenix : 4.4
> Hbase : 1.1.2.2.3.4.0
>
>
> Thanks for your help.
>
> Regards
> Parth S
>