Spark jobs without a login

[jay vyas <ja...@gmail.com>]

Hi spark:

Is it possible to avoid reliance on a login user when running a spark job?

I'm running out a container that doesnt supply a valid user name,
and thus, I'm getting the following exception:

org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:675)

I'm not too worries about this - but it seems like it might be nice if
maybe we could specify a user name as part of sparks context or as part of
an external parameter rather then having to
 use the java based user/group extractor.



-- 
jay vyas

Re: Spark jobs without a login

[Ted Yu <yu...@gmail.com>]

Can you describe more about the container ?

Please show complete stack trace for the exception.

Thanks

On Thu, Jun 16, 2016 at 1:32 PM, jay vyas <ja...@gmail.com>
wrote:

> Hi spark:
>
> Is it possible to avoid reliance on a login user when running a spark job?
>
> I'm running out a container that doesnt supply a valid user name,
> and thus, I'm getting the following exception:
>
>
> org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:675)
>
> I'm not too worries about this - but it seems like it might be nice if
> maybe we could specify a user name as part of sparks context or as part of
> an external parameter rather then having to
>  use the java based user/group extractor.
>
>
>
> --
> jay vyas
>