You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Sergey <gr...@yandex.ru> on 2017/04/14 09:18:53 UTC
Spark API authentication
Hello all,
I've added own spark.ui.filters to enable basic authentication to access to
Spark web UI. It works fine, but I still can do requests to spark API
without any authentication.
Is there any way to enable authentication for API endpoints?
P.S. spark version is 2.1.0, deploy mode is standalone.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark API authentication
Posted by Saisai Shao <sa...@gmail.com>.
IIUC auth filter on the Live UI REST API should already be supported, the
fix in SPARK-19652 is mainly for the History UI to support per app based
ACL.
For application submission REST API in standalone mode, I think currently
it is not supported, it is not a bug.
On Fri, Apr 14, 2017 at 6:56 PM, Sergey Grigorev <gr...@yandex.ru>
wrote:
> Thanks for help!
>
> I've found the ticket with a similar problem https://issues.apache.org/
> jira/browse/SPARK-19652. It looks like this fix did not hit to 2.1.0
> release.
> You said that for the second example custom filter is not supported. It
> is a bug or expected behavior?
>
> On 14.04.2017 13:22, Saisai Shao wrote:
>
> AFAIK, For the first line, custom filter should be worked. But for the
> latter it is not supported.
>
> On Fri, Apr 14, 2017 at 6:17 PM, Sergey Grigorev <gr...@yandex.ru>
> wrote:
>
>> GET requests like *
>> <http://worker:4040/api/v1/applications>http://worker:4040/api/v1/
>> <http://worker:4040/api/v1/>applications *or *http://master:6066/v1/submissions/status/driver-20170414025324-0000
>> <http://master:6066/v1/submissions/status/driver-20170414025324-0000> *return
>> successful result. But if I open the spark master web ui then it requests
>> username and password.
>>
>>
>> On 14.04.2017 12:46, Saisai Shao wrote:
>>
>> Hi,
>>
>> What specifically are you referring to "Spark API endpoint"?
>>
>> Filter can only be worked with Spark Live and History web UI.
>>
>> On Fri, Apr 14, 2017 at 5:18 PM, Sergey < <gr...@yandex.ru>
>> grigorev-s.n@yandex.ru> wrote:
>>
>>> Hello all,
>>>
>>> I've added own spark.ui.filters to enable basic authentication to access
>>> to
>>> Spark web UI. It works fine, but I still can do requests to spark API
>>> without any authentication.
>>> Is there any way to enable authentication for API endpoints?
>>>
>>> P.S. spark version is 2.1.0, deploy mode is standalone.
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html>
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-AP
>>> I-authentication-tp28601.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe e-mail: <us...@spark.apache.org>
>>> user-unsubscribe@spark.apache.org
>>>
>>>
>>
>>
>
>
Re: Spark API authentication
Posted by Sergey Grigorev <gr...@yandex.ru>.
Thanks for help!
I've found the ticket with a similar problem
https://issues.apache.org/jira/browse/SPARK-19652. It looks like this
fix did not hit to 2.1.0 release.
You said that for the second example custom filter is not supported. It
is a bug or expected behavior?
On 14.04.2017 13:22, Saisai Shao wrote:
> AFAIK, For the first line, custom filter should be worked. But for the
> latter it is not supported.
>
> On Fri, Apr 14, 2017 at 6:17 PM, Sergey Grigorev
> <grigorev-s.n@yandex.ru <ma...@yandex.ru>> wrote:
>
> GET requests like *http://worker:4040/api/v1/applications
> <http://worker:4040/api/v1/applications> *or
> *http://master:6066/v1/submissions/status/driver-20170414025324-0000
> <http://master:6066/v1/submissions/status/driver-20170414025324-0000>
> *return successful result. But if I open the spark master web ui
> then it requests username and password.
>
>
> On 14.04.2017 12:46, Saisai Shao wrote:
>> Hi,
>>
>> What specifically are you referring to "Spark API endpoint"?
>>
>> Filter can only be worked with Spark Live and History web UI.
>>
>> On Fri, Apr 14, 2017 at 5:18 PM, Sergey <grigorev-s.n@yandex.ru
>> <ma...@yandex.ru>> wrote:
>>
>> Hello all,
>>
>> I've added own spark.ui.filters to enable basic
>> authentication to access to
>> Spark web UI. It works fine, but I still can do requests to
>> spark API
>> without any authentication.
>> Is there any way to enable authentication for API endpoints?
>>
>> P.S. spark version is 2.1.0, deploy mode is standalone.
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html
>> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html>
>> Sent from the Apache Spark User List mailing list archive at
>> Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>> <ma...@spark.apache.org>
>>
>>
>
>
Re: Spark API authentication
Posted by Saisai Shao <sa...@gmail.com>.
AFAIK, For the first line, custom filter should be worked. But for the
latter it is not supported.
On Fri, Apr 14, 2017 at 6:17 PM, Sergey Grigorev <gr...@yandex.ru>
wrote:
> GET requests like *http://worker:4040/api/v1/applications
> <http://worker:4040/api/v1/applications> *or *http://master:6066/v1/submissions/status/driver-20170414025324-0000
> <http://master:6066/v1/submissions/status/driver-20170414025324-0000> *return
> successful result. But if I open the spark master web ui then it requests
> username and password.
>
>
> On 14.04.2017 12:46, Saisai Shao wrote:
>
> Hi,
>
> What specifically are you referring to "Spark API endpoint"?
>
> Filter can only be worked with Spark Live and History web UI.
>
> On Fri, Apr 14, 2017 at 5:18 PM, Sergey <gr...@yandex.ru> wrote:
>
>> Hello all,
>>
>> I've added own spark.ui.filters to enable basic authentication to access
>> to
>> Spark web UI. It works fine, but I still can do requests to spark API
>> without any authentication.
>> Is there any way to enable authentication for API endpoints?
>>
>> P.S. spark version is 2.1.0, deploy mode is standalone.
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-user-list.
>> 1001560.n3.nabble.com/Spark-API-authentication-tp28601.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>>
>
>
Re: Spark API authentication
Posted by Sergey Grigorev <gr...@yandex.ru>.
GET requests like *http://worker:4040/api/v1/applications *or
*http://master:6066/v1/submissions/status/driver-20170414025324-0000
*return successful result. But if I open the spark master web ui then it
requests username and password.
On 14.04.2017 12:46, Saisai Shao wrote:
> Hi,
>
> What specifically are you referring to "Spark API endpoint"?
>
> Filter can only be worked with Spark Live and History web UI.
>
> On Fri, Apr 14, 2017 at 5:18 PM, Sergey <grigorev-s.n@yandex.ru
> <ma...@yandex.ru>> wrote:
>
> Hello all,
>
> I've added own spark.ui.filters to enable basic authentication to
> access to
> Spark web UI. It works fine, but I still can do requests to spark API
> without any authentication.
> Is there any way to enable authentication for API endpoints?
>
> P.S. spark version is 2.1.0, deploy mode is standalone.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html
> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html>
> Sent from the Apache Spark User List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
> <ma...@spark.apache.org>
>
>
Re: Spark API authentication
Posted by Saisai Shao <sa...@gmail.com>.
Hi,
What specifically are you referring to "Spark API endpoint"?
Filter can only be worked with Spark Live and History web UI.
On Fri, Apr 14, 2017 at 5:18 PM, Sergey <gr...@yandex.ru> wrote:
> Hello all,
>
> I've added own spark.ui.filters to enable basic authentication to access to
> Spark web UI. It works fine, but I still can do requests to spark API
> without any authentication.
> Is there any way to enable authentication for API endpoints?
>
> P.S. spark version is 2.1.0, deploy mode is standalone.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.
> 1001560.n3.nabble.com/Spark-API-authentication-tp28601.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>