You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Sachit Murarka <co...@gmail.com> on 2021/01/15 05:24:22 UTC
Spark 3.0.1 giving warning while running with Java 11
Hi All,
Getting warning while running spark3.0.1 with Java11 .
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (
file:/opt/spark/jars/spark-unsafe_2.12-3.0.1.jar) to constructor
java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal
reflective access operations
WARNING: All illegal access operations will be denied in a future release
Kind Regards,
Sachit Murarka
Re: Spark 3.0.1 giving warning while running with Java 11
Posted by Sachit Murarka <co...@gmail.com>.
Sure Sean. Thanks for confirmation.
On Fri, 15 Jan 2021, 10:57 Sean Owen, <sr...@gmail.com> wrote:
> You can ignore that. Spark 3.x works with Java 11 but it will generate
> some warnings that are safe to disregard.
>
> On Thu, Jan 14, 2021 at 11:26 PM Sachit Murarka <co...@gmail.com>
> wrote:
>
>> Hi All,
>>
>> Getting warning while running spark3.0.1 with Java11 .
>>
>>
>> WARNING: An illegal reflective access operation has occurred
>> WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (
>> file:/opt/spark/jars/spark-unsafe_2.12-3.0.1.jar) to constructor
>> java.nio.DirectByteBuffer(long,int)
>> WARNING: Please consider reporting this to the maintainers of
>> org.apache.spark.unsafe.Platform
>> WARNING: Use --illegal-access=warn to enable warnings of further illegal
>> reflective access operations
>> WARNING: All illegal access operations will be denied in a future release
>>
>>
>>
>> Kind Regards,
>> Sachit Murarka
>>
>
Re: Spark 3.0.1 giving warning while running with Java 11
Posted by Sean Owen <sr...@gmail.com>.
You can ignore that. Spark 3.x works with Java 11 but it will generate some
warnings that are safe to disregard.
On Thu, Jan 14, 2021 at 11:26 PM Sachit Murarka <co...@gmail.com>
wrote:
> Hi All,
>
> Getting warning while running spark3.0.1 with Java11 .
>
>
> WARNING: An illegal reflective access operation has occurred
> WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (
> file:/opt/spark/jars/spark-unsafe_2.12-3.0.1.jar) to constructor
> java.nio.DirectByteBuffer(long,int)
> WARNING: Please consider reporting this to the maintainers of
> org.apache.spark.unsafe.Platform
> WARNING: Use --illegal-access=warn to enable warnings of further illegal
> reflective access operations
> WARNING: All illegal access operations will be denied in a future release
>
>
> Kind Regards,
> Sachit Murarka
>