"unable to establish the security context" with shaded Hadoop S3

[Averell <lv...@gmail.com>]

Hi everyone,

I'm trying a built after this  PR 6795
<https://github.com/apache/flink/pull/6795>   for S3 Recoverable writer, to
write my stream into parquet file on S3 with Flink running on AWS EMR; and
get the error "unable to establish the security context" with full
stacktrace below.
The shading of hadoop jars started from this ticket  FLINK-10366
<https://issues.apache.org/jira/browse/FLINK-10366>  . Googling the error
didn't help. Could someone please help me? 

Thanks and best regards,
Averell

/Setting HADOOP_CONF_DIR=/etc/hadoop/conf because no HADOOP_CONF_DIR was
set.
java.lang.Exception: *unable to establish the security context*
	at
org.apache.flink.runtime.security.SecurityUtils.install(SecurityUtils.java:73)
	at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1124)
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: class
*org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback
not org.apache.hadoop.security.GroupMappingServiceProvider*
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2503)
	at org.apache.hadoop.security.Groups.<init>(Groups.java:106)
	at org.apache.hadoop.security.Groups.<init>(Groups.java:101)
	at
org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:448)
	at
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:331)
	at
org.apache.hadoop.security.UserGroupInformation.setConfiguration(UserGroupInformation.java:359)
	at
org.apache.flink.runtime.security.modules.HadoopModule.install(HadoopModule.java:70)
	at
org.apache.flink.runtime.security.SecurityUtils.install(SecurityUtils.java:67)
	... 1 more
Caused by: java.lang.RuntimeException: class
org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback
not org.apache.hadoop.security.GroupMappingServiceProvider
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2497)
	... 8 more
/




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/