[jira] [Commented] (SQOOP-3469) Bug when starting sqoop2 server

["THOMAS TAO (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SQOOP-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070705#comment-17070705 ] 

THOMAS TAO commented on SQOOP-3469:
-----------------------------------

I think it may be related to your ??org.apache.sqoop.submission.engine.mapreduce.configuration.directory ??setting.

Maybe you can set the function sqoop_server_classpath_set in the bin / sqoop.sh file instead of modifying the environment variables.

 

> Bug when starting sqoop2 server
> -------------------------------
>
>                 Key: SQOOP-3469
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3469
>             Project: Sqoop
>          Issue Type: Bug
>          Components: sqoop2-server
>    Affects Versions: 1.99.7
>         Environment:  
> Ubuntu docker container
> {color:#cc7832}with following pacakage {color}recommends \ssh \openjdk-8-jdk \net-tools \netcat \
> +environement variable:+
> SQOOP_HOME=/usr/lib/sqoop/
> SQOOP_SERVER_EXTRA_LIB = /usr/lib/sqoop/server/lib
> YARN_RESOURCEMANAGER_USER=root
> YARN_NODEMANAGER_USER=root
> HDFS_NAMENODE_USER=root
> HDFS_DATANODE_USER=root
> HDFS_SECONDARYNAMENODE_USER=root
> PDSH_RCMD_TYPE=ssh
> +sqoop.properties unchanged exepect:+ 
> {color:#cc7832}org.apache.sqoop.submission.engine.mapreduce.configuration.directory{color}{color:#808080}={color}{color:#6a8759}/data/hadoop-3.2.1/bin
> {color}
>  
>            Reporter: Pierre Arnaud Auque
>            Priority: Major
>
>  
> Sqoop2 installed following the Apache online guide.
>  
> The command, I have done, from "/data" folder:
>  * sqoop2-tool upgrade ==> No Issue
>  * sqoop2-tool verifiy ==> bug Exception in thread "main" java.lang.NoSuchMethodError: 
>  * sqoop2-server stop
>  * sqoop2-server start
>  
> Then I created conenctor and jobs for an import from mySQL to HDFS. When starting the job the following error appears in the logs:
>  
> {color:#6897bb}org.apache.sqoop.common.SqoopException{color}: CONN_0011:Failed to create ConnectorClassLoader
> {color:#6a8759} at org.apache.sqoop.connector.ConnectorManagerUtils.createConnectorClassLoader(ConnectorManagerUtils.java:122)
> {color}{color:#6a8759} at org.apache.sqoop.job.mr.MRUtils.initConnectorClassLoaders(MRUtils.java:52)
> {color}{color:#6a8759} at org.apache.sqoop.job.mr.SqoopNullOutputFormat$SqoopDestroyerOutputCommitter.setupJob(SqoopNullOutputFormat.java:64)
> {color}{color:#6a8759} at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:541)
> {color}Caused by: {color:#6897bb}java.security.PrivilegedActionException{color}: {color:#6897bb}java.io.FileNotFoundException{color}: /data/sqoop-{color:#9876aa}connector-generic-jdbc-1.99.7.jar{color} (No such file or directory)
> {color:#6a8759} at java.security.AccessController.doPrivileged(Native Method)
> {color}{color:#6a8759} at org.apache.sqoop.connector.ConnectorManagerUtils.createConnectorClassLoader(ConnectorManagerUtils.java:112)
> {color} ... {color:#9876aa}3{color} more
> Caused by: {color:#6897bb}java.io.FileNotFoundException{color}: /data/sqoop-{color:#9876aa}connector-generic-jdbc-1.99.7.jar{color} (No such file or directory)
>  
>  
>  
> It seems that the environement is not well configured, scoop wantes to find its own lib where I started the server.
> If I start the server from sqoop/server/lib, it works.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)