You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by "chrajeshbabu (via GitHub)" <gi...@apache.org> on 2024/10/15 08:50:24 UTC
[I] Hadoop Ingestion job configured with hdfs is failing with IllegalArgumentException [pinot]
chrajeshbabu opened a new issue, #14236:
URL: https://github.com/apache/pinot/issues/14236
Hadoop Batch ingestion job configured with hdfs file system failing with following exception.
java.lang.RuntimeException: Caught exception during running - org.apache.pinot.plugin.ingestion.batch.hadoop.HadoopSegmentGenerationJobRunner
at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:152)
at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.runIngestionJob(IngestionJobLauncher.java:121)
at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.execute(LaunchDataIngestionJobCommand.java:132)
at org.apache.pinot.tools.Command.call(Command.java:33)
at org.apache.pinot.tools.Command.call(Command.java:29)
at picocli.CommandLine.executeUserObject(CommandLine.java:2045)
at picocli.CommandLine.access$1500(CommandLine.java:148)
at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2465)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2457)
at picocli.CommandLine$RunLast.handle(CommandLine.java:2419)
at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2277)
at picocli.CommandLine$RunLast.execute(CommandLine.java:2421)
at picocli.CommandLine.execute(CommandLine.java:2174)
at org.apache.pinot.tools.admin.command.LaunchDataIngestionJobCommand.main(LaunchDataIngestionJobCommand.java:164)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.apache.hadoop.util.RunJar.run(RunJar.java:328)
at org.apache.hadoop.util.RunJar.main(RunJar.java:241)
Caused by: java.lang.IllegalArgumentException: /usr/vdp/3.3.6.4-2/apache-pinot-1.2.0-bin/plugins-external/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/pinot-batch-ingestion-hadoop-1.2.0-shaded.jar is not a directory
at org.apache.pinot.plugin.filesystem.HadoopPinotFS.copyFromLocalDir(HadoopPinotFS.java:225)
at org.apache.pinot.spi.filesystem.NoClosePinotFS.copyFromLocalDir(NoClosePinotFS.java:104)
at org.apache.pinot.plugin.ingestion.batch.hadoop.HadoopSegmentGenerationJobRunner.addMapperJarToDistributedCache(HadoopSegmentGenerationJobRunner.java:352)
at org.apache.pinot.plugin.ingestion.batch.hadoop.HadoopSegmentGenerationJobRunner.run(HadoopSegmentGenerationJobRunner.java:226)
at org.apache.pinot.spi.ingestion.batch.IngestionJobLauncher.kickoffIngestionJob(IngestionJobLauncher.java:150)
... 19 more
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Hadoop Ingestion job configured with hdfs is failing with IllegalArgumentException [pinot]
Posted by "chrajeshbabu (via GitHub)" <gi...@apache.org>.
chrajeshbabu commented on issue #14236:
URL: https://github.com/apache/pinot/issues/14236#issuecomment-2425758273
@Jackie-Jiang could you please add me as assignee to this ticket.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
Re: [I] Hadoop Ingestion job configured with hdfs is failing with IllegalArgumentException [pinot]
Posted by "Jackie-Jiang (via GitHub)" <gi...@apache.org>.
Jackie-Jiang closed issue #14236: Hadoop Ingestion job configured with hdfs is failing with IllegalArgumentException
URL: https://github.com/apache/pinot/issues/14236
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org