You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/03/01 08:41:15 UTC
[GitHub] [druid] jalbs opened a new issue #9443: Hdfs inputSource not
supported by native batch ingestion v0.17
jalbs opened a new issue #9443: Hdfs inputSource not supported by native batch ingestion v0.17
URL: https://github.com/apache/druid/issues/9443
Hdfs inputSource not supported by native batch ingestion v0.17.
### Affected Version
0.17
### Description
Hdfs inputSource not supported by native batch ingestion v0.17 even the documentation says it is possible (https://druid.apache.org/docs/latest/ingestion/native-batch.html#hdfs-input-source):
Failed to submit task: Could not resolve type id 'hdfs' as a subtype of `org.apache.druid.data.input.InputSource`: known type ids = [druid, http, inline, local] (for POJO property 'inputSource') at [Source: (org.eclipse.jetty.server.HttpInputOverHTTP); line: 1, column: 5067] (through reference chain: org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexSupervisorTask["spec"]->org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexIngestionSpec["ioConfig"]->org.apache.druid.indexing.common.task.batch.parallel.ParallelIndexIOConfig["inputSource"])
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson commented on issue #9443: Hdfs inputSource not
supported by native batch ingestion v0.17
Posted by GitBox <gi...@apache.org>.
jihoonson commented on issue #9443: Hdfs inputSource not supported by native batch ingestion v0.17
URL: https://github.com/apache/druid/issues/9443#issuecomment-597248502
If you have loaded it, it should be logged at the beginning of the task logs. Would you please check the task logs?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jalbs commented on issue #9443: Hdfs inputSource not
supported by native batch ingestion v0.17
Posted by GitBox <gi...@apache.org>.
jalbs commented on issue #9443: Hdfs inputSource not supported by native batch ingestion v0.17
URL: https://github.com/apache/druid/issues/9443#issuecomment-597234575
Yes, I have that extension loaded along with parquet, avro and mysql-metadata
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson edited a comment on issue #9443: Hdfs inputSource
not supported by native batch ingestion v0.17
Posted by GitBox <gi...@apache.org>.
jihoonson edited a comment on issue #9443: Hdfs inputSource not supported by native batch ingestion v0.17
URL: https://github.com/apache/druid/issues/9443#issuecomment-593130415
Hi, did you include the `druid-hdfs-storage` extension in your load list? How to load an extension is explained in the document you linked.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org
[GitHub] [druid] jihoonson commented on issue #9443: Hdfs inputSource not
supported by native batch ingestion v0.17
Posted by GitBox <gi...@apache.org>.
jihoonson commented on issue #9443: Hdfs inputSource not supported by native batch ingestion v0.17
URL: https://github.com/apache/druid/issues/9443#issuecomment-593130415
Hi, did you include the `druid-hdfs-storage` extension in your load list? How to load extension is explained in the document you linked.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org