You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by David Garcia <da...@spiceworks.com> on 2017/03/03 23:36:39 UTC
TimeBasePartitioner for confluent
Trying to user s3-loader and am getting this error:
org.apache.kafka.common.config.ConfigException: Invalid generator class: class io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator
at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.newSchemaGenerator(TimeBasedPartitioner.java:107)
at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.init(TimeBasedPartitioner.java:44)
at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.configure(TimeBasedPartitioner.java:87)
at io.confluent.connect.s3.S3SinkTask.newPartitioner(S3SinkTask.java:146)
at io.confluent.connect.s3.S3SinkTask.start(S3SinkTask.java:100)
at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:231)
at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:145)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:139)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:182)
perhaps this is a configuration issue?
-David
Re: TimeBasePartitioner for confluent
Posted by David Garcia <da...@spiceworks.com>.
Gah…nm…looked at source code…use this:
schema.generator.class=io.confluent.connect.storage.hive.schema.TimeBasedSchemaGenerator
On 3/3/17, 5:36 PM, "David Garcia" <da...@spiceworks.com> wrote:
Trying to user s3-loader and am getting this error:
org.apache.kafka.common.config.ConfigException: Invalid generator class: class io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator
at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.newSchemaGenerator(TimeBasedPartitioner.java:107)
at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.init(TimeBasedPartitioner.java:44)
at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.configure(TimeBasedPartitioner.java:87)
at io.confluent.connect.s3.S3SinkTask.newPartitioner(S3SinkTask.java:146)
at io.confluent.connect.s3.S3SinkTask.start(S3SinkTask.java:100)
at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:231)
at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:145)
at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:139)
at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:182)
perhaps this is a configuration issue?
-David