You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by David Garcia <da...@spiceworks.com> on 2017/03/03 23:36:39 UTC

TimeBasePartitioner for confluent

Trying to user s3-loader and am getting this error:

org.apache.kafka.common.config.ConfigException: Invalid generator class: class io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator
                at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.newSchemaGenerator(TimeBasedPartitioner.java:107)
                at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.init(TimeBasedPartitioner.java:44)
                at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.configure(TimeBasedPartitioner.java:87)
                at io.confluent.connect.s3.S3SinkTask.newPartitioner(S3SinkTask.java:146)
                at io.confluent.connect.s3.S3SinkTask.start(S3SinkTask.java:100)
                at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:231)
                at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:145)
                at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:139)
                at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:182)


perhaps this is a configuration issue?

-David

Re: TimeBasePartitioner for confluent

Posted by David Garcia <da...@spiceworks.com>.
Gah…nm…looked at source code…use this:

schema.generator.class=io.confluent.connect.storage.hive.schema.TimeBasedSchemaGenerator

On 3/3/17, 5:36 PM, "David Garcia" <da...@spiceworks.com> wrote:

    Trying to user s3-loader and am getting this error:
    
    org.apache.kafka.common.config.ConfigException: Invalid generator class: class io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator
                    at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.newSchemaGenerator(TimeBasedPartitioner.java:107)
                    at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.init(TimeBasedPartitioner.java:44)
                    at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.configure(TimeBasedPartitioner.java:87)
                    at io.confluent.connect.s3.S3SinkTask.newPartitioner(S3SinkTask.java:146)
                    at io.confluent.connect.s3.S3SinkTask.start(S3SinkTask.java:100)
                    at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:231)
                    at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:145)
                    at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:139)
                    at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:182)
    
    
    perhaps this is a configuration issue?
    
    -David