You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by FO O <fo...@gmail.com> on 2020/03/21 20:47:24 UTC
Could not load key generator class org.apache.hudi.ComplexKeyGenerator
Hi,
When trying to use a ComplexKeyGenerator with 0.5.1 I get the following
error:
"Exception in thread "main" java.io.IOException: Could not load key
generator class org.apache.hudi.ComplexKeyGenerator"
https://gist.github.com/fo3310001/5a998b73a95f734b2852fc1c8689dd62
The command I am using is passing the hudi-utilities-bundle:
spark-submit --class
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer --packages
org.apache.spark:spark-avro_2.11:2.4.4 --master yarn --deploy-mode client
/usr/lib/hudi/hudi-utilities-bundle_2.11-0.5.1-incubating.jar (...)
Any pointers would be appreciated.
Thank you!
Re: Could not load key generator class org.apache.hudi.ComplexKeyGenerator
Posted by FO O <fo...@gmail.com>.
Thank you Balaji, all set.
Balaji Varadarajan <v....@ymail.com.invalid> escreveu no dia sábado,
21/03/2020 à(s) 16:53:
> With 0.5.1, the key-generator classes are relocated to
> org.apache.hudi.keygen.
> You can find the information in release notes in
> https://hudi.incubator.apache.org/releases.html#release-051-incubating-docs
> Balaji.V On Saturday, March 21, 2020, 01:47:48 PM PDT, FO O <
> fo3310001@gmail.com> wrote:
>
> Hi,
>
> When trying to use a ComplexKeyGenerator with 0.5.1 I get the following
> error:
> "Exception in thread "main" java.io.IOException: Could not load key
> generator class org.apache.hudi.ComplexKeyGenerator"
>
> https://gist.github.com/fo3310001/5a998b73a95f734b2852fc1c8689dd62
>
>
> The command I am using is passing the hudi-utilities-bundle:
>
> spark-submit --class
> org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer --packages
> org.apache.spark:spark-avro_2.11:2.4.4 --master yarn --deploy-mode client
> /usr/lib/hudi/hudi-utilities-bundle_2.11-0.5.1-incubating.jar (...)
>
> Any pointers would be appreciated.
>
> Thank you!
>
Re: Could not load key generator class
org.apache.hudi.ComplexKeyGenerator
Posted by Balaji Varadarajan <v....@ymail.com.INVALID>.
With 0.5.1, the key-generator classes are relocated to org.apache.hudi.keygen.
You can find the information in release notes in https://hudi.incubator.apache.org/releases.html#release-051-incubating-docs
Balaji.V On Saturday, March 21, 2020, 01:47:48 PM PDT, FO O <fo...@gmail.com> wrote:
Hi,
When trying to use a ComplexKeyGenerator with 0.5.1 I get the following
error:
"Exception in thread "main" java.io.IOException: Could not load key
generator class org.apache.hudi.ComplexKeyGenerator"
https://gist.github.com/fo3310001/5a998b73a95f734b2852fc1c8689dd62
The command I am using is passing the hudi-utilities-bundle:
spark-submit --class
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer --packages
org.apache.spark:spark-avro_2.11:2.4.4 --master yarn --deploy-mode client
/usr/lib/hudi/hudi-utilities-bundle_2.11-0.5.1-incubating.jar (...)
Any pointers would be appreciated.
Thank you!