You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by Vicky Kak <vi...@gmail.com> on 2018/04/23 09:10:04 UTC

ZK StateStore Factory issue.

Hi All,

I have been trying to configure the ZK Statestore for the Standalone
cluster, I have been getting the issue as the "zk" alias was not resolved
by the ClassAlaisResolver. There are multiple classes with the "zk" alias,
one being ZkDatasetStateStoreFactory and the other one ZkStateStoreFactory,
the ZkStateStoreFactory which is packaged with the gobblin-helix.jar is not
present in the distribution and thus leading to class not found exception.
I verify this by manually copying the gobblin-helix.jar to the
$GOBBLIN_HOME/lib, things started working after I did this.

This look a bug to be which can be fixed by modifying the build by copying
the gobblin-helix related jar to the distribution.

I would like to hear if anyone else out there is using the zk statestore
and have experienced this issue before raising a JIRA.

Thanks,
Vicky

Re: ZK StateStore Factory issue.

Posted by Hung Tran <hu...@linkedin.com>.
Hi Vicky,


gobblin-helix is not part of the standard build flavor. You can modify the the standard build flavor file or create a new one and pass the -PgobblinFlavor=<custom flavor name> option to gradle.


Hung.

________________________________
From: Vicky Kak <vi...@gmail.com>
Sent: Monday, April 23, 2018 2:10:04 AM
To: dev@gobblin.incubator.apache.org
Subject: ZK StateStore Factory issue.

Hi All,

I have been trying to configure the ZK Statestore for the Standalone
cluster, I have been getting the issue as the "zk" alias was not resolved
by the ClassAlaisResolver. There are multiple classes with the "zk" alias,
one being ZkDatasetStateStoreFactory and the other one ZkStateStoreFactory,
the ZkStateStoreFactory which is packaged with the gobblin-helix.jar is not
present in the distribution and thus leading to class not found exception.
I verify this by manually copying the gobblin-helix.jar to the
$GOBBLIN_HOME/lib, things started working after I did this.

This look a bug to be which can be fixed by modifying the build by copying
the gobblin-helix related jar to the distribution.

I would like to hear if anyone else out there is using the zk statestore
and have experienced this issue before raising a JIRA.

Thanks,
Vicky

Re: ZK StateStore Factory issue.

Posted by Vicky Kak <vi...@gmail.com>.
I have created the JIRA
https://issues.apache.org/jira/browse/GOBBLIN-472

On Tue, Apr 24, 2018 at 5:10 AM, Abhishek Tiwari <fi...@gmail.com> wrote:

> Our internal distribution specifically bundles all deps. So, this might be
> an actual issue with standard distribution. We should possibly fix the
> standard build flavor to include this module.
>
> Abhishek
>
> On Mon, Apr 23, 2018 at 2:10 AM, Vicky Kak <vi...@gmail.com> wrote:
>
> > Hi All,
> >
> > I have been trying to configure the ZK Statestore for the Standalone
> > cluster, I have been getting the issue as the "zk" alias was not resolved
> > by the ClassAlaisResolver. There are multiple classes with the "zk"
> alias,
> > one being ZkDatasetStateStoreFactory and the other one
> ZkStateStoreFactory,
> > the ZkStateStoreFactory which is packaged with the gobblin-helix.jar is
> not
> > present in the distribution and thus leading to class not found
> exception.
> > I verify this by manually copying the gobblin-helix.jar to the
> > $GOBBLIN_HOME/lib, things started working after I did this.
> >
> > This look a bug to be which can be fixed by modifying the build by
> copying
> > the gobblin-helix related jar to the distribution.
> >
> > I would like to hear if anyone else out there is using the zk statestore
> > and have experienced this issue before raising a JIRA.
> >
> > Thanks,
> > Vicky
> >
>

Re: ZK StateStore Factory issue.

Posted by Abhishek Tiwari <fi...@gmail.com>.
Our internal distribution specifically bundles all deps. So, this might be
an actual issue with standard distribution. We should possibly fix the
standard build flavor to include this module.

Abhishek

On Mon, Apr 23, 2018 at 2:10 AM, Vicky Kak <vi...@gmail.com> wrote:

> Hi All,
>
> I have been trying to configure the ZK Statestore for the Standalone
> cluster, I have been getting the issue as the "zk" alias was not resolved
> by the ClassAlaisResolver. There are multiple classes with the "zk" alias,
> one being ZkDatasetStateStoreFactory and the other one ZkStateStoreFactory,
> the ZkStateStoreFactory which is packaged with the gobblin-helix.jar is not
> present in the distribution and thus leading to class not found exception.
> I verify this by manually copying the gobblin-helix.jar to the
> $GOBBLIN_HOME/lib, things started working after I did this.
>
> This look a bug to be which can be fixed by modifying the build by copying
> the gobblin-helix related jar to the distribution.
>
> I would like to hear if anyone else out there is using the zk statestore
> and have experienced this issue before raising a JIRA.
>
> Thanks,
> Vicky
>