You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Mike Thomsen <mi...@gmail.com> on 2019/09/13 10:07:50 UTC
Custom filter appears to just hang
https://gist.github.com/MikeThomsen/ed3e742d13adeb63d45ceca7a09bf176
I'm running this in standalone mode, with the jar file in the HBase lib
folder. When I run the client side of it, it gets to the print statement
that says Fetching.... and then just hangs. When I take the filter off the
Get, it pulls the row just fine. Can someone give me some help on why it
might be hanging?
Thanks,
Mike
Re: Custom filter appears to just hang
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Maybe you can try to surround all your methods with giant try/catch
statements and log what ever you might get? Might help to catch an
exception that is drop somewhere?
Le mar. 17 sept. 2019 à 06:24, Mike Thomsen <mi...@gmail.com> a
écrit :
> Do you know of any third party filters that are posted somewhere where I
> could do that?
>
> On Mon, Sep 16, 2019 at 5:55 PM Stack <st...@duboce.net> wrote:
>
> > On Sun, Sep 15, 2019 at 9:35 AM Mike Thomsen <mi...@gmail.com>
> > wrote:
> >
> > > So that's just it, I don't see any errors at all on either the client
> > side
> > > or the server side. I'm running this against HBase 2.0.5, and I didn't
> > see
> > > anything showing up. Granted, I'm running server in local mode with
> just
> > > "bin/hbase master start" and letting it manage ZK and create one
> > > regionserver that way. As I said, I can read and write data just fine
> > with
> > > this setup until I throw the filter into the mix and then it
> mysteriously
> > > hangs.
> > >
> > > I've uploaded the whole project here, including the protobuf section:
> > >
> > > https://github.com/MikeThomsen/hbase-test
> > >
> > > Thanks,
> > >
> > >
> > This stuff can be tricky to dev. If mismatch in rpc or error formulating
> > response, the exceptions can be dropped and not make it out in log or on
> > client-side. Can you printf your filter code? Or use an existing working
> > one and slowly pull it over to do as you want.
> > S
> >
> >
> >
> > > Mike
> > >
> > > On Fri, Sep 13, 2019 at 12:33 PM Esteban Gutierrez
> > > <es...@cloudera.com.invalid> wrote:
> > >
> > > > Hi Mike,
> > > >
> > > > What errors do you see in the RegionServer or Client logs? Did you
> > > > generated the Java class files for SimpleFilter from a proto file?
> The
> > > > HBase Definitive Guide as a good example about how to write and
> deploy
> > > > custom filters:
> > > >
> > > >
> > >
> >
> https://www.oreilly.com/library/view/hbase-the-definitive/9781492024255/ch04.html
> > > > see Example 4-23 and Example 4-24.
> > > >
> > > > But depending on the version of HBase you are using you might have to
> > > also
> > > > take a look a the Protobuf section in the HBase Reference Guide to
> see
> > > > where you should create the proto files and which jar should be used
> > > > (shaded vs non-shaded) : https://hbase.apache.org/book.html#protobuf
> > > >
> > > > thanks,
> > > > esteban.
> > > >
> > > > --
> > > > Cloudera, Inc.
> > > >
> > > >
> > > >
> > > > On Fri, Sep 13, 2019 at 6:54 AM Mike Thomsen <mikerthomsen@gmail.com
> >
> > > > wrote:
> > > >
> > > > >
> https://gist.github.com/MikeThomsen/ed3e742d13adeb63d45ceca7a09bf176
> > > > >
> > > > > I'm running this in standalone mode, with the jar file in the HBase
> > lib
> > > > > folder. When I run the client side of it, it gets to the print
> > > statement
> > > > > that says Fetching.... and then just hangs. When I take the filter
> > off
> > > > the
> > > > > Get, it pulls the row just fine. Can someone give me some help on
> why
> > > it
> > > > > might be hanging?
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Mike
> > > > >
> > > >
> > >
> >
>
Re: Custom filter appears to just hang
Posted by Mike Thomsen <mi...@gmail.com>.
Do you know of any third party filters that are posted somewhere where I
could do that?
On Mon, Sep 16, 2019 at 5:55 PM Stack <st...@duboce.net> wrote:
> On Sun, Sep 15, 2019 at 9:35 AM Mike Thomsen <mi...@gmail.com>
> wrote:
>
> > So that's just it, I don't see any errors at all on either the client
> side
> > or the server side. I'm running this against HBase 2.0.5, and I didn't
> see
> > anything showing up. Granted, I'm running server in local mode with just
> > "bin/hbase master start" and letting it manage ZK and create one
> > regionserver that way. As I said, I can read and write data just fine
> with
> > this setup until I throw the filter into the mix and then it mysteriously
> > hangs.
> >
> > I've uploaded the whole project here, including the protobuf section:
> >
> > https://github.com/MikeThomsen/hbase-test
> >
> > Thanks,
> >
> >
> This stuff can be tricky to dev. If mismatch in rpc or error formulating
> response, the exceptions can be dropped and not make it out in log or on
> client-side. Can you printf your filter code? Or use an existing working
> one and slowly pull it over to do as you want.
> S
>
>
>
> > Mike
> >
> > On Fri, Sep 13, 2019 at 12:33 PM Esteban Gutierrez
> > <es...@cloudera.com.invalid> wrote:
> >
> > > Hi Mike,
> > >
> > > What errors do you see in the RegionServer or Client logs? Did you
> > > generated the Java class files for SimpleFilter from a proto file? The
> > > HBase Definitive Guide as a good example about how to write and deploy
> > > custom filters:
> > >
> > >
> >
> https://www.oreilly.com/library/view/hbase-the-definitive/9781492024255/ch04.html
> > > see Example 4-23 and Example 4-24.
> > >
> > > But depending on the version of HBase you are using you might have to
> > also
> > > take a look a the Protobuf section in the HBase Reference Guide to see
> > > where you should create the proto files and which jar should be used
> > > (shaded vs non-shaded) : https://hbase.apache.org/book.html#protobuf
> > >
> > > thanks,
> > > esteban.
> > >
> > > --
> > > Cloudera, Inc.
> > >
> > >
> > >
> > > On Fri, Sep 13, 2019 at 6:54 AM Mike Thomsen <mi...@gmail.com>
> > > wrote:
> > >
> > > > https://gist.github.com/MikeThomsen/ed3e742d13adeb63d45ceca7a09bf176
> > > >
> > > > I'm running this in standalone mode, with the jar file in the HBase
> lib
> > > > folder. When I run the client side of it, it gets to the print
> > statement
> > > > that says Fetching.... and then just hangs. When I take the filter
> off
> > > the
> > > > Get, it pulls the row just fine. Can someone give me some help on why
> > it
> > > > might be hanging?
> > > >
> > > > Thanks,
> > > >
> > > > Mike
> > > >
> > >
> >
>
Re: Custom filter appears to just hang
Posted by Stack <st...@duboce.net>.
On Sun, Sep 15, 2019 at 9:35 AM Mike Thomsen <mi...@gmail.com> wrote:
> So that's just it, I don't see any errors at all on either the client side
> or the server side. I'm running this against HBase 2.0.5, and I didn't see
> anything showing up. Granted, I'm running server in local mode with just
> "bin/hbase master start" and letting it manage ZK and create one
> regionserver that way. As I said, I can read and write data just fine with
> this setup until I throw the filter into the mix and then it mysteriously
> hangs.
>
> I've uploaded the whole project here, including the protobuf section:
>
> https://github.com/MikeThomsen/hbase-test
>
> Thanks,
>
>
This stuff can be tricky to dev. If mismatch in rpc or error formulating
response, the exceptions can be dropped and not make it out in log or on
client-side. Can you printf your filter code? Or use an existing working
one and slowly pull it over to do as you want.
S
> Mike
>
> On Fri, Sep 13, 2019 at 12:33 PM Esteban Gutierrez
> <es...@cloudera.com.invalid> wrote:
>
> > Hi Mike,
> >
> > What errors do you see in the RegionServer or Client logs? Did you
> > generated the Java class files for SimpleFilter from a proto file? The
> > HBase Definitive Guide as a good example about how to write and deploy
> > custom filters:
> >
> >
> https://www.oreilly.com/library/view/hbase-the-definitive/9781492024255/ch04.html
> > see Example 4-23 and Example 4-24.
> >
> > But depending on the version of HBase you are using you might have to
> also
> > take a look a the Protobuf section in the HBase Reference Guide to see
> > where you should create the proto files and which jar should be used
> > (shaded vs non-shaded) : https://hbase.apache.org/book.html#protobuf
> >
> > thanks,
> > esteban.
> >
> > --
> > Cloudera, Inc.
> >
> >
> >
> > On Fri, Sep 13, 2019 at 6:54 AM Mike Thomsen <mi...@gmail.com>
> > wrote:
> >
> > > https://gist.github.com/MikeThomsen/ed3e742d13adeb63d45ceca7a09bf176
> > >
> > > I'm running this in standalone mode, with the jar file in the HBase lib
> > > folder. When I run the client side of it, it gets to the print
> statement
> > > that says Fetching.... and then just hangs. When I take the filter off
> > the
> > > Get, it pulls the row just fine. Can someone give me some help on why
> it
> > > might be hanging?
> > >
> > > Thanks,
> > >
> > > Mike
> > >
> >
>
Re: Custom filter appears to just hang
Posted by Mike Thomsen <mi...@gmail.com>.
So that's just it, I don't see any errors at all on either the client side
or the server side. I'm running this against HBase 2.0.5, and I didn't see
anything showing up. Granted, I'm running server in local mode with just
"bin/hbase master start" and letting it manage ZK and create one
regionserver that way. As I said, I can read and write data just fine with
this setup until I throw the filter into the mix and then it mysteriously
hangs.
I've uploaded the whole project here, including the protobuf section:
https://github.com/MikeThomsen/hbase-test
Thanks,
Mike
On Fri, Sep 13, 2019 at 12:33 PM Esteban Gutierrez
<es...@cloudera.com.invalid> wrote:
> Hi Mike,
>
> What errors do you see in the RegionServer or Client logs? Did you
> generated the Java class files for SimpleFilter from a proto file? The
> HBase Definitive Guide as a good example about how to write and deploy
> custom filters:
>
> https://www.oreilly.com/library/view/hbase-the-definitive/9781492024255/ch04.html
> see Example 4-23 and Example 4-24.
>
> But depending on the version of HBase you are using you might have to also
> take a look a the Protobuf section in the HBase Reference Guide to see
> where you should create the proto files and which jar should be used
> (shaded vs non-shaded) : https://hbase.apache.org/book.html#protobuf
>
> thanks,
> esteban.
>
> --
> Cloudera, Inc.
>
>
>
> On Fri, Sep 13, 2019 at 6:54 AM Mike Thomsen <mi...@gmail.com>
> wrote:
>
> > https://gist.github.com/MikeThomsen/ed3e742d13adeb63d45ceca7a09bf176
> >
> > I'm running this in standalone mode, with the jar file in the HBase lib
> > folder. When I run the client side of it, it gets to the print statement
> > that says Fetching.... and then just hangs. When I take the filter off
> the
> > Get, it pulls the row just fine. Can someone give me some help on why it
> > might be hanging?
> >
> > Thanks,
> >
> > Mike
> >
>
Re: Custom filter appears to just hang
Posted by Esteban Gutierrez <es...@cloudera.com.INVALID>.
Hi Mike,
What errors do you see in the RegionServer or Client logs? Did you
generated the Java class files for SimpleFilter from a proto file? The
HBase Definitive Guide as a good example about how to write and deploy
custom filters:
https://www.oreilly.com/library/view/hbase-the-definitive/9781492024255/ch04.html
see Example 4-23 and Example 4-24.
But depending on the version of HBase you are using you might have to also
take a look a the Protobuf section in the HBase Reference Guide to see
where you should create the proto files and which jar should be used
(shaded vs non-shaded) : https://hbase.apache.org/book.html#protobuf
thanks,
esteban.
--
Cloudera, Inc.
On Fri, Sep 13, 2019 at 6:54 AM Mike Thomsen <mi...@gmail.com> wrote:
> https://gist.github.com/MikeThomsen/ed3e742d13adeb63d45ceca7a09bf176
>
> I'm running this in standalone mode, with the jar file in the HBase lib
> folder. When I run the client side of it, it gets to the print statement
> that says Fetching.... and then just hangs. When I take the filter off the
> Get, it pulls the row just fine. Can someone give me some help on why it
> might be hanging?
>
> Thanks,
>
> Mike
>