You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Gaurav Kanade <ga...@gmail.com> on 2016/02/19 18:54:25 UTC
YCSB with Phoenix?
Hi All
I am relatively new to Phoenix and was working on some performance
tuning/benchmarking experiments and tried to search online for whether
there exists YCSB client to go through Phoenix.
I came across this https://github.com/brianfrankcooper/YCSB/pull/178 and
some related links but it seems this didnt seem to have moved forward.
Could someone help me know where to look for the latest status on this ?
Does there exist an easy way to test Phoenix via YCSB and if not what are
the other existing options?
Best,
Gaurav
Re: YCSB with Phoenix?
Posted by Andrew Purtell <an...@gmail.com>.
Never mind that last question. Check the email thread and ye shall find the answer...
> On Feb 19, 2016, at 11:10 AM, Andrew Purtell <an...@gmail.com> wrote:
>
> The brianfrankcooper github repo (https://github.com/brianfrankcooper/YCSB) is still the "official" home of YCSB as far as I know. YCSB ships with a JDBC client driver. Just use that with the Phoenix client jar on the classpath and the correct connection string for Phoenix.
>
> What patch is this James? Does it change or improve the YCSB JDBC driver?
>
>> On Feb 19, 2016, at 10:58 AM, James Taylor <ja...@apache.org> wrote:
>>
>> I believe some folks over in the HBase community have revived YCSB, but I'm not sure where it's new home is. Also, not sure if they applied Mujtaba's patch. I'd recommend asking over on the HBase dev or user list.
>>
>> FWIW, we developed Pherf to enable Phoenix users to compare various Phoenix configurations and schemas for a given use case against each other. It's also super useful to catch performance and functional regressions with representative data sizes.
>>
>> Thanks,
>>
>> James
>>
>>> On Fri, Feb 19, 2016 at 10:38 AM, Mujtaba Chohan <mu...@apache.org> wrote:
>>> You can apply this patch on YCSB to test out Phoenix with variable number of VARCHAR fields as well as test out combination of single/multiple CFs, compression and salt buckets. See usage details here.
>>>
>>> You can also use Pherf which is a Phoenix specific performance test suite that uses XML scenario to define how synthetic data is generated and queried. It's launcher scripts are in phoenix/bin directory.
>>>
>>> HTH
>>>
>>>> On Fri, Feb 19, 2016 at 9:54 AM, Gaurav Kanade <ga...@gmail.com> wrote:
>>>> Hi All
>>>>
>>>> I am relatively new to Phoenix and was working on some performance tuning/benchmarking experiments and tried to search online for whether there exists YCSB client to go through Phoenix.
>>>>
>>>> I came across this https://github.com/brianfrankcooper/YCSB/pull/178 and some related links but it seems this didnt seem to have moved forward.
>>>>
>>>> Could someone help me know where to look for the latest status on this ? Does there exist an easy way to test Phoenix via YCSB and if not what are the other existing options?
>>>>
>>>> Best,
>>>> Gaurav
>>>>
>>>>
>>>
>>
Re: YCSB with Phoenix?
Posted by Andrew Purtell <an...@gmail.com>.
The brianfrankcooper github repo (https://github.com/brianfrankcooper/YCSB) is still the "official" home of YCSB as far as I know. YCSB ships with a JDBC client driver. Just use that with the Phoenix client jar on the classpath and the correct connection string for Phoenix.
What patch is this James? Does it change or improve the YCSB JDBC driver?
> On Feb 19, 2016, at 10:58 AM, James Taylor <ja...@apache.org> wrote:
>
> I believe some folks over in the HBase community have revived YCSB, but I'm not sure where it's new home is. Also, not sure if they applied Mujtaba's patch. I'd recommend asking over on the HBase dev or user list.
>
> FWIW, we developed Pherf to enable Phoenix users to compare various Phoenix configurations and schemas for a given use case against each other. It's also super useful to catch performance and functional regressions with representative data sizes.
>
> Thanks,
>
> James
>
>> On Fri, Feb 19, 2016 at 10:38 AM, Mujtaba Chohan <mu...@apache.org> wrote:
>> You can apply this patch on YCSB to test out Phoenix with variable number of VARCHAR fields as well as test out combination of single/multiple CFs, compression and salt buckets. See usage details here.
>>
>> You can also use Pherf which is a Phoenix specific performance test suite that uses XML scenario to define how synthetic data is generated and queried. It's launcher scripts are in phoenix/bin directory.
>>
>> HTH
>>
>>> On Fri, Feb 19, 2016 at 9:54 AM, Gaurav Kanade <ga...@gmail.com> wrote:
>>> Hi All
>>>
>>> I am relatively new to Phoenix and was working on some performance tuning/benchmarking experiments and tried to search online for whether there exists YCSB client to go through Phoenix.
>>>
>>> I came across this https://github.com/brianfrankcooper/YCSB/pull/178 and some related links but it seems this didnt seem to have moved forward.
>>>
>>> Could someone help me know where to look for the latest status on this ? Does there exist an easy way to test Phoenix via YCSB and if not what are the other existing options?
>>>
>>> Best,
>>> Gaurav
>
Re: YCSB with Phoenix?
Posted by James Taylor <ja...@apache.org>.
I believe some folks over in the HBase community have revived YCSB, but I'm
not sure where it's new home is. Also, not sure if they applied Mujtaba's
patch. I'd recommend asking over on the HBase dev or user list.
FWIW, we developed Pherf to enable Phoenix users to compare various Phoenix
configurations and schemas for a given use case against each other. It's
also super useful to catch performance and functional regressions with
representative data sizes.
Thanks,
James
On Fri, Feb 19, 2016 at 10:38 AM, Mujtaba Chohan <mu...@apache.org> wrote:
> You can apply this patch on YCSB to test out Phoenix with variable number
> of VARCHAR fields as well as test out combination of single/multiple CFs,
> compression and salt buckets. See usage details here
> <https://github.com/mujtabachohan/YCSB/blob/2bcad91e2f6fd9c6041931fe9a423c0564201dc9/phoenix/src/main/java/com/yahoo/ycsb/db/PhoenixCreateTable.java>.
>
>
> You can also use Pherf
> <https://git-wip-us.apache.org/repos/asf?p=phoenix.git;a=tree;f=phoenix-pherf;h=661c6ec623946241e9799f1a11cb8547bfc43ddf;hb=refs/heads/4.x-HBase-0.98>
> which is a Phoenix specific performance test suite that uses XML scenario
> to define how synthetic data is generated and queried. It's launcher
> scripts are in phoenix/bin directory.
>
> HTH
>
> On Fri, Feb 19, 2016 at 9:54 AM, Gaurav Kanade <ga...@gmail.com>
> wrote:
>
>> Hi All
>>
>> I am relatively new to Phoenix and was working on some performance
>> tuning/benchmarking experiments and tried to search online for whether
>> there exists YCSB client to go through Phoenix.
>>
>> I came across this https://github.com/brianfrankcooper/YCSB/pull/178 and
>> some related links but it seems this didnt seem to have moved forward.
>>
>> Could someone help me know where to look for the latest status on this ?
>> Does there exist an easy way to test Phoenix via YCSB and if not what are
>> the other existing options?
>>
>> Best,
>> Gaurav
>>
>>
>>
>
Re: YCSB with Phoenix?
Posted by Mujtaba Chohan <mu...@apache.org>.
You can apply this patch on YCSB to test out Phoenix with variable number
of VARCHAR fields as well as test out combination of single/multiple CFs,
compression and salt buckets. See usage details here
<https://github.com/mujtabachohan/YCSB/blob/2bcad91e2f6fd9c6041931fe9a423c0564201dc9/phoenix/src/main/java/com/yahoo/ycsb/db/PhoenixCreateTable.java>.
You can also use Pherf
<https://git-wip-us.apache.org/repos/asf?p=phoenix.git;a=tree;f=phoenix-pherf;h=661c6ec623946241e9799f1a11cb8547bfc43ddf;hb=refs/heads/4.x-HBase-0.98>
which is a Phoenix specific performance test suite that uses XML scenario
to define how synthetic data is generated and queried. It's launcher
scripts are in phoenix/bin directory.
HTH
On Fri, Feb 19, 2016 at 9:54 AM, Gaurav Kanade <ga...@gmail.com>
wrote:
> Hi All
>
> I am relatively new to Phoenix and was working on some performance
> tuning/benchmarking experiments and tried to search online for whether
> there exists YCSB client to go through Phoenix.
>
> I came across this https://github.com/brianfrankcooper/YCSB/pull/178 and
> some related links but it seems this didnt seem to have moved forward.
>
> Could someone help me know where to look for the latest status on this ?
> Does there exist an easy way to test Phoenix via YCSB and if not what are
> the other existing options?
>
> Best,
> Gaurav
>
>
>