You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Vinay varma (JIRA)" <ji...@apache.org> on 2018/01/10 07:46:00 UTC
[jira] [Updated] (BEAM-3446) RedisIO non-prefix read operations
[ https://issues.apache.org/jira/browse/BEAM-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay varma updated BEAM-3446:
------------------------------
Description:
Read operation in RedisIO is for prefix based look ups. While this can be used for exact key matches as well, the number of operations limits the through put of the function.
I suggest exposing current readAll operation as readbyprefix and using more simpler operations for readAll functionality.
ex:
{code:java}
String output = jedis.get(element);
if (output != null) {
processContext.output(KV.of(element, output));
}
{code}
instead of:
https://github.com/apache/beam/blob/7d240c0bb171af6868f1a6e95196c9dcfc9ac640/sdks/java/io/redis/src/main/java/org/apache/beam/sdk/io/redis/RedisIO.java#L292
was:
Read operation in RedisIO is for prefix based look ups. While this can be used for exact key matches as well, the number of operations limits the through put of the function.
I suggest exposing current readAll operation as readbyprefix and using more simpler operations for readAll functionality.
ex:
{code:java}
String output = jedis.get(element);
if (output != null) {
processContext.output(KV.of(element, output));
}
{code}
> RedisIO non-prefix read operations
> ----------------------------------
>
> Key: BEAM-3446
> URL: https://issues.apache.org/jira/browse/BEAM-3446
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-extensions
> Reporter: Vinay varma
> Assignee: Reuven Lax
>
> Read operation in RedisIO is for prefix based look ups. While this can be used for exact key matches as well, the number of operations limits the through put of the function.
> I suggest exposing current readAll operation as readbyprefix and using more simpler operations for readAll functionality.
> ex:
> {code:java}
> String output = jedis.get(element);
> if (output != null) {
> processContext.output(KV.of(element, output));
> }
> {code}
> instead of:
> https://github.com/apache/beam/blob/7d240c0bb171af6868f1a6e95196c9dcfc9ac640/sdks/java/io/redis/src/main/java/org/apache/beam/sdk/io/redis/RedisIO.java#L292
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)