You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ignite.apache.org by Dmitriy Setrakyan <ds...@apache.org> on 2017/09/02 23:10:19 UTC
DataStreamer usability
Igniters,
I am noticing quite a few issues on the user list and Stack Overflow that
have to do with Data Streamer usability. Here is just one example:
https://stackoverflow.com/questions/46015833/datastreamer-adddata-method-not-work-as-expected-in-cluster
I think, as a community, we should try to analyze all the issues and figure
out why the users are struggling.
Does anyone have a good sense for what is happening?
D.
Re: DataStreamer usability
Posted by Denis Mekhanikov <dm...@gmail.com>.
Here is another little example of non-obvious DataStreamer-related API:
https://stackoverflow.com/questions/46045987/unknown-pair-exception-when-using-streamtransformer-for-binaryobject/46051447?noredirect=1#comment79063618_46051447
I think, passing new value as the first element of Object array is
confusing. It wasn't obvious to me.
- Denis.
пн, 4 сент. 2017 г. в 0:21, Dmitriy Setrakyan <ds...@apache.org>:
> On Sun, Sep 3, 2017 at 11:42 AM, Evgenii Zhuravlev <
> e.zhuravlev.wk@gmail.com
> > wrote:
>
> > >But why would anyone have different configurations for streaming into
> the
> > >same cache on the same node? In this case, we should print out a warning
> > if
> > >the configuration of one streamer is different from another. Agree?
> >
> > Well, I have not come across the necessity to use different
> > datastreamers on one node in use cases I've seen. But at the same time, I
> > can come up with the use case in order to configure different
> > StreamReceivers when uploading data from different data sources.
> >
>
> Evgenii, I agree with you. But a simple warning here to alert the user
> about the config differences could go a long way.
>
>
> >
> > Evgenii
> >
> > 2017-09-03 20:18 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> >
> > > On Sun, Sep 3, 2017 at 10:09 AM, Evgenii Zhuravlev <
> > > e.zhuravlev.wk@gmail.com
> > > > wrote:
> > >
> > > > Dmitriy,
> > > >
> > > > >Disagree. This is an Ignite issue, not a user issue. We must detect
> > this
> > > > >and either provide a user with a warning message or disallow 2
> > streamers
> > > > >with identical names.
> > > > >Makes sense?
> > > >
> > > > It's not a streamer name we apply as an argument, it's a cache name.
> > So,
> > > > it's possible to use a different Data Streamers from different nodes
> > for
> > > > the one cache or even different streamers for one cache on the one
> > node.
> > > >
> > >
> > > But why would anyone have different configurations for streaming into
> the
> > > same cache on the same node? In this case, we should print out a
> warning
> > if
> > > the configuration of one streamer is different from another. Agree?
> > >
> > >
> > > >
> > > > Evgenii
> > > >
> > > >
> > > > 2017-09-03 19:59 GMT+03:00 Dmitriy Setrakyan <dsetrakyan@apache.org
> >:
> > > >
> > > > > On Sun, Sep 3, 2017 at 9:36 AM, Evgenii Zhuravlev <
> > > > > e.zhuravlev.wk@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > What about this SO question - I think it could be a good idea to
> > add
> > > > some
> > > > > > additional validation between nodes configurations at node's
> start.
> > > > > > Because, if the root of the problem was found correctly, then it
> > > means
> > > > > that
> > > > > > nodes were started with inconsistent configurations. What do you
> > > think?
> > > > > >
> > > > >
> > > > > Agree. These are exactly the fixes we should start adding to
> Ignite.
> > > > >
> > > > >
> > > > > > https://stackoverflow.com/questions/45911616/
> > > > datastreamer-does-not-work-
> > > > > > well/4597234
> > > > > > - it doesn't relate to DataStreamer, looks like since version
> > 2.1(or
> > > > > > earlier) we have problems with old versions of Java7. I've seen
> > also
> > > at
> > > > > > least two same questions on the user list. I've created issue for
> > > that:
> > > > > > https://issues.apache.org/jira/browse/IGNITE-6248
> > > > >
> > > > >
> > > > > Great! I have scheduled this ticket for 2.2. The node must not
> start
> > on
> > > > an
> > > > > incompatible Java version.
> > > > >
> > > > >
> > > > > >
> > > > > > https://stackoverflow.com/questions/45034975/apache-
> > > > > > ignite-data-streamer/45035436
> > > > > > - As he said at the end, I think he didn't properly understand
> how
> > > > > > DataStreamer should work
> > > > > >
> > > > >
> > > > > Disagree. This is an Ignite issue, not a user issue. We must detect
> > > this
> > > > > and either provide a user with a warning message or disallow 2
> > > streamers
> > > > > with identical names.
> > > > >
> > > > > Makes sense?
> > > > >
> > > > >
> > > > > >
> > > > > > http://apache-ignite-users.70518.x6.nabble.com/Failing-
> > > > > > DataStreamer-beacuse-of-minor-version-change-td12142.html
> > > > > > for this issue, we already have an improvement too:
> > > > > > https://issues.apache.org/jira/browse/IGNITE-5195
> > > > >
> > > > >
> > > > > Argh, what a horrible issue. We spit out an exception 2 pages long,
> > and
> > > > > then telling the poor user to ignore it. This is just sad. I
> updated
> > > the
> > > > > ticket and added a link to the user thread.
> > > > >
> > > > >
> > > > > >
> > > > > >
> > > > > > Evgenii
> > > > > >
> > > > > > 2017-09-03 18:13 GMT+03:00 Dmitriy Setrakyan <
> > dsetrakyan@apache.org
> > > >:
> > > > > >
> > > > > > > In that case we either provide bad configuration or bad error
> > > > messages.
> > > > > > > Could we provide a better error message for this SO issue?
> > > > > > >
> > > > > > > Evgenii, can I please ask you to provide links to all the data
> > > > streamer
> > > > > > > questions you looked at here? This way we may have a chance to
> > spot
> > > > > some
> > > > > > > area for improvement.
> > > > > > >
> > > > > > > D.
> > > > > > >
> > > > > > > On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <
> > > > > > > e.zhuravlev.wk@gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Dmitriy,
> > > > > > > >
> > > > > > > > I've seen several questions on StackOverflow and on the user
> > > list,
> > > > > that
> > > > > > > > seems to be connected with Data Streamer at first sight, but
> > > after
> > > > > some
> > > > > > > > investigation, it was clear that they were not related to
> Data
> > > > > Streamer
> > > > > > > at
> > > > > > > > all. Usually, as it was in this question on SO, it was a
> wrong
> > > > > > > > configuration or conflicted configuration between nodes.
> > > > > > > >
> > > > > > > > Evgenii
> > > > > > > >
> > > > > > > > 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <
> > > dsetrakyan@apache.org
> > > > >:
> > > > > > > >
> > > > > > > > > Igniters,
> > > > > > > > >
> > > > > > > > > I am noticing quite a few issues on the user list and Stack
> > > > > Overflow
> > > > > > > that
> > > > > > > > > have to do with Data Streamer usability. Here is just one
> > > > example:
> > > > > > > > >
> > > > > > > > > https://stackoverflow.com/questions/46015833/
> > > > > > > > datastreamer-adddata-method-
> > > > > > > > > not-work-as-expected-in-cluster
> > > > > > > > >
> > > > > > > > > I think, as a community, we should try to analyze all the
> > > issues
> > > > > and
> > > > > > > > figure
> > > > > > > > > out why the users are struggling.
> > > > > > > > >
> > > > > > > > > Does anyone have a good sense for what is happening?
> > > > > > > > >
> > > > > > > > > D.
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: DataStreamer usability
Posted by Dmitriy Setrakyan <ds...@apache.org>.
On Sun, Sep 3, 2017 at 11:42 AM, Evgenii Zhuravlev <e.zhuravlev.wk@gmail.com
> wrote:
> >But why would anyone have different configurations for streaming into the
> >same cache on the same node? In this case, we should print out a warning
> if
> >the configuration of one streamer is different from another. Agree?
>
> Well, I have not come across the necessity to use different
> datastreamers on one node in use cases I've seen. But at the same time, I
> can come up with the use case in order to configure different
> StreamReceivers when uploading data from different data sources.
>
Evgenii, I agree with you. But a simple warning here to alert the user
about the config differences could go a long way.
>
> Evgenii
>
> 2017-09-03 20:18 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
>
> > On Sun, Sep 3, 2017 at 10:09 AM, Evgenii Zhuravlev <
> > e.zhuravlev.wk@gmail.com
> > > wrote:
> >
> > > Dmitriy,
> > >
> > > >Disagree. This is an Ignite issue, not a user issue. We must detect
> this
> > > >and either provide a user with a warning message or disallow 2
> streamers
> > > >with identical names.
> > > >Makes sense?
> > >
> > > It's not a streamer name we apply as an argument, it's a cache name.
> So,
> > > it's possible to use a different Data Streamers from different nodes
> for
> > > the one cache or even different streamers for one cache on the one
> node.
> > >
> >
> > But why would anyone have different configurations for streaming into the
> > same cache on the same node? In this case, we should print out a warning
> if
> > the configuration of one streamer is different from another. Agree?
> >
> >
> > >
> > > Evgenii
> > >
> > >
> > > 2017-09-03 19:59 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> > >
> > > > On Sun, Sep 3, 2017 at 9:36 AM, Evgenii Zhuravlev <
> > > > e.zhuravlev.wk@gmail.com>
> > > > wrote:
> > > >
> > > > > What about this SO question - I think it could be a good idea to
> add
> > > some
> > > > > additional validation between nodes configurations at node's start.
> > > > > Because, if the root of the problem was found correctly, then it
> > means
> > > > that
> > > > > nodes were started with inconsistent configurations. What do you
> > think?
> > > > >
> > > >
> > > > Agree. These are exactly the fixes we should start adding to Ignite.
> > > >
> > > >
> > > > > https://stackoverflow.com/questions/45911616/
> > > datastreamer-does-not-work-
> > > > > well/4597234
> > > > > - it doesn't relate to DataStreamer, looks like since version
> 2.1(or
> > > > > earlier) we have problems with old versions of Java7. I've seen
> also
> > at
> > > > > least two same questions on the user list. I've created issue for
> > that:
> > > > > https://issues.apache.org/jira/browse/IGNITE-6248
> > > >
> > > >
> > > > Great! I have scheduled this ticket for 2.2. The node must not start
> on
> > > an
> > > > incompatible Java version.
> > > >
> > > >
> > > > >
> > > > > https://stackoverflow.com/questions/45034975/apache-
> > > > > ignite-data-streamer/45035436
> > > > > - As he said at the end, I think he didn't properly understand how
> > > > > DataStreamer should work
> > > > >
> > > >
> > > > Disagree. This is an Ignite issue, not a user issue. We must detect
> > this
> > > > and either provide a user with a warning message or disallow 2
> > streamers
> > > > with identical names.
> > > >
> > > > Makes sense?
> > > >
> > > >
> > > > >
> > > > > http://apache-ignite-users.70518.x6.nabble.com/Failing-
> > > > > DataStreamer-beacuse-of-minor-version-change-td12142.html
> > > > > for this issue, we already have an improvement too:
> > > > > https://issues.apache.org/jira/browse/IGNITE-5195
> > > >
> > > >
> > > > Argh, what a horrible issue. We spit out an exception 2 pages long,
> and
> > > > then telling the poor user to ignore it. This is just sad. I updated
> > the
> > > > ticket and added a link to the user thread.
> > > >
> > > >
> > > > >
> > > > >
> > > > > Evgenii
> > > > >
> > > > > 2017-09-03 18:13 GMT+03:00 Dmitriy Setrakyan <
> dsetrakyan@apache.org
> > >:
> > > > >
> > > > > > In that case we either provide bad configuration or bad error
> > > messages.
> > > > > > Could we provide a better error message for this SO issue?
> > > > > >
> > > > > > Evgenii, can I please ask you to provide links to all the data
> > > streamer
> > > > > > questions you looked at here? This way we may have a chance to
> spot
> > > > some
> > > > > > area for improvement.
> > > > > >
> > > > > > D.
> > > > > >
> > > > > > On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <
> > > > > > e.zhuravlev.wk@gmail.com>
> > > > > > wrote:
> > > > > >
> > > > > > > Dmitriy,
> > > > > > >
> > > > > > > I've seen several questions on StackOverflow and on the user
> > list,
> > > > that
> > > > > > > seems to be connected with Data Streamer at first sight, but
> > after
> > > > some
> > > > > > > investigation, it was clear that they were not related to Data
> > > > Streamer
> > > > > > at
> > > > > > > all. Usually, as it was in this question on SO, it was a wrong
> > > > > > > configuration or conflicted configuration between nodes.
> > > > > > >
> > > > > > > Evgenii
> > > > > > >
> > > > > > > 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <
> > dsetrakyan@apache.org
> > > >:
> > > > > > >
> > > > > > > > Igniters,
> > > > > > > >
> > > > > > > > I am noticing quite a few issues on the user list and Stack
> > > > Overflow
> > > > > > that
> > > > > > > > have to do with Data Streamer usability. Here is just one
> > > example:
> > > > > > > >
> > > > > > > > https://stackoverflow.com/questions/46015833/
> > > > > > > datastreamer-adddata-method-
> > > > > > > > not-work-as-expected-in-cluster
> > > > > > > >
> > > > > > > > I think, as a community, we should try to analyze all the
> > issues
> > > > and
> > > > > > > figure
> > > > > > > > out why the users are struggling.
> > > > > > > >
> > > > > > > > Does anyone have a good sense for what is happening?
> > > > > > > >
> > > > > > > > D.
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: DataStreamer usability
Posted by Evgenii Zhuravlev <e....@gmail.com>.
>But why would anyone have different configurations for streaming into the
>same cache on the same node? In this case, we should print out a warning if
>the configuration of one streamer is different from another. Agree?
Well, I have not come across the necessity to use different
datastreamers on one node in use cases I've seen. But at the same time, I
can come up with the use case in order to configure different
StreamReceivers when uploading data from different data sources.
Evgenii
2017-09-03 20:18 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> On Sun, Sep 3, 2017 at 10:09 AM, Evgenii Zhuravlev <
> e.zhuravlev.wk@gmail.com
> > wrote:
>
> > Dmitriy,
> >
> > >Disagree. This is an Ignite issue, not a user issue. We must detect this
> > >and either provide a user with a warning message or disallow 2 streamers
> > >with identical names.
> > >Makes sense?
> >
> > It's not a streamer name we apply as an argument, it's a cache name. So,
> > it's possible to use a different Data Streamers from different nodes for
> > the one cache or even different streamers for one cache on the one node.
> >
>
> But why would anyone have different configurations for streaming into the
> same cache on the same node? In this case, we should print out a warning if
> the configuration of one streamer is different from another. Agree?
>
>
> >
> > Evgenii
> >
> >
> > 2017-09-03 19:59 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> >
> > > On Sun, Sep 3, 2017 at 9:36 AM, Evgenii Zhuravlev <
> > > e.zhuravlev.wk@gmail.com>
> > > wrote:
> > >
> > > > What about this SO question - I think it could be a good idea to add
> > some
> > > > additional validation between nodes configurations at node's start.
> > > > Because, if the root of the problem was found correctly, then it
> means
> > > that
> > > > nodes were started with inconsistent configurations. What do you
> think?
> > > >
> > >
> > > Agree. These are exactly the fixes we should start adding to Ignite.
> > >
> > >
> > > > https://stackoverflow.com/questions/45911616/
> > datastreamer-does-not-work-
> > > > well/4597234
> > > > - it doesn't relate to DataStreamer, looks like since version 2.1(or
> > > > earlier) we have problems with old versions of Java7. I've seen also
> at
> > > > least two same questions on the user list. I've created issue for
> that:
> > > > https://issues.apache.org/jira/browse/IGNITE-6248
> > >
> > >
> > > Great! I have scheduled this ticket for 2.2. The node must not start on
> > an
> > > incompatible Java version.
> > >
> > >
> > > >
> > > > https://stackoverflow.com/questions/45034975/apache-
> > > > ignite-data-streamer/45035436
> > > > - As he said at the end, I think he didn't properly understand how
> > > > DataStreamer should work
> > > >
> > >
> > > Disagree. This is an Ignite issue, not a user issue. We must detect
> this
> > > and either provide a user with a warning message or disallow 2
> streamers
> > > with identical names.
> > >
> > > Makes sense?
> > >
> > >
> > > >
> > > > http://apache-ignite-users.70518.x6.nabble.com/Failing-
> > > > DataStreamer-beacuse-of-minor-version-change-td12142.html
> > > > for this issue, we already have an improvement too:
> > > > https://issues.apache.org/jira/browse/IGNITE-5195
> > >
> > >
> > > Argh, what a horrible issue. We spit out an exception 2 pages long, and
> > > then telling the poor user to ignore it. This is just sad. I updated
> the
> > > ticket and added a link to the user thread.
> > >
> > >
> > > >
> > > >
> > > > Evgenii
> > > >
> > > > 2017-09-03 18:13 GMT+03:00 Dmitriy Setrakyan <dsetrakyan@apache.org
> >:
> > > >
> > > > > In that case we either provide bad configuration or bad error
> > messages.
> > > > > Could we provide a better error message for this SO issue?
> > > > >
> > > > > Evgenii, can I please ask you to provide links to all the data
> > streamer
> > > > > questions you looked at here? This way we may have a chance to spot
> > > some
> > > > > area for improvement.
> > > > >
> > > > > D.
> > > > >
> > > > > On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <
> > > > > e.zhuravlev.wk@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Dmitriy,
> > > > > >
> > > > > > I've seen several questions on StackOverflow and on the user
> list,
> > > that
> > > > > > seems to be connected with Data Streamer at first sight, but
> after
> > > some
> > > > > > investigation, it was clear that they were not related to Data
> > > Streamer
> > > > > at
> > > > > > all. Usually, as it was in this question on SO, it was a wrong
> > > > > > configuration or conflicted configuration between nodes.
> > > > > >
> > > > > > Evgenii
> > > > > >
> > > > > > 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <
> dsetrakyan@apache.org
> > >:
> > > > > >
> > > > > > > Igniters,
> > > > > > >
> > > > > > > I am noticing quite a few issues on the user list and Stack
> > > Overflow
> > > > > that
> > > > > > > have to do with Data Streamer usability. Here is just one
> > example:
> > > > > > >
> > > > > > > https://stackoverflow.com/questions/46015833/
> > > > > > datastreamer-adddata-method-
> > > > > > > not-work-as-expected-in-cluster
> > > > > > >
> > > > > > > I think, as a community, we should try to analyze all the
> issues
> > > and
> > > > > > figure
> > > > > > > out why the users are struggling.
> > > > > > >
> > > > > > > Does anyone have a good sense for what is happening?
> > > > > > >
> > > > > > > D.
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: DataStreamer usability
Posted by Dmitriy Setrakyan <ds...@apache.org>.
On Sun, Sep 3, 2017 at 10:09 AM, Evgenii Zhuravlev <e.zhuravlev.wk@gmail.com
> wrote:
> Dmitriy,
>
> >Disagree. This is an Ignite issue, not a user issue. We must detect this
> >and either provide a user with a warning message or disallow 2 streamers
> >with identical names.
> >Makes sense?
>
> It's not a streamer name we apply as an argument, it's a cache name. So,
> it's possible to use a different Data Streamers from different nodes for
> the one cache or even different streamers for one cache on the one node.
>
But why would anyone have different configurations for streaming into the
same cache on the same node? In this case, we should print out a warning if
the configuration of one streamer is different from another. Agree?
>
> Evgenii
>
>
> 2017-09-03 19:59 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
>
> > On Sun, Sep 3, 2017 at 9:36 AM, Evgenii Zhuravlev <
> > e.zhuravlev.wk@gmail.com>
> > wrote:
> >
> > > What about this SO question - I think it could be a good idea to add
> some
> > > additional validation between nodes configurations at node's start.
> > > Because, if the root of the problem was found correctly, then it means
> > that
> > > nodes were started with inconsistent configurations. What do you think?
> > >
> >
> > Agree. These are exactly the fixes we should start adding to Ignite.
> >
> >
> > > https://stackoverflow.com/questions/45911616/
> datastreamer-does-not-work-
> > > well/4597234
> > > - it doesn't relate to DataStreamer, looks like since version 2.1(or
> > > earlier) we have problems with old versions of Java7. I've seen also at
> > > least two same questions on the user list. I've created issue for that:
> > > https://issues.apache.org/jira/browse/IGNITE-6248
> >
> >
> > Great! I have scheduled this ticket for 2.2. The node must not start on
> an
> > incompatible Java version.
> >
> >
> > >
> > > https://stackoverflow.com/questions/45034975/apache-
> > > ignite-data-streamer/45035436
> > > - As he said at the end, I think he didn't properly understand how
> > > DataStreamer should work
> > >
> >
> > Disagree. This is an Ignite issue, not a user issue. We must detect this
> > and either provide a user with a warning message or disallow 2 streamers
> > with identical names.
> >
> > Makes sense?
> >
> >
> > >
> > > http://apache-ignite-users.70518.x6.nabble.com/Failing-
> > > DataStreamer-beacuse-of-minor-version-change-td12142.html
> > > for this issue, we already have an improvement too:
> > > https://issues.apache.org/jira/browse/IGNITE-5195
> >
> >
> > Argh, what a horrible issue. We spit out an exception 2 pages long, and
> > then telling the poor user to ignore it. This is just sad. I updated the
> > ticket and added a link to the user thread.
> >
> >
> > >
> > >
> > > Evgenii
> > >
> > > 2017-09-03 18:13 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> > >
> > > > In that case we either provide bad configuration or bad error
> messages.
> > > > Could we provide a better error message for this SO issue?
> > > >
> > > > Evgenii, can I please ask you to provide links to all the data
> streamer
> > > > questions you looked at here? This way we may have a chance to spot
> > some
> > > > area for improvement.
> > > >
> > > > D.
> > > >
> > > > On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <
> > > > e.zhuravlev.wk@gmail.com>
> > > > wrote:
> > > >
> > > > > Dmitriy,
> > > > >
> > > > > I've seen several questions on StackOverflow and on the user list,
> > that
> > > > > seems to be connected with Data Streamer at first sight, but after
> > some
> > > > > investigation, it was clear that they were not related to Data
> > Streamer
> > > > at
> > > > > all. Usually, as it was in this question on SO, it was a wrong
> > > > > configuration or conflicted configuration between nodes.
> > > > >
> > > > > Evgenii
> > > > >
> > > > > 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <dsetrakyan@apache.org
> >:
> > > > >
> > > > > > Igniters,
> > > > > >
> > > > > > I am noticing quite a few issues on the user list and Stack
> > Overflow
> > > > that
> > > > > > have to do with Data Streamer usability. Here is just one
> example:
> > > > > >
> > > > > > https://stackoverflow.com/questions/46015833/
> > > > > datastreamer-adddata-method-
> > > > > > not-work-as-expected-in-cluster
> > > > > >
> > > > > > I think, as a community, we should try to analyze all the issues
> > and
> > > > > figure
> > > > > > out why the users are struggling.
> > > > > >
> > > > > > Does anyone have a good sense for what is happening?
> > > > > >
> > > > > > D.
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: DataStreamer usability
Posted by Evgenii Zhuravlev <e....@gmail.com>.
Dmitriy,
>Disagree. This is an Ignite issue, not a user issue. We must detect this
>and either provide a user with a warning message or disallow 2 streamers
>with identical names.
>Makes sense?
It's not a streamer name we apply as an argument, it's a cache name. So,
it's possible to use a different Data Streamers from different nodes for
the one cache or even different streamers for one cache on the one node.
Evgenii
2017-09-03 19:59 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> On Sun, Sep 3, 2017 at 9:36 AM, Evgenii Zhuravlev <
> e.zhuravlev.wk@gmail.com>
> wrote:
>
> > What about this SO question - I think it could be a good idea to add some
> > additional validation between nodes configurations at node's start.
> > Because, if the root of the problem was found correctly, then it means
> that
> > nodes were started with inconsistent configurations. What do you think?
> >
>
> Agree. These are exactly the fixes we should start adding to Ignite.
>
>
> > https://stackoverflow.com/questions/45911616/datastreamer-does-not-work-
> > well/4597234
> > - it doesn't relate to DataStreamer, looks like since version 2.1(or
> > earlier) we have problems with old versions of Java7. I've seen also at
> > least two same questions on the user list. I've created issue for that:
> > https://issues.apache.org/jira/browse/IGNITE-6248
>
>
> Great! I have scheduled this ticket for 2.2. The node must not start on an
> incompatible Java version.
>
>
> >
> > https://stackoverflow.com/questions/45034975/apache-
> > ignite-data-streamer/45035436
> > - As he said at the end, I think he didn't properly understand how
> > DataStreamer should work
> >
>
> Disagree. This is an Ignite issue, not a user issue. We must detect this
> and either provide a user with a warning message or disallow 2 streamers
> with identical names.
>
> Makes sense?
>
>
> >
> > http://apache-ignite-users.70518.x6.nabble.com/Failing-
> > DataStreamer-beacuse-of-minor-version-change-td12142.html
> > for this issue, we already have an improvement too:
> > https://issues.apache.org/jira/browse/IGNITE-5195
>
>
> Argh, what a horrible issue. We spit out an exception 2 pages long, and
> then telling the poor user to ignore it. This is just sad. I updated the
> ticket and added a link to the user thread.
>
>
> >
> >
> > Evgenii
> >
> > 2017-09-03 18:13 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> >
> > > In that case we either provide bad configuration or bad error messages.
> > > Could we provide a better error message for this SO issue?
> > >
> > > Evgenii, can I please ask you to provide links to all the data streamer
> > > questions you looked at here? This way we may have a chance to spot
> some
> > > area for improvement.
> > >
> > > D.
> > >
> > > On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <
> > > e.zhuravlev.wk@gmail.com>
> > > wrote:
> > >
> > > > Dmitriy,
> > > >
> > > > I've seen several questions on StackOverflow and on the user list,
> that
> > > > seems to be connected with Data Streamer at first sight, but after
> some
> > > > investigation, it was clear that they were not related to Data
> Streamer
> > > at
> > > > all. Usually, as it was in this question on SO, it was a wrong
> > > > configuration or conflicted configuration between nodes.
> > > >
> > > > Evgenii
> > > >
> > > > 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> > > >
> > > > > Igniters,
> > > > >
> > > > > I am noticing quite a few issues on the user list and Stack
> Overflow
> > > that
> > > > > have to do with Data Streamer usability. Here is just one example:
> > > > >
> > > > > https://stackoverflow.com/questions/46015833/
> > > > datastreamer-adddata-method-
> > > > > not-work-as-expected-in-cluster
> > > > >
> > > > > I think, as a community, we should try to analyze all the issues
> and
> > > > figure
> > > > > out why the users are struggling.
> > > > >
> > > > > Does anyone have a good sense for what is happening?
> > > > >
> > > > > D.
> > > > >
> > > >
> > >
> >
>
Re: DataStreamer usability
Posted by Dmitriy Setrakyan <ds...@apache.org>.
On Sun, Sep 3, 2017 at 9:36 AM, Evgenii Zhuravlev <e....@gmail.com>
wrote:
> What about this SO question - I think it could be a good idea to add some
> additional validation between nodes configurations at node's start.
> Because, if the root of the problem was found correctly, then it means that
> nodes were started with inconsistent configurations. What do you think?
>
Agree. These are exactly the fixes we should start adding to Ignite.
> https://stackoverflow.com/questions/45911616/datastreamer-does-not-work-
> well/4597234
> - it doesn't relate to DataStreamer, looks like since version 2.1(or
> earlier) we have problems with old versions of Java7. I've seen also at
> least two same questions on the user list. I've created issue for that:
> https://issues.apache.org/jira/browse/IGNITE-6248
Great! I have scheduled this ticket for 2.2. The node must not start on an
incompatible Java version.
>
> https://stackoverflow.com/questions/45034975/apache-
> ignite-data-streamer/45035436
> - As he said at the end, I think he didn't properly understand how
> DataStreamer should work
>
Disagree. This is an Ignite issue, not a user issue. We must detect this
and either provide a user with a warning message or disallow 2 streamers
with identical names.
Makes sense?
>
> http://apache-ignite-users.70518.x6.nabble.com/Failing-
> DataStreamer-beacuse-of-minor-version-change-td12142.html
> for this issue, we already have an improvement too:
> https://issues.apache.org/jira/browse/IGNITE-5195
Argh, what a horrible issue. We spit out an exception 2 pages long, and
then telling the poor user to ignore it. This is just sad. I updated the
ticket and added a link to the user thread.
>
>
> Evgenii
>
> 2017-09-03 18:13 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
>
> > In that case we either provide bad configuration or bad error messages.
> > Could we provide a better error message for this SO issue?
> >
> > Evgenii, can I please ask you to provide links to all the data streamer
> > questions you looked at here? This way we may have a chance to spot some
> > area for improvement.
> >
> > D.
> >
> > On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <
> > e.zhuravlev.wk@gmail.com>
> > wrote:
> >
> > > Dmitriy,
> > >
> > > I've seen several questions on StackOverflow and on the user list, that
> > > seems to be connected with Data Streamer at first sight, but after some
> > > investigation, it was clear that they were not related to Data Streamer
> > at
> > > all. Usually, as it was in this question on SO, it was a wrong
> > > configuration or conflicted configuration between nodes.
> > >
> > > Evgenii
> > >
> > > 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> > >
> > > > Igniters,
> > > >
> > > > I am noticing quite a few issues on the user list and Stack Overflow
> > that
> > > > have to do with Data Streamer usability. Here is just one example:
> > > >
> > > > https://stackoverflow.com/questions/46015833/
> > > datastreamer-adddata-method-
> > > > not-work-as-expected-in-cluster
> > > >
> > > > I think, as a community, we should try to analyze all the issues and
> > > figure
> > > > out why the users are struggling.
> > > >
> > > > Does anyone have a good sense for what is happening?
> > > >
> > > > D.
> > > >
> > >
> >
>
Re: DataStreamer usability
Posted by Evgenii Zhuravlev <e....@gmail.com>.
What about this SO question - I think it could be a good idea to add some
additional validation between nodes configurations at node's start.
Because, if the root of the problem was found correctly, then it means that
nodes were started with inconsistent configurations. What do you think?
Sure, here are a few questions:
https://stackoverflow.com/questions/45911616/datastreamer-does-not-work-well/4597234
- it doesn't relate to DataStreamer, looks like since version 2.1(or
earlier) we have problems with old versions of Java7. I've seen also at
least two same questions on the user list. I've created issue for that:
https://issues.apache.org/jira/browse/IGNITE-6248
https://stackoverflow.com/questions/45034975/apache-ignite-data-streamer/45035436
- As he said at the end, I think he didn't properly understand how
DataStreamer should work
http://apache-ignite-users.70518.x6.nabble.com/Failing-DataStreamer-beacuse-of-minor-version-change-td12142.html
-
for this issue, we already have an improvement too:
https://issues.apache.org/jira/browse/IGNITE-5195
Evgenii
2017-09-03 18:13 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> In that case we either provide bad configuration or bad error messages.
> Could we provide a better error message for this SO issue?
>
> Evgenii, can I please ask you to provide links to all the data streamer
> questions you looked at here? This way we may have a chance to spot some
> area for improvement.
>
> D.
>
> On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <
> e.zhuravlev.wk@gmail.com>
> wrote:
>
> > Dmitriy,
> >
> > I've seen several questions on StackOverflow and on the user list, that
> > seems to be connected with Data Streamer at first sight, but after some
> > investigation, it was clear that they were not related to Data Streamer
> at
> > all. Usually, as it was in this question on SO, it was a wrong
> > configuration or conflicted configuration between nodes.
> >
> > Evgenii
> >
> > 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> >
> > > Igniters,
> > >
> > > I am noticing quite a few issues on the user list and Stack Overflow
> that
> > > have to do with Data Streamer usability. Here is just one example:
> > >
> > > https://stackoverflow.com/questions/46015833/
> > datastreamer-adddata-method-
> > > not-work-as-expected-in-cluster
> > >
> > > I think, as a community, we should try to analyze all the issues and
> > figure
> > > out why the users are struggling.
> > >
> > > Does anyone have a good sense for what is happening?
> > >
> > > D.
> > >
> >
>
Re: DataStreamer usability
Posted by Dmitriy Setrakyan <ds...@apache.org>.
In that case we either provide bad configuration or bad error messages.
Could we provide a better error message for this SO issue?
Evgenii, can I please ask you to provide links to all the data streamer
questions you looked at here? This way we may have a chance to spot some
area for improvement.
D.
On Sun, Sep 3, 2017 at 3:05 AM, Evgenii Zhuravlev <e....@gmail.com>
wrote:
> Dmitriy,
>
> I've seen several questions on StackOverflow and on the user list, that
> seems to be connected with Data Streamer at first sight, but after some
> investigation, it was clear that they were not related to Data Streamer at
> all. Usually, as it was in this question on SO, it was a wrong
> configuration or conflicted configuration between nodes.
>
> Evgenii
>
> 2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
>
> > Igniters,
> >
> > I am noticing quite a few issues on the user list and Stack Overflow that
> > have to do with Data Streamer usability. Here is just one example:
> >
> > https://stackoverflow.com/questions/46015833/
> datastreamer-adddata-method-
> > not-work-as-expected-in-cluster
> >
> > I think, as a community, we should try to analyze all the issues and
> figure
> > out why the users are struggling.
> >
> > Does anyone have a good sense for what is happening?
> >
> > D.
> >
>
Re: DataStreamer usability
Posted by Evgenii Zhuravlev <e....@gmail.com>.
Dmitriy,
I've seen several questions on StackOverflow and on the user list, that
seems to be connected with Data Streamer at first sight, but after some
investigation, it was clear that they were not related to Data Streamer at
all. Usually, as it was in this question on SO, it was a wrong
configuration or conflicted configuration between nodes.
Evgenii
2017-09-03 2:10 GMT+03:00 Dmitriy Setrakyan <ds...@apache.org>:
> Igniters,
>
> I am noticing quite a few issues on the user list and Stack Overflow that
> have to do with Data Streamer usability. Here is just one example:
>
> https://stackoverflow.com/questions/46015833/datastreamer-adddata-method-
> not-work-as-expected-in-cluster
>
> I think, as a community, we should try to analyze all the issues and figure
> out why the users are struggling.
>
> Does anyone have a good sense for what is happening?
>
> D.
>