You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by GitBox <gi...@apache.org> on 2023/05/02 11:10:11 UTC
[GitHub] [streampipes] heinehenning created a discussion: Problems with data visualization / string conversion
GitHub user heinehenning created a discussion: Problems with data visualization / string conversion
Hi there,
I am trying to setup some connections with simple data visualization, but I am running into problems, when it comes to the visualization part.
I am using StreamPipes 0.91.0, started with docker-compose from installer/compose. The system is running inside WSL2 on my Windows 10 Notebook.
I created a MQTT connector and selected the option "Persist events" before starting the adapter. Messages are arriving, as can be seen in the details view on the specific adapter.
This is our original payload:
And this is the result after selecting measurements and timestamp:
When I try to build a visualization with the data explorer, the widget is not showing any data just the message _"Found no data in the selected time range"_
It would be great to get some hints where to start with the trouble shooting.
One thing I noticed is, when checking the help on the DataSource, all fields are marked as "Text"-Fields.
Could that be part of the problem?
If found a "Field Converter" for string conversion in the StreamPipes docs but this pipeline element is not available under my pipeline elements.
Thanks in advance for your help!
GitHub link: https://github.com/apache/streampipes/discussions/1543
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] tenthe added a comment to the discussion: Problems with data visualization / string conversion
Posted by GitBox <gi...@apache.org>.
GitHub user tenthe added a comment to the discussion: Problems with data visualization / string conversion
Hello @heinehenning,
thank you very much for reporting this behavior. I will look into it and get back to you.
Cheers,
Philipp
GitHub link: https://github.com/apache/streampipes/discussions/1543#discussioncomment-5788370
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] heinehenning added a comment to the discussion: Problems with data visualization / string conversion
Posted by GitBox <gi...@apache.org>.
GitHub user heinehenning added a comment to the discussion: Problems with data visualization / string conversion
Hi @tenthe,
thanks for checking in!
One more thing, that I have noticed:
I tried to rule out the issues with our data format and tried to pipe some random values from the JS-Eval-Processor to the data lake:
I am getting the followint error on the data lake. This error occured already with my previous tests.
GitHub link: https://github.com/apache/streampipes/discussions/1543#discussioncomment-5788507
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] heinehenning added a comment to the discussion: Problems with data visualization / string conversion
Posted by GitBox <gi...@apache.org>.
GitHub user heinehenning added a comment to the discussion: Problems with data visualization / string conversion
I still struggle to make this ↑ work.
My assumption is, that the pipeline can not really access the JSON object that is coming from the connector.
When I try to access the connector output with a JS-Eval-Processor, I can not manage to drill down to the actual value:
Data coming from the connector:
Configuration of JS-Eval-Processor:
Preview of Pipeliine:
Any Ideas how to access the actual values?
GitHub link: https://github.com/apache/streampipes/discussions/1543#discussioncomment-5788283
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org
[GitHub] [streampipes] tenthe added a comment to the discussion: Problems with data visualization / string conversion
Posted by GitBox <gi...@apache.org>.
GitHub user tenthe added a comment to the discussion: Problems with data visualization / string conversion
Hi @heinehenning,
I have tried to reproduce your problems.
I also had several problems with the nested json structure. @dominikriemer is currently working on it.
Once the changes are complete, I will try it again.
About your JavaScript function. I suspect the problem is with the data source.
I tried the same example with a different adapter and it worked in my instance. (I used the latest release 0.91.0 for the tests)
My guess is that the adapter's event schema is broken because of the nested structure issues.
Right now you can flatten the events in the schema editor by dragging the value property to the top level.
Cheers,
Philipp
GitHub link: https://github.com/apache/streampipes/discussions/1543#discussioncomment-5818030
----
This is an automatically sent email for dev@streampipes.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@streampipes.apache.org