You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@superset.apache.org by 491424570 <49...@qq.com.INVALID> on 2023/04/24 09:25:05 UTC

superset consulting

Hi


My company is trying to use superset. There are some questions and i can't find the result by google.


Q1: How cound superset display fast realtime data. some datas are generate in milliseconds. is superset possible to refresh milliseconds?


Q2: I have a lot of data comeing from others system which only have api and mqtt to access data. database is forbidden. can superset get data from api &amp; mqtt?


Sorry to interrupt. Thank you very much



Best regards
zhihao.jia


491424570
491424570@qq.com



&nbsp;

Re: superset consulting

Posted by Maxime Beauchemin <ma...@gmail.com>.
about Q1 there's a feature to auto-refresh charts in a dashboard on a
periodic interval, it could probably be set as low as 10 seconds, but
display a spinner / reload very often. Also note that Superset works very
well on top of the top realtime analytics database (Druid, Pinot,
Clickhouse, ...), the charts just won't animate to show the new data points.

My personal position on this it's that it's pretty rare that humans need to
see "what happened within the last minute", except for super operational
use cases (troubleshooting, observability), where typically bots/alerts are
more appropriate than having a human anxiously looking at a moving chart.

Max

On Wed, 26 Apr 2023 at 10:17, Evan Rusackas <ev...@rusackas.com> wrote:

> Hi Zhihao,
>
> You’d probably get more results asking these questions on Slack (
> http://bit.ly/join-superset-slack), where there’s a bigger audience, as
> this list is mostly used for development proposals and consensus-gathering.
>
> That said, I can offer some terse answers here.
>
> Q1: Superset isn’t built specifically for real-time. There are efforts
> (e.g. Global Async Queries and the web socket door that opens) that might
> be inroads to steer it more in that direction if you’re interested in
> contributing.
> Q2: There are a lot of ways to make these API connections, though it
> involves using complimentary tooling like Fivetran/Airbyte/Meltano/Drill,
> along with other ETL/ELT tools like dbt/airflow/etc.
>
> Feel free to ping the wider audience on Slack in the #improving-superset
> channel if you’d like to learn and contribute in this area.
>
> All the best,
>
> Evan
> On Apr 24, 2023 at 11:09 AM -0600, 491424570 <49...@qq.com.invalid>,
> wrote:
> > Hi
> >
> >
> > My company is trying to use superset. There are some questions and i
> can't find the result by google.
> >
> >
> > Q1: How cound superset display fast realtime data. some datas are
> generate in milliseconds. is superset possible to refresh milliseconds?
> >
> >
> > Q2: I have a lot of data comeing from others system which only have api
> and mqtt to access data. database is forbidden. can superset get data from
> api &amp; mqtt?
> >
> >
> > Sorry to interrupt. Thank you very much
> >
> >
> >
> > Best regards
> > zhihao.jia
> >
> >
> > 491424570
> > 491424570@qq.com
> >
> >
> >
> > &nbsp;
>

Re: superset consulting

Posted by Evan Rusackas <ev...@rusackas.com>.
Hi Zhihao,

You’d probably get more results asking these questions on Slack (http://bit.ly/join-superset-slack), where there’s a bigger audience, as this list is mostly used for development proposals and consensus-gathering.

That said, I can offer some terse answers here.

Q1: Superset isn’t built specifically for real-time. There are efforts (e.g. Global Async Queries and the web socket door that opens) that might be inroads to steer it more in that direction if you’re interested in contributing.
Q2: There are a lot of ways to make these API connections, though it involves using complimentary tooling like Fivetran/Airbyte/Meltano/Drill, along with other ETL/ELT tools like dbt/airflow/etc.

Feel free to ping the wider audience on Slack in the #improving-superset channel if you’d like to learn and contribute in this area.

All the best,

Evan
On Apr 24, 2023 at 11:09 AM -0600, 491424570 <49...@qq.com.invalid>, wrote:
> Hi
>
>
> My company is trying to use superset. There are some questions and i can't find the result by google.
>
>
> Q1: How cound superset display fast realtime data. some datas are generate in milliseconds. is superset possible to refresh milliseconds?
>
>
> Q2: I have a lot of data comeing from others system which only have api and mqtt to access data. database is forbidden. can superset get data from api &amp; mqtt?
>
>
> Sorry to interrupt. Thank you very much
>
>
>
> Best regards
> zhihao.jia
>
>
> 491424570
> 491424570@qq.com
>
>
>
> &nbsp;