You are viewing a plain text version of this content. The canonical link for it is here.
Posted to pr@flagon.apache.org by "brucearctor (via GitHub)" <gi...@apache.org> on 2026/10/12 00:57:14 UTC

[PR] feat(examples): add OpenSearch (#54) and All-Apache Lakehouse examples (flagon)

brucearctor opened a new pull request, #193:
URL: https://github.com/apache/flagon/pull/193

   ## Summary
   Adds two 100% `Apache-2.0`-licensed backend deployment & analytics examples alongside the existing OpenTelemetry + Grafana/Loki/Tempo (`products/userale/example/otel-demo/`) and legacy ELK (`examples/elk/`) examples:
   
   1. **OpenSearch Stack (`examples/opensearch/` — Closes #54)**:
      - Docker Compose (`examples/opensearch/docker-compose.yml`) and Kubernetes (`examples/opensearch/kubernetes/opensearch.yaml`) configurations for **OpenTelemetry Collector + OpenSearch + OpenSearch Dashboards** (`Apache-2.0`).
      - Includes an OpenSearch v2 index template (`examples/opensearch/userale-index-template.json`) mapping UserALE 2.5 telemetry (`targetRect`, `traceId`, `spanId`, and disabling `frames` indexing on `replay` envelopes to avoid segment bloat).
   
   2. **All-Apache Behavioral Lakehouse (`examples/apache-lakehouse/`)**:
      - Streaming lakehouse architecture using **Apache Flagon UserALE.js** (`OtlpJsonExporter`) $\rightarrow$ **OpenTelemetry Collector** $\rightarrow$ **Apache Kafka** (`apache/kafka-native` KRaft) $\rightarrow$ **Apache Iceberg / Apache Parquet / Apache Arrow** $\rightarrow$ **Apache DataFusion** + **Apache Flagon Distill 2.5**.
      - Includes a self-contained, runnable Python script (`examples/apache-lakehouse/distill_lakehouse_demo.py`) that normalizes OTLP/JSON logs via Distill, writes an Apache Parquet dataset, runs vectorized SQL window functions (`LEAD()` over session partitions) via **Apache DataFusion**, and computes UX frustration scores, Markov transition matrices, and W3C trace correlations via **Distill 2.5**.
   
   3. **Top-Level Examples Index (`examples/README.md`)**:
      - Compares all four supported deployment architectures (`OpenTelemetry + Grafana/Loki/Tempo`, `All-Apache Behavioral Lakehouse`, `OpenSearch`, and legacy `ELK`).
   
   Closes #54


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: pr-unsubscribe@flagon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: pr-unsubscribe@flagon.apache.org
For additional commands, e-mail: pr-help@flagon.apache.org


Re: [PR] feat(examples): add OpenSearch (#54) and All-Apache Lakehouse examples (flagon)

Posted by "brucearctor (via GitHub)" <gi...@apache.org>.
brucearctor merged PR #193:
URL: https://github.com/apache/flagon/pull/193


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: pr-unsubscribe@flagon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: pr-unsubscribe@flagon.apache.org
For additional commands, e-mail: pr-help@flagon.apache.org