You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2026/08/24 01:21:00 UTC

[jira] [Created] (SPARK-58961) Import scg-audit and scg-ratelimit crates into Spark Connect Gateway

L. C. Hsieh created SPARK-58961:
-----------------------------------

             Summary: Import scg-audit and scg-ratelimit crates into Spark Connect Gateway
                 Key: SPARK-58961
                 URL: https://issues.apache.org/jira/browse/SPARK-58961
             Project: Spark
          Issue Type: Sub-task
          Components: Connect
    Affects Versions: connect-gateway-0.1.0
            Reporter: L. C. Hsieh
            Assignee: L. C. Hsieh


Part of importing the Spark Connect Gateway reference implementation into
apache/spark-connect-gateway as a series of small, bottom-up PRs.

This adds two small leaf crates, grouped into one PR:
  
  - scg-audit — structured audit logging for the gateway.
  - scg-ratelimit — per-tenant (and optional per-user) token-bucket rate limiting,
    with a Redis-backed distributed token bucket for multi-replica deployments.

Both are leaf crates (no internal dependencies), so they compile and test on
their own (audit: 6 unit tests; ratelimit: 9 tests, plus Redis integration tests
that are #[ignore] so they compile but don't require Docker in CI). They are
appended to the workspace members list, and are consumed later by the proxy
crate.
  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org