You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "detj (via GitHub)" <gi...@apache.org> on 2026/03/25 12:18:11 UTC

[I] Creating a topic with compression fails with an error. [iggy]

detj opened a new issue, #3028:
URL: https://github.com/apache/iggy/issues/3028

   ### Bug description
   
   ## What were you doing?
   
   Creating a stream with the iggy cli fails for the following compression algorithms.
   
   - `zstd`
   - `lz4`
   
   Works with `gzip` & `none`.
   
   ## What you expected?
   
   Expected the topic to be created with the `lz4` or `zstd` compression algorithms.
   
   ## What actually happened?
   
   Topic creation failed for the `zstd` & `lz4` compression algorithms.
   
   ```sh
   iggy -u iggy -p iggy topic create my-stream my-topic 3 lz4 7d
   
   error: invalid value 'lz4' for '<COMPRESSION_ALGORITHM>': Unknown compression type: lz4
   
   For more information, try '--help'.
   ```
   
   ```sh
   iggy -u iggy -p iggy topic create my-stream my-topic 3 zstd 7d
   
   error: invalid value 'zstd' for '<COMPRESSION_ALGORITHM>': Unknown compression type: zstd
   
   For more information, try '--help'.
   ```
   
   ## Additional details
   
   Rest of the server configuration is set as default. Implies the following.
   
   ```toml
   # Compression configuration
   [system.compression]
   # Allows overriding the default compression algorithm per data segment (boolean).
   # `true` permits different compression algorithms for individual segments.
   # `false` means all data segments use the default compression algorithm.
   allow_override = false
   # The default compression algorithm used for data storage (string).
   # "none" indicates no compression, other values can specify different algorithms.
   default_algorithm = "none"
   ```
   
   ### Deployment
   
   Docker (DockerHub image)
   
   ### Versions
   
   server 0.7.0
   
   ### Hardware / environment
   
   macOS 26.3.1
   
   ### Sample code
   
   _No response_
   
   ### Logs
   
   _No response_
   
   ### Iggy server config
   
   ```sh
   IGGY_ROOT_USERNAME=iggy
   IGGY_ROOT_PASSWORD=iggy
   IGGY_HTTP_ENABLED=true
   IGGY_HTTP_ADDRESS=0.0.0.0:80
   IGGY_TCP_ENABLED=true
   IGGY_TCP_ADDRESS=0.0.0.0:8090
   IGGY_QUIC_ENABLED=false
   IGGY_WEBSOCKET_ENABLED=false
   IGGY_HEARTBEAT_ENABLED=true
   IGGY_HEARTBEAT_INTERVAL=5s
   IGGY_SYSTEM_PATH=/local_data
   ```
   
   ### Reproduction
   
   1. Create a new topic with `lz4` compression
   
   ```sh
   iggy -u iggy -p iggy topic create my-stream my-topic 3 lz4 7d
   
   error: invalid value 'lz4' for '<COMPRESSION_ALGORITHM>': Unknown compression type: lz4
   
   For more information, try '--help'.
   ```
   2. Create a new topic with `zstd` compression
   
   ```sh
   iggy -u iggy -p iggy topic create my-stream my-topic 3 zstd 7d
   
   error: invalid value 'zstd' for '<COMPRESSION_ALGORITHM>': Unknown compression type: zstd
   
   For more information, try '--help'.
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Creating a topic with compression fails with an error. [iggy]

Posted by "detj (via GitHub)" <gi...@apache.org>.
detj commented on issue #3028:
URL: https://github.com/apache/iggy/issues/3028#issuecomment-4126282416

   Understood. Thanks for the quick reply.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Creating a topic with compression fails with an error. [iggy]

Posted by "detj (via GitHub)" <gi...@apache.org>.
detj commented on issue #3028:
URL: https://github.com/apache/iggy/issues/3028#issuecomment-4126140447

   I might be missing something here. Let me know if you can spot the issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Creating a topic with compression fails with an error. [iggy]

Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio closed issue #3028: Creating a topic with compression fails with an error.
URL: https://github.com/apache/iggy/issues/3028


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Creating a topic with compression fails with an error. [iggy]

Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #3028:
URL: https://github.com/apache/iggy/issues/3028#issuecomment-4126229702

   hey.
   we dont support compression yet :( this has been really challenging issue to solve, there are multiple variants of this very problem:
   - compression on disk (saves storage, the one you reported that doesnt work)
   - compression on the network (saves network traffic)
   and combination of both.
   
   See https://github.com/apache/iggy/issues/18 and https://github.com/apache/iggy/issues/30.
   
   But fear not, we have workaround. You can see code in `examples/rust/src/message-headers/message-compression`:
   https://github.com/apache/iggy/tree/master/examples/rust/src/message-headers/message-compression
   
   this example show how to do userspace compression manually using iggy message headers. we plan to tackle those compression features after implementing cluster (VSR).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org