You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@pekko.apache.org by "hanishi (via GitHub)" <gi...@apache.org> on 2024/03/07 00:40:46 UTC

[I] Feedback: ScyllaDB support and compatibility considerations. [incubator-pekko-persistence-cassandra]

hanishi opened a new issue, #135:
URL: https://github.com/apache/incubator-pekko-persistence-cassandra/issues/135

   When attempting to use the `tables-autocreate` feature specified in an `application.conf` file, I encountered a failure due to a compatibility issue between Cassandra and ScyllaDB. The problem arises because the `unchecked_tombstone_compaction` option, used within the compaction strategy configuration, is not recognized by [ScyllaDB](https://opensource.docs.scylladb.com/stable/cql/compaction.html#common-options). 
   
   The plugin expects this option during the table creation process. The relevant code can be found [here](https://github.com/apache/incubator-pekko-persistence-cassandra/blob/90d80ad20dd72b9eff09ab1998e3354f78227313/core/src/main/scala/org/apache/pekko/persistence/cassandra/compaction/BaseCompactionStrategy.scala#L56).
   
   I worked around this by manually creating the necessary tables without using the `unchecked_tombstone_compaction` option. This workaround suggests that broader compatibility might be achievable with some adjustments.
   Given the growing popularity and adoption of ScyllaDB, it would be nice if future versions of the plugin could consider providing some support for ScyllaDB.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org
For additional commands, e-mail: notifications-help@pekko.apache.org


Re: [I] Feedback: ScyllaDB support and compatibility considerations. [incubator-pekko-persistence-cassandra]

Posted by "pjfanning (via GitHub)" <gi...@apache.org>.
pjfanning commented on issue #135:
URL: https://github.com/apache/incubator-pekko-persistence-cassandra/issues/135#issuecomment-1982141172

   Would it be possible to tell ScyllaDB team about the missing support for this param? They seem to claim that they support tombstone compaction - eg https://github.com/scylladb/scylladb/issues/1487


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org
For additional commands, e-mail: notifications-help@pekko.apache.org


Re: [I] Feedback: ScyllaDB support and compatibility considerations. [incubator-pekko-persistence-cassandra]

Posted by "pjfanning (via GitHub)" <gi...@apache.org>.
pjfanning commented on issue #135:
URL: https://github.com/apache/incubator-pekko-persistence-cassandra/issues/135#issuecomment-1982143256

   also: https://lists.apache.org/api/plain?thread=16b01wk5tksg6646npl71n7fzck7o6mg


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org
For additional commands, e-mail: notifications-help@pekko.apache.org


Re: [I] Feedback: ScyllaDB support and compatibility considerations. [incubator-pekko-persistence-cassandra]

Posted by "hanishi (via GitHub)" <gi...@apache.org>.
hanishi commented on issue #135:
URL: https://github.com/apache/incubator-pekko-persistence-cassandra/issues/135#issuecomment-1982171179

   Well, the tombstone compaction, by means of `tombstone_compaction_interval` and `tombstone_compaction_interval`, is supported, but this specific option isn't I guess.  😩
   
   ```
   ConfigurationException: Invalid compaction strategy options {{unchecked_tombstone_compaction, false}} for chosen strategy type
   ```
    
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org
For additional commands, e-mail: notifications-help@pekko.apache.org


Re: [I] Feedback: ScyllaDB support and compatibility considerations. [incubator-pekko-persistence-cassandra]

Posted by "hanishi (via GitHub)" <gi...@apache.org>.
hanishi commented on issue #135:
URL: https://github.com/apache/incubator-pekko-persistence-cassandra/issues/135#issuecomment-1982294386

   @pjfanning let's find out. 
   https://forum.scylladb.com/t/cassandras-unchecked-tombstone-compaction-not-recognized/1360?u=hanishi


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org
For additional commands, e-mail: notifications-help@pekko.apache.org


Re: [I] Feedback: ScyllaDB support and compatibility considerations. [incubator-pekko-persistence-cassandra]

Posted by "pjfanning (via GitHub)" <gi...@apache.org>.
pjfanning commented on issue #135:
URL: https://github.com/apache/incubator-pekko-persistence-cassandra/issues/135#issuecomment-1984173017

   @hanishi thanks for the details. They should be useful for other ScyllaDB users.
   
   The docs say that the tables should be manually set up.
   https://pekko.apache.org/docs/pekko-persistence-cassandra/current/journal.html#schema
   
   I think I can maybe come back and update the docs a bit but it take a few days.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@pekko.apache.org
For additional commands, e-mail: notifications-help@pekko.apache.org