You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Yi Pan (Data Infrastructure) (JIRA)" <ji...@apache.org> on 2016/05/19 21:19:12 UTC
[jira] [Commented] (SAMZA-870) RocksDBException: Invalid argument:
Compression type Snappy is not linked with the binary
[ https://issues.apache.org/jira/browse/SAMZA-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292156#comment-15292156 ]
Yi Pan (Data Infrastructure) commented on SAMZA-870:
----------------------------------------------------
Jose and [~edi_bice@yahoo.com], I have opened an issue in rocksDB community to track this issue. We did not see this issue after we got an workaround for our unit test working for [issue-989|https://github.com/facebook/rocksdb/issues/989].
The issue I opened is [issue-1127|https://github.com/facebook/rocksdb/issues/1127].
> RocksDBException: Invalid argument: Compression type Snappy is not linked with the binary
> -----------------------------------------------------------------------------------------
>
> Key: SAMZA-870
> URL: https://issues.apache.org/jira/browse/SAMZA-870
> Project: Samza
> Issue Type: Bug
> Components: kv-store
> Affects Versions: 0.10.1
> Environment: RedHat Enterprise Linux 6.6, Java 8 (Oracle 1.8.0_40)
> Reporter: Edi Bice
> Assignee: Navina Ramesh
>
> I'm running latest from master with a small patch to allow for additional RocksDB configuration. All my jobs (which involve KV stores) fail with the following:
> org.apache.samza.SamzaException: Error opening RocksDB store xxx-store/Partition_6, received the following exception from RocksDB org.rocksdb.RocksDBException: Invalid argument: Compression type Snappy is not linked with the binary.
> at org.apache.samza.storage.kv.RocksDbKeyValueStore$.openDB(RocksDbKeyValueStore.scala:81)
> at org.apache.samza.storage.kv.RocksDbKeyValueStore.db$lzycompute(RocksDbKeyValueStore.scala:103)
> at org.apache.samza.storage.kv.RocksDbKeyValueStore.db(RocksDbKeyValueStore.scala:103)
> at org.apache.samza.storage.kv.RocksDbKeyValueStore.flush(RocksDbKeyValueStore.scala:195)
> at org.apache.samza.storage.kv.LoggedStore.flush(LoggedStore.scala:107)
> at org.apache.samza.storage.kv.SerializedKeyValueStore.flush(SerializedKeyValueStore.scala:117)
> at org.apache.samza.storage.kv.CachedStore.flush(CachedStore.scala:194)
> at org.apache.samza.storage.kv.NullSafeKeyValueStore.flush(NullSafeKeyValueStore.scala:82)
> at org.apache.samza.storage.kv.KeyValueStorageEngine.flush(KeyValueStorageEngine.scala:123)
> at org.apache.samza.storage.kv.KeyValueStorageEngine.close(KeyValueStorageEngine.scala:135)
> at org.apache.samza.storage.kv.KeyValueStorageEngine.stop(KeyValueStorageEngine.scala:129)
> at org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193)
> at org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193)
> at scala.collection.Iterator$class.foreach(Iterator.scala:727)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
> at scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
> at org.apache.samza.storage.TaskStorageManager.stopStores(TaskStorageManager.scala:193)
> at org.apache.samza.storage.TaskStorageManager.stop(TaskStorageManager.scala:197)
> at org.apache.samza.container.TaskInstance.shutdownStores(TaskInstance.scala:203)
> at org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689)
> at org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689)
> at scala.collection.Iterator$class.foreach(Iterator.scala:727)
> at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
> at scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206)
> at org.apache.samza.container.SamzaContainer.shutdownStores(SamzaContainer.scala:689)
> at org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:568)
> at org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:93)
> at org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:67)
> at org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)