Hi Team ,
I am trying commit log compression for dse 5.1.16,
how we can achieve and test commit log compression.
Thanks
Bringing together the Apache Cassandra experts from the community and DataStax.
Want to learn? Have a question? Want to share your expertise? You are in the right place!
Not sure where to begin? Getting Started
Hi Team ,
I am trying commit log compression for dse 5.1.16,
how we can achieve and test commit log compression.
Thanks
Hi Amitosh,
the default commit log location is `/var/lib/cassandra/commitlog`, in your case it may be configured to be different. After changing the settings (commitlog_compression) and restarting the database, you may check the difference there.
Compression settings for the commit log are documented here: https://docs.datastax.com/en/dse/5.1/dse-admin/datastax_enterprise/config/configCassandra_yaml.html#configCassandra_yaml__PerformanceTuningProps
Normal commit log is uncompressed, so it looks like that:
Notice that commit log compression may lead to a bit higher CPU load, I'd not set the compression level to be too high.
You could try to enable commit log compression on a single node and then compare it with the regular 'unchanged' node next to it.
@amitosh In the cassandra.yaml
, enable commitlog compression with:
commitlog_compression: - class_name: LZ4Compressor
Your results may vary depending on your cluster's access patterns and the type of disk being used for the commit log. Cheers!
4 People are following this question.
DataStax Enterprise is powered by the best distribution of Apache Cassandra ™
© 2022 DataStax, Titan, and TitanDB are registered trademarks of DataStax, Inc. and its subsidiaries in the United States and/or other countries.
Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries.
Privacy Policy Terms of Use