Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

amitosh avatar image
amitosh asked Aleks Volochnev published

how we can achieve and test commit log compression

Hi Team ,

I am trying commit log compression for dse 5.1.16,

how we can achieve and test commit log compression.

Thanks

commit log compression
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Aleks Volochnev avatar image
Aleks Volochnev answered Aleks Volochnev published

Hi Amitosh,

the default commit log location is `/var/lib/cassandra/commitlog`, in your case it may be configured to be different. After changing the settings (commitlog_compression) and restarting the database, you may check the difference there.

Compression settings for the commit log are documented here: https://docs.datastax.com/en/dse/5.1/dse-admin/datastax_enterprise/config/configCassandra_yaml.html#configCassandra_yaml__PerformanceTuningProps

Normal commit log is uncompressed, so it looks like that:

Notice that commit log compression may lead to a bit higher CPU load, I'd not set the compression level to be too high.

You could try to enable commit log compression on a single node and then compare it with the regular 'unchanged' node next to it.


1565352894752.png (23.0 KiB)
1565354244640.png (59.4 KiB)
Share
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Erick Ramirez avatar image
Erick Ramirez answered

@amitosh In the cassandra.yaml, enable commitlog compression with:

commitlog_compression:
  - class_name: LZ4Compressor

Your results may vary depending on your cluster's access patterns and the type of disk being used for the commit log. Cheers!

Share
10 |1000

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.