Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

amitosh avatar image
amitosh asked ·

copy data between table on different cluster

Hi Guys,


I want to copy data from one table in a cluster to another cluster table with filters. Basically from one environment (Stage) to another environment (Dev).


What is the best way to do that I am familiar with nodetool snapshot , but that may not work as we want just part of data.


Thanks



copy data
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Lewisr650 avatar image
Lewisr650 answered ·

There are an endless numbers of stategies to move data between clusters. If you are running DSE the easiest would be to use Opscenter Backup/Restore to restore production data into dev, but that will perform a full restore of your data.

Here is an outline of some of your options:

https://docs.datastax.com/en/dse/6.7/dse-admin/datastax_enterprise/operations/OpsmigratingData.html


If you are familiar with Spark, you could write a simple Scala program to read data from one cluster and write it to anther. Typically, dev environments would not be accessible to prod environments and vice versa, so you might have details to deal with there.

Likely your easiest method would be to use Datastax Bulk Loader to export a collection of records from prod and then load them into your dev environment.

Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.