Hi Guys,
I want to copy data from one table in a cluster to another cluster table with filters. Basically from one environment (Stage) to another environment (Dev).
What is the best way to do that I am familiar with nodetool snapshot , but that may not work as we want just part of data.
Thanks
There are an endless numbers of stategies to move data between clusters. If you are running DSE the easiest would be to use Opscenter Backup/Restore to restore production data into dev, but that will perform a full restore of your data.
Here is an outline of some of your options:
https://docs.datastax.com/en/dse/6.7/dse-admin/datastax_enterprise/operations/OpsmigratingData.html
If you are familiar with Spark, you could write a simple Scala program to read data from one cluster and write it to anther. Typically, dev environments would not be accessible to prod environments and vice versa, so you might have details to deal with there.
Likely your easiest method would be to use Datastax Bulk Loader to export a collection of records from prod and then load them into your dev environment.
2 People are following this question.
