PLANNED MAINTENANCE

Hello, DataStax Community!

We want to make you aware of a few operational updates which will be carried out on the site. We are working hard to streamline the login process to integrate with other DataStax resources. As such, you will soon be prompted to update your password. Please note that your username will remain the same.

As we work to improve your user experience, please be aware that login to the DataStax Community will be unavailable for a few hours on:

  • Wednesday, July 15 16:00 PDT | 19:00 EDT | 20:00 BRT
  • Thursday, July 16 00:00 BST | 01:00 CEST | 04:30 IST | 07:00 CST | 09:00 AEST

For more info, check out the FAQ page. Thank you for being a valued member of our community.


question

amitosh avatar image
amitosh asked ·

copy data between table on different cluster

Hi Guys,


I want to copy data from one table in a cluster to another cluster table with filters. Basically from one environment (Stage) to another environment (Dev).


What is the best way to do that I am familiar with nodetool snapshot , but that may not work as we want just part of data.


Thanks



copy data
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

1 Answer

Lewisr650 avatar image
Lewisr650 answered ·

There are an endless numbers of stategies to move data between clusters. If you are running DSE the easiest would be to use Opscenter Backup/Restore to restore production data into dev, but that will perform a full restore of your data.

Here is an outline of some of your options:

https://docs.datastax.com/en/dse/6.7/dse-admin/datastax_enterprise/operations/OpsmigratingData.html


If you are familiar with Spark, you could write a simple Scala program to read data from one cluster and write it to anther. Typically, dev environments would not be accessible to prod environments and vice versa, so you might have details to deal with there.

Likely your easiest method would be to use Datastax Bulk Loader to export a collection of records from prod and then load them into your dev environment.

Share
10 |1000 characters needed characters left characters exceeded

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.