cassandra 导入数据好慢怎么办？

Question

This question was closed Jun 18, 2021 at 06:11 AM by Erick Ramirez for the following reason: The question is answered, right answer was accepted

question

wdeng asked Mar 17, '20 Erick Ramirez edited Jun 18, '21

cassandra 导入数据好慢怎么办？

cassandra 导入数据好慢。ftp_db.sql 数据文件200G，导入一个晚上没完成，还在进行中，半天又过去了。同样的数据文件，我用mysql已经导入完成。

data load

10 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

DataStax Enterprise is powered by the best distribution of Apache Cassandra ™

Apache, Apache Cassandra, Cassandra, Apache Tomcat, Tomcat, Apache Lucene, Lucene, Apache Solr, Apache Hadoop, Hadoop, Apache Spark, Spark, Apache TinkerPop, TinkerPop, Apache Kafka and Kafka are either registered trademarks or trademarks of the Apache Software Foundation or its subsidiaries in Canada, the United States and/or other countries.

Privacy Policy Terms of Use

Answer 1 · 2020-04-08T19:03:02Z

wdeng answered Apr 8, '20

可以试一下Datastax的DSE Bulkloader（https://docs.datastax.com/en/dsbulk/doc/dsbulk/install/dsbulkInstall.html）。

这个程序使用最新的DataStax Java CQL Driver，利用了很多driver提供的优化，比你自己写程序用INSERT插入记录或者cqlsh COPY命令要更快。

Share

10 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

question

cassandra 导入数据好慢怎么办？

1 Answer

question details

OTHER RESOURCES