您好,登錄后才能下訂單哦!
本文主要介紹elasticsearch集群數據備份及恢復,利用共享文件系統,通過快照方式備份。
集群的部署參考:http://hnr520.blog.51cto.com/4484939/1876467
一、配置修改
1.配置文件必須添加如下參數
path.repo: /mnt/backups/es_mybak
二、數據備份
1.創建備份倉庫
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup' -d '{ "type": "fs", "settings": { "location": "/mnt/backups/es_mybak" } }' [root@node1 local]# curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup' -d '{ > "type": "fs", > "settings": { > "location": "/mnt/backups/es_mybak" > } > }' {"acknowledged":true}
給我們的倉庫取一個名字,在本例它叫 EsBackup 。
我們指定倉庫的類型應該是一個共享文件系統,這里采用nfs。
最后,我們提供一個已掛載的設備(/mnt/backups/es_mybak )作為目的地址。
注意:共享文件系統路徑必須確保集群所有節點都可以訪問到。
2.查詢備份倉庫
[root@node1 local]# curl -XGET 'http://192.168.115.11:9200/_snapshot?pretty' { "EsBackup" : { "type" : "fs", "settings" : { "location" : "/mnt/backups/es_mybak" } } }
3.備份所有索引
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all' [root@node1 local]# curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all' {"accepted":true}
4.查看備份快照
curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all?pretty' [root@node1 elasticsearch6]# curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_*?pretty' { "snapshots" : [ { "snapshot" : "snapshot_all", "uuid" : "MRTYocxBT4qgwtpu_6jdpg", "version_id" : 5000199, "version" : "5.0.1", "indices" : [ "els_student_hnr05", "hnrtest", "els_student_hnr03", "els_student", "els_student_hnr02", "els_student_hnr04", "els_python01", "els_student_hnr01" ], "state" : "SUCCESS", "start_time" : "2017-05-17T10:00:46.860Z", "start_time_in_millis" : 1495015246860, "end_time" : "2017-05-17T10:00:54.209Z", "end_time_in_millis" : 1495015254209, "duration_in_millis" : 7349, "failures" : [ ], "shards" : { "total" : 40, "failed" : 0, "successful" : 40 } } ] }
5.備份部分索引
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05' -d '{ "indices": "els_student_hnr05" }' [root@node1 elasticsearch6]# curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05' -d '{ "indices": "els_student_hnr05" }' {"accepted":true}
6.查看備份快照
curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05?pretty' 查看快照的詳細信息,可以看到每個shard的信息 curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05/_status?pretty' [root@node1 elasticsearch6]# curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05?pretty' { "snapshots" : [ { "snapshot" : "snapshot_els_student_hnr05", "uuid" : "hsSkWa63Ss6MJjh0Eo4arA", "version_id" : 5000199, "version" : "5.0.1", "indices" : [ "els_student_hnr05" ], "state" : "SUCCESS", "start_time" : "2017-05-18T00:58:35.699Z", "start_time_in_millis" : 1495069115699, "end_time" : "2017-05-18T00:58:36.396Z", "end_time_in_millis" : 1495069116396, "duration_in_millis" : 697, "failures" : [ ], "shards" : { "total" : 5, "failed" : 0, "successful" : 5 } } ] }
三、.部分索引數據恢復
1.查詢索引
curl -XGET '192.168.115.11:9200/_cat/indices?v' health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green open els_student_hnr05 mkvmTguZS4m1wGKbB8TOEw 5 1 99 0 124.7kb 62.3kb green open hnrtest Y-bjuEPLQTGGP88EafDlyg 5 1 0 0 1.5kb 795b green open els_student_hnr03 _UHB6P-fRfucH7lEyE-C7g 5 1 99 0 146.7kb 73.3kb green open els_student JC69IBEjTji8jU6bxCDE3A 5 1 999 0 495.9kb 247.9kb green open els_student_hnr02 k-aLl7tzRUyRfwJs8O0-kA 5 1 99 0 109.8kb 54.9kb green open els_student_hnr04 zAkj7GvfQ-CqmuFMJUTSuA 5 1 99 0 162.8kb 81.4kb green open els_python01 wmdREADVQmCX773_JDL46Q 5 1 0 0 1.5kb 795b green open els_student_hnr01 BJlcIp7mS0ii9nDYj8UDyQ 5 1 100 0 109.2kb 54.6kb
2.刪除索引els_student_hnr05
[root@node1 elasticsearch6]# curl -XDELETE 'http://192.168.115.11:9200/els_student_hnr05' {"acknowledged":true}
3.根據snapshot_els_student_hnr05快照恢復索引
curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05/_restore' [root@node1 elasticsearch6]# curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05/_restore' {"accepted":true}
4.再次查看索引
[root@node1 elasticsearch6]# curl -XGET '192.168.115.11:9200/_cat/indices?v' health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green open hnrtest Y-bjuEPLQTGGP88EafDlyg 5 1 0 0 1.5kb 795b green open els_student_hnr05 S3AsHa4dRtuXXZ3uIDGvuQ 5 1 99 0 124.7kb 62.3kb
被刪除的索引els_student_hnr05已經恢復回來
四、數據完全恢復
1.關閉所有節點,刪除數據目錄下的所有數據,重新啟動集群
kill -9 $(ps -ef | grep -v grep | grep elasticsearch | awk '{print $2}')
2.重新啟動集群
3.創建備份倉庫
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup' -d '{ "type": "fs", "settings": { "location": "/mnt/backups/es_mybak" } }'
4.查看備份快照
curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_*?pretty' { "snapshots" : [ { "snapshot" : "snapshot_all", "uuid" : "MRTYocxBT4qgwtpu_6jdpg", "version_id" : 5000199, "version" : "5.0.1", "indices" : [ "els_student_hnr05", "hnrtest", "els_student_hnr03", "els_student", "els_student_hnr02", "els_student_hnr04", "els_python01", "els_student_hnr01" ], "state" : "SUCCESS", "start_time" : "2017-05-17T10:00:46.860Z", "start_time_in_millis" : 1495015246860, "end_time" : "2017-05-17T10:00:54.209Z", "end_time_in_millis" : 1495015254209, "duration_in_millis" : 7349, "failures" : [ ], "shards" : { "total" : 40, "failed" : 0, "successful" : 40 } }, { "snapshot" : "snapshot_els_student_hnr05", "uuid" : "hsSkWa63Ss6MJjh0Eo4arA", "version_id" : 5000199, "version" : "5.0.1", "indices" : [ "els_student_hnr05" ], "state" : "SUCCESS", "start_time" : "2017-05-18T00:58:35.699Z", "start_time_in_millis" : 1495069115699, "end_time" : "2017-05-18T00:58:36.396Z", "end_time_in_millis" : 1495069116396, "duration_in_millis" : 697, "failures" : [ ], "shards" : { "total" : 5, "failed" : 0, "successful" : 5 } } ] }
5.恢復數據
curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all/_restore'
6.查詢索引
[root@node1 elasticsearch6]# curl -XGET '192.168.115.11:9200/_cat/indices?v' health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green open hnrtest LNkwevA2Sr2Jgue1oLRIGA 5 1 0 0 1.5kb 795b green open els_student 6aE8M7KMRN2EdievhDBXcw 5 1 999 0 495.9kb 247.9kb green open els_student_hnr04 8hXeVjXYRhS5POdy3hnMuQ 5 1 99 0 162.8kb 81.4kb green open els_student_hnr01 afVLqgxpTqii6pNObLC2sA 5 1 100 0 109.2kb 54.6kb green open els_student_hnr05 jzHPY_TlSEm-ZEXWz0sz4Q 5 1 99 0 124.7kb 62.3kb green open els_student_hnr02 f3hqeM1pQkWttZifnCCQDQ 5 1 99 0 109.8kb 54.9kb green open els_python01 4_vFwhn0RCi3SZbz2bORCw 5 1 0 0 1.5kb 795b green open els_student_hnr03 esFyZMwwTaeLf7YrKxyYjQ 5 1 99 0 146.7kb 73.3kb 至此所有索引已經完全恢復
五、從全部索引快照中恢復單個索引
1.刪除索引els_student_hnr05
curl -XDELETE 'http://192.168.115.11:9200/els_student_hnr05'
2.恢復被刪除的索引els_student_hnr05
curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all/_restore' -d '{ "indices": "els_student_hnr05", "rename_replacement": "restored_index_$1" }'
六、刪除快照
curl -XDELETE 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05' curl -XDELETE 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all'
免責聲明:本站發布的內容(圖片、視頻和文字)以原創、轉載和分享為主,文章觀點不代表本網站立場,如果涉及侵權請聯系站長郵箱:is@yisu.com進行舉報,并提供相關證據,一經查實,將立刻刪除涉嫌侵權內容。