reprendre
Le NFS XCP resume
la commande redémarre une opération de copie interrompue en spécifiant le nom ou le numéro d'index du catalogue. Le nom ou le numéro d'index du catalogue de l'opération de copie précédente se trouve dans le <catalog path>:/catalog/indexes
répertoire.
xcp resume -id <catalog_name>
Le -id <catalog_name> le paramètre est requis avec le resume commande.
|
Montrer l'exemple
[root@localhost linux]# ./xcp resume -id ID001 xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of destination NFS server>:/dest_vol} xcp: resume 'ID001': Reviewing the incomplete index... xcp: diff 'ID001': Found 652 completed directories and 31 in progress 4,658 reviewed, 362 KiB in (258 KiB/s), 7.66 KiB out (5.46 KiB/s), 1s. xcp: resume 'ID001': Starting second pass for the in-progress directories... xcp: resume 'ID001': Resuming the in-progress directories... xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'} xcp: resume 'ID001': Current options: {-id: 'ID001'} xcp: resume 'ID001': Merged options: {-id: 'ID001', -newid: u'ID001'} xcp: resume 'ID001': Values marked with a * include operations before resume 28,866 MiB/s), scanned*, 5s 9,565 copied*, 4,658 indexed*, 108 MiB in (21.6 MiB/s), 100.0 MiB out(20.0 44,761 MiB/s), 44,761 scanned*, 11s scanned*, 16,440 20,795 copied*, copied*, 4,658 indexed*, 206 MiB in (19.3 MiB/s), 191 MiB out (17.9 4,658 indexed*, 362 MiB in (31.3 MiB/s), 345 MiB out (30.8 MiB/s), 44,761 16s scanned*, 25,985 copied*, 4,658 indexed*, 488 MiB in (25.2 MiB/s), 465 MiB out (24.0 MiB/s), 44,761 21s scanned*, 31,044 copied*, 4,658 indexed*, 578 MiB in (17.9 MiB/s), 558 MiB out (18.6 MiB/s), 54,838 26s scanned*, 36,980 copied*, 14,276 indexed*, 679 MiB in (20.2 MiB/s), 657 MiB out (19.8 MiB/s), 67,123 31s scanned*, 42,485 copied*, 29,160 indexed*, 742 MiB in (12.5 MiB/s), 720 MiB out (12.4 MiB/s), 79,681 36s scanned*, 49,863 copied*, 39,227 indexed*, 801 MiB in (11.8 MiB/s), 779 MiB out (11.7 MiB/s), 79,681 41s scanned*, 56,273 copied*, 39,227 indexed*, 854 MiB in (10.6 MiB/s), 832 MiB out (10.6 MiB/s), 79,681 46s scanned*, 62,593 copied*, 39,227 indexed*, 906 MiB in (10.2 MiB/s), 881 MiB out (9.70 MiB/s), 84,577 51s scanned*, 68,000 copied*, 44,047 indexed*, 976 MiB in (14.0 MiB/s), 951 MiB out (14.1 MiB/s), 86,737 56s scanned*, 72,738 copied*, 49,071 indexed*, 1.04 GiB in (17.8 MiB/s), 1.01 GiB out (17.5 MiB/s), 89,690 1m1s scanned*, 77,440 copied*, 54,110 indexed*, 1.14 GiB in (20.5 MiB/s), 1.11 GiB out (20.1 MiB/s), 1m6s 110,311 scanned*, 84,497 copied*, 74,158 indexed*, 1.24 GiB in (20.3 MiB/s), 1.21 GiB out (20.4 MiB/s), 1m11s 114,726 scanned*, 91,285 copied*, 74,158 indexed*, 1.33 GiB in (17.9 MiB/s), 1.30 GiB out (17.6 MiB/s), 1m16s 114,726 scanned*, 97,016 copied*, 74,158 indexed*, 1.46 GiB in (26.6 MiB/s), 1.43 GiB out (26.6 MiB/s), 1m21s 118,743 scanned*, 100,577 copied*, 79,331 indexed*, 1.65 GiB in (40.1 MiB/s), 1.62 GiB out (39.3 MiB/s), 1m26s 122,180 scanned*, 106,572 copied*, 84,217 indexed*, 1.77 GiB in (24.7 MiB/s), 1.74 GiB out (25.0 MiB/s), 1m31s 124,724 scanned*, 111,727 copied*, 84,217 indexed*, 1.89 GiB in (22.8 MiB/s), 1.86 GiB out (22.5 MiB/s), 1m36s 128,268 scanned*, 114,686 copied*, 99,203 indexed*, 1.99 GiB in (21.1 MiB/s), 1.96 GiB out (21.2 MiB/s), 1m41s 134,630 scanned*, 118,217 copied*, 104,317 indexed*, 2.06 GiB in (13.8 MiB/s), 2.03 GiB out (13.7 MiB/s), 1m46s 134,630 scanned*, 121,742 copied*, 109,417 indexed*, 2.10 GiB in (9.02 MiB/s), 2.07 GiB out (9.30 MiB/s), 1m51s 134,630 scanned*, 126,057 copied*, 109,417 indexed*, 2.20 GiB in (21.0 MiB/s), 2.17 GiB out (21.0 MiB/s), 1m56s 134,630 scanned*, 130,034 copied*, 114,312 indexed*, 2.36 GiB in (32.1 MiB/s), 2.33 GiBout (31.8 MiB/s), 2m1s Xcp command : xcp resume -id ID001 134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error Speed : 2.40 GiB in (19.7 MiB/s), 2.37 GiB out (19.5 MiB/s) Total Time : 2m4s. STATUS : PASSED
Le tableau suivant répertorie la resume
paramètres et leur description.
Paramètre | Description |
---|---|
Spécifie le nom de catalogue d'un index de copie précédent. Il s'agit d'un paramètre obligatoire pour la commande RESUME. |
|
Spécifie la taille du bloc de lecture/écriture (par défaut : 64 ko). |
|
<<resume_dircount,reprendre -dircount lt;n[k]> |
Spécifie la taille de la demande lors de la lecture des répertoires. |
<<resume_parallel,reprise - parallèle et gauche ; n ; |
Spécifie le nombre maximal de processus de traitement par lots simultanés (par défaut : 7). |
Restaure tous les fichiers à la dernière date d'accès sur la source. |
|
Permet d'utiliser HTTP au lieu de HTTPS pour les communications entre compartiments S3. |
|
Remplace l'URL du terminal Amazon Web Services (AWS) par défaut par l'URL spécifiée pour la communication du compartiment S3. |
|
Spécifie un profil à partir du fichier d'informations d'identification AWS pour la communication du compartiment S3. |
|
Remplace la vérification par défaut de la certification SSL pour les communications de compartiment S3. |
reprendre -bs <n[k]>
Utilisez le -bs <n[k]>
paramètre avec le resume
pour spécifier la taille des blocs de lecture/écriture. La taille de bloc par défaut est de 64 Ko.
xcp resume -id <catalog_name> -bs <n[k]>
Montrer l'exemple
[root@localhost linux]# ./xcp resume -id ID001 -bs 32k xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of destination NFS server>:/dest_vol} xcp: resume 'ID001': Reviewing the incomplete index... xcp: diff 'ID001': Found 2,360 completed directories and 152 in progress 19,440 reviewed, 1.28 MiB in (898 KiB/s), 9.77 KiB out (6.71 KiB/s), 1s. xcp: resume 'ID001': Starting second pass for the in-progress directories... xcp: resume 'ID001': Resuming the in-progress directories... xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'} xcp: resume 'ID001': Current options: {-bs: '32k', -id: 'ID001'} xcp: resume 'ID001': Merged options: {-bs: '32k', -id: 'ID001', -newid: u'ID001'} xcp: resume 'ID001': Values marked with a * include operations before resume 44,242 MiB/s), scanned*, 5s 24,132 copied*, 19,440 indexed*, 36.7 MiB in (7.34 MiB/s), 30.6 MiB out (6.12 59,558 MiB/s), 59,558 scanned*, 10s scanned*, 30,698 35,234 copied*, copied*, 19,440 19,440 indexed*, indexed*, 142 203 MiB MiB in in (20.9 MiB/s), 125 (12.1 MiB/s), 187 MiB MiB out out (18.8 (12.2 MiB/s), 59,558 15s scanned*, 40,813 copied*, 19,440 indexed*, 286 MiB in (16.5 MiB/s), 269 MiB out (16.5 MiB/s), 65,126 20s scanned*, 46,317 copied*, 24,106 indexed*, 401 MiB in (22.9 MiB/s), 382 MiB out (22.5 MiB/s), 69,214 25s scanned*, 53,034 copied*, 29,031 indexed*, 496 MiB in (19.0 MiB/s), 476 MiB out (18.7 MiB/s), 85,438 30s scanned*, 60,627 copied*, 53,819 indexed*, 591 MiB in (18.9 MiB/s), 569 MiB out (18.5 MiB/s), 94,647 35s scanned*, 66,948 copied*, 53,819 indexed*, 700 MiB in (21.6 MiB/s), 679 MiB out (21.9 MiB/s), 94,647 40s scanned*, 73,632 copied*, 53,819 indexed*, 783 MiB in (16.5 MiB/s), 761 MiB out (16.4 MiB/s), 99,683 45s scanned*, 80,541 copied*, 58,962 indexed*, 849 MiB in (13.0 MiB/s), 824 MiB out (12.4 MiB/s), 50s 99,683 MiB/s), scanned*, 55s 84,911 copied*, 58,962 indexed*, 1013 MiB in (32.8 MiB/s), 991 MiB out (33.2 101,667 scanned*, 91,386 copied*, 73,849 indexed*, 1.06 GiB in (15.4 MiB/s), 1.04 GiB out (15.4 MiB/s), 1m0s 118,251 scanned*, 98,413 copied*, 89,168 indexed*, 1.13 GiB in (14.0 MiB/s), 1.11 GiB out (13.3 MiB/s), 1m5s 124,672 scanned*, 104,134 copied*, 89,168 indexed*, 1.25 GiB in (23.9 MiB/s), 1.22 GiB out (23.2 MiB/s), 1m10s 130,171 scanned*, 109,594 copied*, 94,016 indexed*, 1.38 GiB in (25.7 MiB/s), 1.35 GiB out (25.5 MiB/s), 1m15s 134,574 scanned*, 113,798 copied*, 94,016 indexed*, 1.52 GiB in (28.6 MiB/s), 1.48 GiB out (28.2 MiB/s), 1m20s 134,574 scanned*, 118,078 copied*, 94,016 indexed*, 1.64 GiB in (24.6 MiB/s), 1.61 GiB out (25.1 MiB/s), 1m25s 134,574 scanned*, 121,502 copied*, 94,016 indexed*, 1.80 GiB in (34.0 MiB/s), 1.77 GiB out (33.0 MiB/s), 1m30s 134,630 scanned*, 126,147 copied*, 104,150 indexed*, 1.88 GiB in (16.2 MiB/s), 1.86 GiB out (17.5 MiB/s), 1m35s 134,630 scanned*, 131,830 copied*, 119,455 indexed*, 1.95 GiB in (13.6 MiB/s), 1.92 GiB out (13.5 MiB/s), 1m41s Xcp command : xcp resume -id ID001 -bs 32k 134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error Speed : 2.02 GiB in (19.9 MiB/s), 1.99 GiB out (19.7 MiB/s) Total Time : 1m43s. STATUS : PASSED
reprendre -dircount <n[k]>
Utilisez le -dircount <n[k]>
paramètre avec le resume
commande permettant de spécifier la taille de la demande lors de la lecture des répertoires. La valeur par défaut est 64k.
xcp resume -id <catalog_name> -dircount <n[k]>
Montrer l'exemple
root@localhost linux]# ./xcp resume -id ID001 -dircount 32k xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of destination NFS server>:/dest_vol} xcp: resume 'ID001': Reviewing the incomplete index... xcp: diff 'ID001': Found 4,582 completed directories and 238 in progress 39,520 reviewed, 2.47 MiB in (1.49 MiB/s), 12.6 KiB out (7.62 KiB/s), 1s. xcp: resume 'ID001': Starting second pass for the in-progress directories... xcp: resume 'ID001': Resuming the in-progress directories... xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'} xcp: resume 'ID001': Current options: {-dircount: '32k', -id: 'ID001'} xcp: resume 'ID001': Merged options: {-dircount: '32k', -id: 'ID001', -newid: u'ID001'} xcp: resume 'ID001': Values marked with a * include operations before resume 76,626 scanned*, 43,825 copied*, 39,520 indexed*, 31.7 MiB in (6.33 MiB/s), 23.0 MiB out (4.60 MiB/s), 5s 79,751 scanned*, 49,942 copied*, 39,520 indexed*, 140 MiB in (21.7 MiB/s), 131 MiB out (21.5 MiB/s), 10s 79,751 scanned*, 55,901 copied*, 39,520 indexed*, 234 MiB in (18.8 MiB/s), 223 MiB out (18.3 MiB/s), 15s 79,751 scanned*, 61,764 copied*, 39,520 indexed*, 325 MiB in (18.0 MiB/s), 313 MiB out (17.9 MiB/s), 20s 84,791 scanned*, 68,129 copied*, 44,510 indexed*, 397 MiB in (14.3 MiB/s), 384 MiB out (14.2 MiB/s), 25s 94,698 scanned*, 74,741 copied*, 54,039 indexed*, 485 MiB in (17.4 MiB/s), 473 MiB out (17.8 MiB/s), 30s 99,734 scanned*, 80,110 copied*, 59,044 indexed*, 605 MiB in (24.1 MiB/s), 591 MiB out (23.7 MiB/s), 35s 104,773 scanned*, 86,288 copied*, 69,005 indexed*, 716 MiB in (22.2 MiB/s), 703 MiB out (22.3 MiB/s), 40s 110,076 scanned*, 93,265 copied*, 79,102 indexed*, 795 MiB in (15.8 MiB/s), 781 MiB out (15.5 MiB/s), 45s 121,341 scanned*, 100,077 copied*, 84,096 indexed*, 897 MiB in (20.4 MiB/s), 881 MiB out (19.9 MiB/s), 50s 125,032 scanned*, 105,712 copied*, 89,132 indexed*, 1003 MiB in (21.2 MiB/s), 985 MiB out (20.7 MiB/s), 55s 129,548 scanned*, 110,382 copied*, 89,132 indexed*, 1.14 GiB in (32.0 MiB/s), 1.12 GiB out (32.1 MiB/s), 1m0s 131,976 scanned*, 115,158 copied*, 94,221 indexed*, 1.23 GiB in (19.2 MiB/s), 1.21 GiB out (18.3 MiB/s), 1m5s 134,430 scanned*, 119,161 copied*, 94,221 indexed*, 1.37 GiB in (27.8 MiB/s), 1.35 GiB out (28.3 MiB/s), 1m10s 134,630 scanned*, 125,013 copied*, 109,402 indexed*, 1.47 GiB in (21.2 MiB/s), 1.45 GiB out (21.4 MiB/s), 1m15s 134,630 scanned*, 129,301 copied*, 114,532 indexed*, 1.61 GiB in (29.4 MiB/s), 1.60 GiB out (29.8 MiB/s), 1m20s 134,630 scanned*, 132,546 copied*, 124,445 indexed*, 1.69 GiB in (14.8 MiB/s), 1.67 GiBout (15.0 MiB/s), 1m25s Xcp command : xcp resume -id ID001 -dircount 32k 134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error Speed : 1.70 GiB in (19.7 MiB/s), 1.69 GiB out (19.5 MiB/s) Total Time : 1m28s. STATUS : PASSED
reprise -<n> parallèle
Utilisez le - parallel <n>
paramètre avec le resume
pour spécifier le nombre maximal de traitements par lots simultanés. La valeur par défaut est 7.
xcp resume -id <catalog_name> -parallel <n>
Montrer l'exemple
[root@localhost linux]# ./xcp resume -id ID001 -parallel 3 xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of destination NFS server>:/dest_vol} xcp: resume 'ID001': Reviewing the incomplete index... xcp: diff 'ID001': Found 2,347 completed directories and 149 in progress 19,399 reviewed, 1.28 MiB in (659 KiB/s), 9.77 KiB out (4.93 KiB/s), 1s. xcp: resume 'ID001': Starting second pass for the in-progress directories... xcp: resume 'ID001': Resuming the in-progress directories... xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'} xcp: resume 'ID001': Current options: {-id: 'ID001', -parallel: 3} xcp: resume 'ID001': Merged options: {-id: 'ID001', -newid: u'ID001', -parallel: 3} xcp: resume 'ID001': Values marked with a * include operations before resume 39,610 scanned*, 23,642 copied*, 19,399 indexed*, 56.3 MiB in (11.2 MiB/s), 45.8 MiB out (9.15 MiB/s), 5s 39,610 scanned*, 28,980 copied*, 19,399 indexed*, 145 MiB in (17.6 MiB/s), 134 MiB out (17.6 MiB/s), 10s 48,111 scanned*, 34,782 copied*, 34,042 indexed*, 223 MiB in (15.8 MiB/s), 212 MiB out (15.7 MiB/s), 15s 55,412 scanned*, 40,468 copied*, 34,042 indexed*, 317 MiB in (18.4 MiB/s), 304 MiB out (18.1 MiB/s), 21s 59,639 scanned*, 46,980 copied*, 39,032 indexed*, 390 MiB in (14.6 MiB/s), 377 MiB out (14.5 MiB/s), 26s 69,520 scanned*, 55,251 copied*, 49,006 indexed*, 438 MiB in (9.59 MiB/s), 423 MiB out (9.21 MiB/s), 31s 78,596 scanned*, 62,054 copied*, 59,001 indexed*, 492 MiB in (10.7 MiB/s), 476 MiB out (10.6 MiB/s), 36s 79,673 scanned*, 68,163 copied*, 59,001 indexed*, 610 MiB in (23.5 MiB/s), 593 MiB out (23.5 MiB/s), 41s 84,600 scanned*, 74,238 copied*, 64,150 indexed*, 723 MiB in (22.5 MiB/s), 705 MiB out (22.3 MiB/s), 46s 94,525 scanned*, 80,754 copied*, 74,157 indexed*, 807 MiB in (16.7 MiB/s), 788 MiB out (16.4 MiB/s), 51s 94,525 scanned*, 85,119 copied*, 74,157 indexed*, 1007 MiB in (39.9 MiB/s), 988 MiB out (39.9 MiB/s), 56s 09,514 scanned*, 93,474 copied*, 89,192 indexed*, 1.08 GiB in (20.7 MiB/s), 1.06 GiB out (20.2 MiB/s), 1m1s 111,953 scanned*, 100,639 copied*, 94,248 indexed*, 1.18 GiB in (19.3 MiB/s), 1.16 GiB out (19.2 MiB/s), 1m6s 114,605 scanned*, 105,958 copied*, 94,248 indexed*, 1.36 GiB in (36.8 MiB/s), 1.34 GiB out (36.6 MiB/s), 1m11s 124,531 scanned*, 112,340 copied*, 104,275 indexed*, 1.51 GiB in (29.8 MiB/s), 1.48 GiB out (29.4 MiB/s), 1m16s 129,694 scanned*, 117,218 copied*, 109,236 indexed*, 1.67 GiB in (33.2 MiB/s), 1.65 GiB out (33.1 MiB/s), 1m21s 131,753 scanned*, 123,850 copied*, 114,358 indexed*, 1.80 GiB in (25.9 MiB/s), 1.77 GiB out (25.9 MiB/s), 1m26s 134,630 scanned*, 130,829 copied*, 124,437 indexed*, 1.85 GiB in (11.2 MiB/s), 1.83 GiBout (11.2 MiB/s), 1m31s Xcp command : xcp resume -id ID001 -parallel 3 134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error Speed : 2.02 GiB in (21.6 MiB/s), 2.00 GiB out (21.3 MiB/s) Total Time : 1m35s. STATUS : PASSED
reprendre -conserver-atime
Utilisez le -preserve-atime
paramètre avec le resume
pour restaurer tous les fichiers à la date de dernier accès sur la source.
Le -preserve-atime
Le paramètre réinitialise le temps d'accès à la valeur d'origine définie avant l'opération de lecture XCP.
xcp resume -id <catalog_name> -preserve-atime
Montrer l'exemple
root@client1 linux]# ./xcp resume -preserve-atime -id XCP_copy_2022-06-30_14.22.53.742272 xcp: Job ID: Job_XCP_copy_2022-06-30_14.22.53.742272_2022-06-30_14.37.07.746208_resume xcp: Index: {source: 101.10.10.12:/source_vol, target: 10.102.102.70:/dest_vol} xcp: Tune: Previous operation on id 'XCP_copy_2022-06-30_14.22.53.742272' already completed; nothing to resume 0 in (0/s), 0 out (0/s), 6s Xcp command : xcp resume -preserve-atime -id XCP_copy_2022-06-30_14.22.53.742272 Stats : Speed : 0 in (0/s), 0 out (0/s) Total Time : 6s. Migration ID: XCP_copy_2022-06-30_14.22.53.742272 Job ID : Job_XCP_copy_2022-06-30_14.22.53.742272_2022-06-30_14.37.07.746208_resume Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2022-06-30_14.22.53.742272_2022-06- 30_14.37.07.746208_resume.log STATUS : PASSED
reprendre -s3.insecure
Utilisez le -s3.insecure
paramètre avec le resume
Commande permettant d'utiliser HTTP au lieu de HTTPS pour les communications entre les compartiments S3.
Si le -s3.insecure le paramètre est utilisé avec le copy elle est ignorée lors de la reprise. Vous devez spécifier -s3.insecure pour utiliser à nouveau l'option de reprise.
|
xcp resume -s3.insecure -id <catalog_name>
Montrer l'exemple
root@client1 linux]# ./xcp resume -s3.insecure -id XCP_copy_2023-06-08_10.31.47.381883 Job ID: Job_XCP_copy_2023-06-08_10.31.47.381883_2023-06-08_10.34.02.964143_resume Index: {source: 1 hdfs:///user/demo, target: s3://bucket1/} Reviewing the incomplete index... Found 0 completed directories and 2 in progress 4,009 reviewed, 88.7 KiB in (76.1 KiB/s), 332 out (285/s), 1s. 4,009 reviewed, 90.9 KiB in (77.6 KiB/s), 2.44 KiB out (2.08 KiB/s), 1s. Starting second pass for the in-progress directories... 4,009 reviewed, 4,009 re-reviewed, 179 KiB in (130 KiB/s), 2.72 KiB out (1.98 KiB/s), 1s. 9,008 scanned*, 4,540 copied*, 4,009 indexed*, 534 KiB s3.data.uploaded, 534 s3.copied.single.key.file, 534 s3.copied.file, 2.28 MiB in (464 KiB/s), 631 KiB out (126 KiB/s), 5s 9,008 scanned*, 5,551 copied*, 4,009 indexed*, 1.51 MiB s3.data.uploaded, 1,544 s3.copied.single.key.file, 1,544 s3.copied.file, 3.38 MiB in (222 KiB/s), 1.74 MiB out (226 KiB/s), 10s 9,008 scanned*, 6,596 copied*, 4,009 indexed*, 2.53 MiB s3.data.uploaded, 2,595 s3.copied.single.key.file, 2,595 s3.copied.file, 4.55 MiB in (235 KiB/s), 2.91 MiB out (236 KiB/s), 15s 9,008 scanned*, 7,658 copied*, 4,009 indexed*, 3.57 MiB s3.data.uploaded, 3,652 s3.copied.single.key.file, 3,652 s3.copied.file, 5.71 MiB in (234 KiB/s), 4.09 MiB out (238 KiB/s), 20s 9,008 scanned*, 8,711 copied*, 4,009 indexed*, 4.60 MiB s3.data.uploaded, 4,706 s3.copied.single.key.file, 4,706 s3.copied.file, 6.88 MiB in (235 KiB/s), 5.26 MiB out (236 KiB/s), 25s Xcp command : xcp resume -s3.insecure -id XCP_copy_2023-06-08_10.31.47.381883 Stats : 9,008 scanned*, 9,006 copied*, 9,009 indexed*, 4.88 MiB s3.data.uploaded, 4,996 s3.copied.single.key.file, 4,996 s3.copied.file Speed : 7.10 MiB in (270 KiB/s), 5.76 MiB out (219 KiB/s) Total Time : 26s. Migration ID: XCP_copy_2023-06-08_10.31.47.381883 Job ID : Job_XCP_copy_2023-06-08_10.31.47.381883_2023-06-08_10.34.02.964143_resume Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-08_10.31.47.381883_2023-06- 08_10.34.02.964143_resume.log STATUS : PASSED
reprenez -s3.<s3_endpoint_url> de terminal
Utilisez le -s3.endpoint <s3_endpoint_url>
paramètre avec le resume
Commande permettant de remplacer l'URL du terminal AWS par défaut par l'URL spécifiée pour la communication du compartiment S3.
Par défaut, resume utilise le profil S3 et le terminal S3 spécifiés lors de l'opération de copie. Toutefois, si vous spécifiez un nouveau terminal S3 et un nouveau profil S3 lors de la reprise, celui-ci remplace la valeur par défaut utilisée avec le copy commande.
|
xcp resume -s3.profile <profile_name> -s3.endpoint https://<endpoint_url>: -id <catalog_name>
Montrer l'exemple
[root@client1 linux]# ./xcp resume -id XCP_copy_2023-06-13_11.48.59.454327 Job ID: Job_XCP_copy_2023-06-13_11.48.59.454327_2023-06-13_11.49.34.887164_resume Index: {source: hdfs:///user/demo, target: s3://xcp-testing/} Reviewing the incomplete index... Found 0 completed directories and 2 in progress 9 reviewed, 4.53 KiB in (2.47 KiB/s), 188 out (102/s), 1s. 9 reviewed, 6.81 KiB in (3.70 KiB/s), 2.30 KiB out (1.25 KiB/s), 1s. Starting second pass for the in-progress directories... 9 reviewed, 9 re-reviewed, 10.9 KiB in (5.65 KiB/s), 2.44 KiB out (1.26 KiB/s), 1s. 15,008 scanned*, 1,532 copied*, 9 indexed*, 1.50 MiB s3.data.uploaded, 1,539 s3.copied.single.key.file, 1,539 s3.copied.file, 4.64 MiB in (946 KiB/s), 1.77 MiB out (360 KiB/s), 6s 15,008 scanned*, 4,764 copied*, 9 indexed*, 4.67 MiB s3.data.uploaded, 4,784 s3.copied.single.key.file, 4,784 s3.copied.file, 8.21 MiB in (727 KiB/s), 5.38 MiB out (736 KiB/s), 11s 15,008 scanned*, 7,928 copied*, 9 indexed*, 7.75 MiB s3.data.uploaded, 7,935 5,008 scanned*, 7,928 copied*, 9 indexed*, 7.75 MiB s3.data.uploaded, 7,935 s3.copied.single.key.file, 7,935 s3.copied.file, 11.7 MiB in (703 KiB/s), 8.89 MiB out (708 KiB/s), 16s 15,008 scanned*, 10,863 copied*, 9 indexed*, 10.6 MiB s3.data.uploaded, 10,864 s3.copied.single.key.file, 10,864 s3.copied.file, 14.9 MiB in (660 KiB/s), 12.2 MiB out (664 KiB/s), 21s 15,008 scanned*, 14,060 copied*, 9 indexed*, 13.7 MiB s3.data.uploaded, 14,076 s3.copied.single.key.file, 14,076 s3.copied.file, 18.5 MiB in (716 KiB/s), 15.7 MiB out (725 KiB/s), 26s Xcp command : xcp resume -id XCP_copy_2023-06-13_11.48.59.454327 Stats : 15,008 scanned*, 15,006 copied*, 15,009 indexed*, 14.6 MiB s3.data.uploaded, 14,996 s3.copied.single.key.file, 14,996 s3.copied.file Speed : 19.2 MiB in (708 KiB/s), 17.1 MiB out (631 KiB/s) Total Time : 27s. Migration ID: XCP_copy_2023-06-13_11.48.59.454327 Job ID : Job_XCP_copy_2023-06-13_11.48.59.454327_2023-06-13_11.49.34.887164_resume Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-13_11.48.59.454327_2023-06- 13_11.49.34.887164_resume.log STATUS : PASSED
reprendre s3.profile <profile_name>
Utilisez le -s3.profile <profile_name>
paramètre avec le resume
Commande permettant de spécifier un profil à partir du fichier d'informations d'identification AWS pour les communications du compartiment S3
Par défaut, resume utilise le profil S3 et le terminal S3 spécifiés lors de l'opération de copie. Toutefois, si vous spécifiez un nouveau terminal S3 et un nouveau profil S3 lors de la reprise, celui-ci remplace la valeur par défaut utilisée avec le copy commande.
|
xcp resume -s3.profile <name> -s3.endpoint -id <catalog_name>
Montrer l'exemple
[root@client1 linux]# ./xcp resume -s3.profile sg -s3.endpoint https://<endpoint_url>: -id XCP_copy_2023-06-08_10.40.42.519258 Job ID: Job_XCP_copy_2023-06-08_10.40.42.519258_2023-06-08_10.52.18.453982_resume Index: {source: hdfs:///user/demo target: s3://xxx-bucket/ Reviewing the incomplete index... Found 0 completed directories and 2 in progress 9 reviewed, 4.53 KiB in (3.03 KiB/s), 188 out (126/s), 1s. 9 reviewed, 6.81 KiB in (4.52 KiB/s), 2.30 KiB out (1.53 KiB/s), 1s. Starting second pass for the in-progress directories... 9 reviewed, 9 re-reviewed, 10.9 KiB in (6.76 KiB/s), 2.44 KiB out (1.51 KiB/s), 1s. 15,008 scanned*, 1,660 copied*, 9 indexed*, 1.64 MiB s3.data.uploaded, 1,675 s3.copied.single.key.file, 1,675 s3.copied.file, 4.75 MiB in (971 KiB/s), 1.92 MiB out (392 KiB/s), 5s 15,008 scanned*, 3,453 copied*, 9 indexed*, 3.39 MiB s3.data.uploaded, 3,467 s3.copied.single.key.file, 3,467 s3.copied.file, 6.79 MiB in (412 KiB/s), 3.91 MiB out (403 KiB/s), 10s 15,008 scanned*, 6,296 copied*, 9 indexed*, 6.16 MiB s3.data.uploaded, 6,305 s3.copied.single.key.file, 6,305 s3.copied.file, 9.86 MiB in (619 KiB/s), 7.08 MiB out (637 KiB/s), 15s 15,008 scanned*, 9,527 copied*, 9 indexed*, 9.33 MiB s3.data.uploaded, 9,554 s3.copied.single.key.file, 9,554 s3.copied.file, 13.4 MiB in (717 KiB/s), 10.7 MiB out (726 KiB/s), 20s 15,008 scanned*, 12,656 copied*, 9 indexed*, 12.4 MiB s3.data.uploaded, 12,648 s3.copied.single.key.file, 12,648 s3.copied.file, 16.9 MiB in (715 KiB/s), 14.1 MiB out (706 KiB/s), 25s Xcp command : xcp resume -s3.profile sg -s3.endpoint https://<endpoint_url>: -id XCP_copy_2023- 06-08_10.40.42.519258 Stats : 15,008 scanned*, 15,006 copied*, 15,009 indexed*, 14.6 MiB s3.data.uploaded, 14,996 s3.copied.single.key.file, 14,996 s3.copied.file Speed : 19.2 MiB in (661 KiB/s), 17.1 MiB out (590 KiB/s) Total Time : 29s. Migration ID: XCP_copy_2023-06-08_10.40.42.519258 Job ID : Job_XCP_copy_2023-06-08_10.40.42.519258_2023-06-08_10.52.18.453982_resume Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-08_10.40.42.519258_2023-06- 08_10.52.18.453982_resume.log STATUS : PASSED
reprendre -s3.noverify
Utilisez le -s3.noverify
paramètre avec le resume
Commande permettant de remplacer la vérification par défaut de la certification SSL pour les communications de compartiment S3.
xcp resume -s3.noverify -id <catalog_name>
Montrer l'exemple
[root@client1 linux]# ./xcp resume -s3.noverify -id XCP_copy_2023-06-13_11.32.47.743708 Job ID: Job_XCP_copy_2023-06-13_11.32.47.743708_2023-06-13_11.33.41.388541_resume Index: {source: hdfs:///user/demo, target: s3://bucket/ Reviewing the incomplete index... Found 0 completed directories and 2 in progress 9 reviewed, 4.53 KiB in (3.70 KiB/s), 188 out (153/s), 1s. 9 reviewed, 6.81 KiB in (5.52 KiB/s), 2.30 KiB out (1.87 KiB/s), 1s. Starting second pass for the in-progress directories... 9 reviewed, 9 re-reviewed, 10.9 KiB in (8.19 KiB/s), 2.44 KiB out (1.83 KiB/s), 1s. 15,008 scanned*, 1,643 copied*, 9 indexed*, 1.62 MiB s3.data.uploaded, 1,662 s3.copied.single.key.file, 1,662 s3.copied.file, 4.78 MiB in (969 KiB/s), 1.90 MiB out (385 KiB/s), 5s 15,008 scanned*, 4,897 copied*, 9 indexed*, 4.78 MiB s3.data.uploaded, 4,892 s3.copied.single.key.file, 4,892 s3.copied.file, 8.38 MiB in (735 KiB/s), 5.50 MiB out (737 KiB/s), 10s 15,008 scanned*, 8,034 copied*, 9 indexed*, 7.86 MiB s3.data.uploaded, 8,048 s3.copied.single.key.file, 8,048 s3.copied.file, 11.8 MiB in (696 KiB/s), 9.02 MiB out (708 KiB/s), 15s 15,008 scanned*, 11,243 copied*, 9 indexed*, 11.0 MiB s3.data.uploaded, 11,258 s3.copied.single.key.file, 11,258 s3.copied.file, 15.3 MiB in (709 KiB/s), 12.6 MiB out (724 KiB/s), 20s 15,008 scanned*, 14,185 copied*, 9 indexed*, 13.9 MiB s3.data.uploaded, 14,195 s3.copied.single.key.file, 14,195 s3.copied.file, 18.6 MiB in (662 KiB/s), 15.9 MiB out (660 KiB/s), 25s Xcp command : xcp resume -s3.noverify -id XCP_copy_2023-06-13_11.32.47.743708 Stats : 15,008 scanned*, 15,006 copied*, 15,009 indexed*, 14.6 MiB s3.data.uploaded, 14,996 s3.copied.single.key.file, 14,996 s3.copied.file Speed : 19.2 MiB in (736 KiB/s), 17.1 MiB out (657 KiB/s) Total Time : 26s. Migration ID: XCP_copy_2023-06-13_11.32.47.743708 Job ID : Job_XCP_copy_2023-06-13_11.32.47.743708_2023-06-13_11.33.41.388541_resume Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-13_11.32.47.743708_2023-06- 13_11.33.41.388541_resume.log STATUS : PASSED