resume
Contributors
Suggest changes
PDFs
The XCP NFS resume command restarts an interrupted copy operation by specifying the catalog index name or number. The catalog index name or number of the previous copy operation is located in the <catalog path>:/catalog/indexes directory.
Syntax
xcp resume -id <catalog_name>
|
The -id <catalog_name> parameter is required with the resume command.
|
Show example
[root@localhost linux]# ./xcp resume -id ID001
xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of
destination NFS server>:/dest_vol}
xcp: resume 'ID001': Reviewing the incomplete index...
xcp: diff 'ID001': Found 652 completed directories and 31 in progress
4,658 reviewed, 362 KiB in (258 KiB/s), 7.66 KiB out (5.46 KiB/s), 1s.
xcp: resume 'ID001': Starting second pass for the in-progress directories...
xcp: resume 'ID001': Resuming the in-progress directories...
xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'}
xcp: resume 'ID001': Current options: {-id: 'ID001'}
xcp: resume 'ID001': Merged options: {-id: 'ID001', -newid: u'ID001'}
xcp: resume 'ID001': Values marked with a * include operations before resume
28,866
MiB/s),
scanned*,
5s 9,565 copied*, 4,658 indexed*, 108 MiB in (21.6 MiB/s), 100.0 MiB out(20.0
44,761
MiB/s),
44,761
scanned*,
11s
scanned*,
16,440
20,795
copied*,
copied*,
4,658 indexed*, 206 MiB in (19.3 MiB/s), 191 MiB out (17.9
4,658 indexed*, 362 MiB in (31.3 MiB/s), 345 MiB out (30.8
MiB/s),
44,761
16s
scanned*, 25,985 copied*, 4,658 indexed*, 488 MiB in (25.2 MiB/s), 465 MiB out (24.0
MiB/s),
44,761
21s
scanned*, 31,044 copied*, 4,658 indexed*, 578 MiB in (17.9 MiB/s), 558 MiB out (18.6
MiB/s),
54,838
26s
scanned*, 36,980 copied*, 14,276 indexed*, 679 MiB in (20.2 MiB/s), 657 MiB out (19.8
MiB/s),
67,123
31s
scanned*, 42,485 copied*, 29,160 indexed*, 742 MiB in (12.5 MiB/s), 720 MiB out (12.4
MiB/s),
79,681
36s
scanned*, 49,863 copied*, 39,227 indexed*, 801 MiB in (11.8 MiB/s), 779 MiB out (11.7
MiB/s),
79,681
41s
scanned*, 56,273 copied*, 39,227 indexed*, 854 MiB in (10.6 MiB/s), 832 MiB out (10.6
MiB/s),
79,681
46s
scanned*, 62,593 copied*, 39,227 indexed*, 906 MiB in (10.2 MiB/s), 881 MiB out (9.70
MiB/s),
84,577
51s
scanned*, 68,000 copied*, 44,047 indexed*, 976 MiB in (14.0 MiB/s), 951 MiB out (14.1
MiB/s),
86,737
56s
scanned*, 72,738 copied*, 49,071 indexed*, 1.04 GiB in (17.8 MiB/s), 1.01 GiB out (17.5
MiB/s),
89,690
1m1s
scanned*, 77,440 copied*, 54,110 indexed*, 1.14 GiB in (20.5 MiB/s), 1.11 GiB out (20.1
MiB/s), 1m6s
110,311 scanned*, 84,497 copied*, 74,158 indexed*, 1.24 GiB in (20.3 MiB/s), 1.21 GiB out (20.4
MiB/s), 1m11s
114,726 scanned*, 91,285 copied*, 74,158 indexed*, 1.33 GiB in (17.9 MiB/s), 1.30 GiB out (17.6
MiB/s), 1m16s
114,726 scanned*, 97,016 copied*, 74,158 indexed*, 1.46 GiB in (26.6 MiB/s), 1.43 GiB out (26.6
MiB/s), 1m21s
118,743 scanned*, 100,577 copied*, 79,331 indexed*, 1.65 GiB in (40.1 MiB/s), 1.62 GiB out (39.3
MiB/s), 1m26s
122,180 scanned*, 106,572 copied*, 84,217 indexed*, 1.77 GiB in (24.7 MiB/s), 1.74 GiB out (25.0
MiB/s), 1m31s
124,724 scanned*, 111,727 copied*, 84,217 indexed*, 1.89 GiB in (22.8 MiB/s), 1.86 GiB out (22.5
MiB/s), 1m36s
128,268 scanned*, 114,686 copied*, 99,203 indexed*, 1.99 GiB in (21.1 MiB/s), 1.96 GiB out (21.2
MiB/s), 1m41s
134,630 scanned*, 118,217 copied*, 104,317 indexed*, 2.06 GiB in (13.8 MiB/s), 2.03 GiB out
(13.7 MiB/s), 1m46s
134,630 scanned*, 121,742 copied*, 109,417 indexed*, 2.10 GiB in (9.02 MiB/s), 2.07 GiB out
(9.30 MiB/s), 1m51s
134,630 scanned*, 126,057 copied*, 109,417 indexed*, 2.20 GiB in (21.0 MiB/s), 2.17 GiB out
(21.0 MiB/s), 1m56s
134,630 scanned*, 130,034 copied*, 114,312 indexed*, 2.36 GiB in (32.1 MiB/s), 2.33 GiBout
(31.8 MiB/s), 2m1s
Xcp command : xcp resume -id ID001
134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error
Speed : 2.40 GiB in (19.7 MiB/s), 2.37 GiB out (19.5 MiB/s)
Total Time : 2m4s.
STATUS : PASSED
The following table lists the resume parameters and their description.
| Parameter | Description |
|---|---|
Specifies the catalog name of a previous copy index. This is a required parameter for the resume command. |
|
Specifies the read/write block size (default: 64k). |
|
Specifies the request size when reading directories. |
|
Specifies the maximum number of concurrent batch processes (default: 7). |
|
Restores all files to the last accessed date on the source. |
|
Provides the option to use HTTP instead of HTTPS for S3 bucket communication. |
|
Overrides the default Amazon Web Services (AWS) endpoint URL with the specified URL for S3 bucket communication. |
|
Specifies a profile from the AWS credential file for S3 bucket communication. |
|
Overrides the default verification of SSL certification for S3 bucket communication. |
resume -bs <n[k]>
Use the -bs <n[k]> parameter with the resume command to specify the read/write block size. The default block size is 64k.
Syntax
xcp resume -id <catalog_name> -bs <n[k]>Show example
[root@localhost linux]# ./xcp resume -id ID001 -bs 32k
xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of
destination NFS server>:/dest_vol}
xcp: resume 'ID001': Reviewing the incomplete index...
xcp: diff 'ID001': Found 2,360 completed directories and 152 in progress
19,440 reviewed, 1.28 MiB in (898 KiB/s), 9.77 KiB out (6.71 KiB/s), 1s.
xcp: resume 'ID001': Starting second pass for the in-progress directories...
xcp: resume 'ID001': Resuming the in-progress directories...
xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'}
xcp: resume 'ID001': Current options: {-bs: '32k', -id: 'ID001'}
xcp: resume 'ID001': Merged options: {-bs: '32k', -id: 'ID001', -newid: u'ID001'}
xcp: resume 'ID001': Values marked with a * include operations before resume
44,242
MiB/s),
scanned*,
5s 24,132 copied*, 19,440 indexed*, 36.7 MiB in (7.34 MiB/s), 30.6 MiB out (6.12
59,558
MiB/s),
59,558
scanned*,
10s
scanned*,
30,698
35,234
copied*,
copied*,
19,440
19,440
indexed*,
indexed*,
142
203
MiB
MiB
in
in
(20.9 MiB/s), 125
(12.1 MiB/s), 187
MiB
MiB
out
out
(18.8
(12.2
MiB/s),
59,558
15s
scanned*, 40,813 copied*, 19,440 indexed*, 286 MiB in (16.5 MiB/s), 269 MiB out (16.5
MiB/s),
65,126
20s
scanned*, 46,317 copied*, 24,106 indexed*, 401 MiB in (22.9 MiB/s), 382 MiB out (22.5
MiB/s),
69,214
25s
scanned*, 53,034 copied*, 29,031 indexed*, 496 MiB in (19.0 MiB/s), 476 MiB out (18.7
MiB/s),
85,438
30s
scanned*, 60,627 copied*, 53,819 indexed*, 591 MiB in (18.9 MiB/s), 569 MiB out (18.5
MiB/s),
94,647
35s
scanned*, 66,948 copied*, 53,819 indexed*, 700 MiB in (21.6 MiB/s), 679 MiB out (21.9
MiB/s),
94,647
40s
scanned*, 73,632 copied*, 53,819 indexed*, 783 MiB in (16.5 MiB/s), 761 MiB out (16.4
MiB/s),
99,683
45s
scanned*, 80,541 copied*, 58,962 indexed*, 849 MiB in (13.0 MiB/s), 824 MiB out (12.4
MiB/s), 50s
99,683
MiB/s),
scanned*,
55s
84,911 copied*, 58,962 indexed*, 1013 MiB in (32.8 MiB/s), 991 MiB out (33.2
101,667 scanned*, 91,386 copied*, 73,849 indexed*, 1.06 GiB in (15.4 MiB/s), 1.04 GiB out (15.4
MiB/s), 1m0s
118,251 scanned*, 98,413 copied*, 89,168 indexed*, 1.13 GiB in (14.0 MiB/s), 1.11 GiB out (13.3
MiB/s), 1m5s
124,672 scanned*, 104,134 copied*, 89,168 indexed*, 1.25 GiB in (23.9 MiB/s), 1.22 GiB out (23.2
MiB/s), 1m10s
130,171 scanned*, 109,594 copied*, 94,016 indexed*, 1.38 GiB in (25.7 MiB/s), 1.35 GiB out (25.5
MiB/s), 1m15s
134,574 scanned*, 113,798 copied*, 94,016 indexed*, 1.52 GiB in (28.6 MiB/s), 1.48 GiB out (28.2
MiB/s), 1m20s
134,574 scanned*, 118,078 copied*, 94,016 indexed*, 1.64 GiB in (24.6 MiB/s), 1.61 GiB out (25.1
MiB/s), 1m25s
134,574 scanned*, 121,502 copied*, 94,016 indexed*, 1.80 GiB in (34.0 MiB/s), 1.77 GiB out (33.0
MiB/s), 1m30s
134,630 scanned*, 126,147 copied*, 104,150 indexed*, 1.88 GiB in (16.2 MiB/s), 1.86 GiB out
(17.5 MiB/s), 1m35s
134,630 scanned*, 131,830 copied*, 119,455 indexed*, 1.95 GiB in (13.6 MiB/s), 1.92 GiB out
(13.5 MiB/s), 1m41s
Xcp command : xcp resume -id ID001 -bs 32k
134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error
Speed : 2.02 GiB in (19.9 MiB/s), 1.99 GiB out (19.7 MiB/s)
Total Time : 1m43s.
STATUS : PASSED
resume -dircount <n[k]>
Use the -dircount <n[k]> parameter with the resume command to specify the request size when reading directories. The default value is 64k.
Syntax
xcp resume -id <catalog_name> -dircount <n[k]>Show example
root@localhost linux]# ./xcp resume -id ID001 -dircount 32k
xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of
destination NFS server>:/dest_vol}
xcp: resume 'ID001': Reviewing the incomplete index...
xcp: diff 'ID001': Found 4,582 completed directories and 238 in progress
39,520 reviewed, 2.47 MiB in (1.49 MiB/s), 12.6 KiB out (7.62 KiB/s), 1s.
xcp: resume 'ID001': Starting second pass for the in-progress directories...
xcp: resume 'ID001': Resuming the in-progress directories...
xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'}
xcp: resume 'ID001': Current options: {-dircount: '32k', -id: 'ID001'}
xcp: resume 'ID001': Merged options: {-dircount: '32k', -id: 'ID001', -newid: u'ID001'}
xcp: resume 'ID001': Values marked with a * include operations before resume
76,626 scanned*, 43,825 copied*, 39,520 indexed*, 31.7 MiB in (6.33 MiB/s), 23.0 MiB out (4.60
MiB/s), 5s
79,751 scanned*, 49,942 copied*, 39,520 indexed*, 140 MiB in (21.7 MiB/s), 131 MiB out (21.5
MiB/s), 10s
79,751 scanned*, 55,901 copied*, 39,520 indexed*, 234 MiB in (18.8 MiB/s), 223 MiB out (18.3
MiB/s), 15s
79,751 scanned*, 61,764 copied*, 39,520 indexed*, 325 MiB in (18.0 MiB/s), 313 MiB out (17.9
MiB/s), 20s
84,791 scanned*, 68,129 copied*, 44,510 indexed*, 397 MiB in (14.3 MiB/s), 384 MiB out (14.2
MiB/s), 25s
94,698 scanned*, 74,741 copied*, 54,039 indexed*, 485 MiB in (17.4 MiB/s), 473 MiB out (17.8
MiB/s), 30s
99,734 scanned*, 80,110 copied*, 59,044 indexed*, 605 MiB in (24.1 MiB/s), 591 MiB out (23.7
MiB/s), 35s
104,773 scanned*, 86,288 copied*, 69,005 indexed*, 716 MiB in (22.2 MiB/s), 703 MiB out (22.3
MiB/s), 40s
110,076 scanned*, 93,265 copied*, 79,102 indexed*, 795 MiB in (15.8 MiB/s), 781 MiB out (15.5
MiB/s), 45s
121,341 scanned*, 100,077 copied*, 84,096 indexed*, 897 MiB in (20.4 MiB/s), 881 MiB out (19.9
MiB/s), 50s
125,032 scanned*, 105,712 copied*, 89,132 indexed*, 1003 MiB in (21.2 MiB/s), 985 MiB out (20.7
MiB/s), 55s
129,548 scanned*, 110,382 copied*, 89,132 indexed*, 1.14 GiB in (32.0 MiB/s), 1.12 GiB out (32.1
MiB/s), 1m0s
131,976 scanned*, 115,158 copied*, 94,221 indexed*, 1.23 GiB in (19.2 MiB/s), 1.21 GiB out (18.3
MiB/s), 1m5s
134,430 scanned*, 119,161 copied*, 94,221 indexed*, 1.37 GiB in (27.8 MiB/s), 1.35 GiB out (28.3
MiB/s), 1m10s
134,630 scanned*, 125,013 copied*, 109,402 indexed*, 1.47 GiB in (21.2 MiB/s), 1.45 GiB out
(21.4 MiB/s), 1m15s
134,630 scanned*, 129,301 copied*, 114,532 indexed*, 1.61 GiB in (29.4 MiB/s), 1.60 GiB out
(29.8 MiB/s), 1m20s
134,630 scanned*, 132,546 copied*, 124,445 indexed*, 1.69 GiB in (14.8 MiB/s), 1.67 GiBout
(15.0 MiB/s), 1m25s
Xcp command : xcp resume -id ID001 -dircount 32k
134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error
Speed : 1.70 GiB in (19.7 MiB/s), 1.69 GiB out (19.5 MiB/s)
Total Time : 1m28s.
STATUS : PASSED
resume -parallel <n>
Use the - parallel <n> parameter with the resume command to specify the maximum number of concurrent batch processes. The default value is 7.
Syntax
xcp resume -id <catalog_name> -parallel <n>Show example
[root@localhost linux]# ./xcp resume -id ID001 -parallel 3
xcp: Index: {source: <IP address or hostname of NFS server>:/source_vol, target: <IP address of
destination NFS server>:/dest_vol}
xcp: resume 'ID001': Reviewing the incomplete index...
xcp: diff 'ID001': Found 2,347 completed directories and 149 in progress
19,399 reviewed, 1.28 MiB in (659 KiB/s), 9.77 KiB out (4.93 KiB/s), 1s.
xcp: resume 'ID001': Starting second pass for the in-progress directories...
xcp: resume 'ID001': Resuming the in-progress directories...
xcp: resume 'ID001': Resumed command: copy {-newid: u'ID001'}
xcp: resume 'ID001': Current options: {-id: 'ID001', -parallel: 3}
xcp: resume 'ID001': Merged options: {-id: 'ID001', -newid: u'ID001', -parallel: 3}
xcp: resume 'ID001': Values marked with a * include operations before resume
39,610 scanned*, 23,642 copied*, 19,399 indexed*, 56.3 MiB in (11.2 MiB/s), 45.8 MiB out (9.15
MiB/s), 5s
39,610 scanned*, 28,980 copied*, 19,399 indexed*, 145 MiB in (17.6 MiB/s), 134 MiB out (17.6
MiB/s), 10s
48,111 scanned*, 34,782 copied*, 34,042 indexed*, 223 MiB in (15.8 MiB/s), 212 MiB out (15.7
MiB/s), 15s
55,412 scanned*, 40,468 copied*, 34,042 indexed*, 317 MiB in (18.4 MiB/s), 304 MiB out (18.1
MiB/s), 21s
59,639 scanned*, 46,980 copied*, 39,032 indexed*, 390 MiB in (14.6 MiB/s), 377 MiB out (14.5
MiB/s), 26s
69,520 scanned*, 55,251 copied*, 49,006 indexed*, 438 MiB in (9.59 MiB/s), 423 MiB out (9.21
MiB/s), 31s
78,596 scanned*, 62,054 copied*, 59,001 indexed*, 492 MiB in (10.7 MiB/s), 476 MiB out (10.6
MiB/s), 36s
79,673 scanned*, 68,163 copied*, 59,001 indexed*, 610 MiB in (23.5 MiB/s), 593 MiB out (23.5
MiB/s), 41s
84,600 scanned*, 74,238 copied*, 64,150 indexed*, 723 MiB in (22.5 MiB/s), 705 MiB out (22.3
MiB/s), 46s
94,525 scanned*, 80,754 copied*, 74,157 indexed*, 807 MiB in (16.7 MiB/s), 788 MiB out (16.4
MiB/s), 51s
94,525 scanned*, 85,119 copied*, 74,157 indexed*, 1007 MiB in (39.9 MiB/s), 988 MiB out (39.9
MiB/s), 56s
09,514 scanned*, 93,474 copied*, 89,192 indexed*, 1.08 GiB in (20.7 MiB/s), 1.06 GiB out (20.2
MiB/s), 1m1s
111,953 scanned*, 100,639 copied*, 94,248 indexed*, 1.18 GiB in (19.3 MiB/s), 1.16 GiB out (19.2
MiB/s), 1m6s
114,605 scanned*, 105,958 copied*, 94,248 indexed*, 1.36 GiB in (36.8 MiB/s), 1.34 GiB out (36.6
MiB/s), 1m11s
124,531 scanned*, 112,340 copied*, 104,275 indexed*, 1.51 GiB in (29.8 MiB/s), 1.48 GiB out
(29.4 MiB/s), 1m16s
129,694 scanned*, 117,218 copied*, 109,236 indexed*, 1.67 GiB in (33.2 MiB/s), 1.65 GiB out
(33.1 MiB/s), 1m21s
131,753 scanned*, 123,850 copied*, 114,358 indexed*, 1.80 GiB in (25.9 MiB/s), 1.77 GiB out
(25.9 MiB/s), 1m26s
134,630 scanned*, 130,829 copied*, 124,437 indexed*, 1.85 GiB in (11.2 MiB/s), 1.83 GiBout
(11.2 MiB/s), 1m31s
Xcp command : xcp resume -id ID001 -parallel 3
134,630 scanned*, 134,630 copied*, 0 modification, 0 new item, 0 delete item, 0 error
Speed : 2.02 GiB in (21.6 MiB/s), 2.00 GiB out (21.3 MiB/s)
Total Time : 1m35s.
STATUS : PASSED
resume -preserve-atime
Use the -preserve-atime parameter with the resume command to restore all files to the last accessed date on the source.
The -preserve-atime parameter resets the access time to the original value set before the XCP read operation.
Syntax
xcp resume -id <catalog_name> -preserve-atimeShow example
root@client1 linux]# ./xcp resume -preserve-atime -id XCP_copy_2022-06-30_14.22.53.742272
xcp: Job ID: Job_XCP_copy_2022-06-30_14.22.53.742272_2022-06-30_14.37.07.746208_resume
xcp: Index: {source: 101.10.10.12:/source_vol, target: 10.102.102.70:/dest_vol}
xcp: Tune: Previous operation on id 'XCP_copy_2022-06-30_14.22.53.742272' already completed;
nothing to resume
0 in (0/s), 0 out (0/s), 6s
Xcp command : xcp resume -preserve-atime -id XCP_copy_2022-06-30_14.22.53.742272
Stats :
Speed : 0 in (0/s), 0 out (0/s)
Total Time : 6s.
Migration ID: XCP_copy_2022-06-30_14.22.53.742272
Job ID : Job_XCP_copy_2022-06-30_14.22.53.742272_2022-06-30_14.37.07.746208_resume
Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2022-06-30_14.22.53.742272_2022-06-
30_14.37.07.746208_resume.log
STATUS : PASSED
resume -s3.insecure
Use the -s3.insecure parameter with the resume command to use HTTP instead of HTTPS for S3 bucket communication.
|
If the -s3.insecure parameter is used with the copy command, it is ignored on resume. You must specify -s3.insecure again to use the option on resume.
|
Syntax
xcp resume -s3.insecure -id <catalog_name>Show example
root@client1 linux]# ./xcp resume -s3.insecure -id XCP_copy_2023-06-08_10.31.47.381883
Job ID: Job_XCP_copy_2023-06-08_10.31.47.381883_2023-06-08_10.34.02.964143_resume
Index: {source: 1 hdfs:///user/demo, target: s3://bucket1/}
Reviewing the incomplete index...
Found 0 completed directories and 2 in progress
4,009 reviewed, 88.7 KiB in (76.1 KiB/s), 332 out (285/s), 1s.
4,009 reviewed, 90.9 KiB in (77.6 KiB/s), 2.44 KiB out (2.08 KiB/s), 1s.
Starting second pass for the in-progress directories...
4,009 reviewed, 4,009 re-reviewed, 179 KiB in (130 KiB/s), 2.72 KiB out (1.98 KiB/s), 1s.
9,008 scanned*, 4,540 copied*, 4,009 indexed*, 534 KiB s3.data.uploaded, 534
s3.copied.single.key.file, 534 s3.copied.file, 2.28 MiB in (464 KiB/s), 631 KiB out (126 KiB/s),
5s
9,008 scanned*, 5,551 copied*, 4,009 indexed*, 1.51 MiB s3.data.uploaded, 1,544
s3.copied.single.key.file, 1,544 s3.copied.file, 3.38 MiB in (222 KiB/s), 1.74 MiB out (226
KiB/s), 10s
9,008 scanned*, 6,596 copied*, 4,009 indexed*, 2.53 MiB s3.data.uploaded, 2,595
s3.copied.single.key.file, 2,595 s3.copied.file, 4.55 MiB in (235 KiB/s), 2.91 MiB out (236
KiB/s), 15s
9,008 scanned*, 7,658 copied*, 4,009 indexed*, 3.57 MiB s3.data.uploaded, 3,652
s3.copied.single.key.file, 3,652 s3.copied.file, 5.71 MiB in (234 KiB/s), 4.09 MiB out (238
KiB/s), 20s
9,008 scanned*, 8,711 copied*, 4,009 indexed*, 4.60 MiB s3.data.uploaded, 4,706
s3.copied.single.key.file, 4,706 s3.copied.file, 6.88 MiB in (235 KiB/s), 5.26 MiB out (236
KiB/s), 25s
Xcp command : xcp resume -s3.insecure -id XCP_copy_2023-06-08_10.31.47.381883
Stats : 9,008 scanned*, 9,006 copied*, 9,009 indexed*, 4.88 MiB s3.data.uploaded, 4,996
s3.copied.single.key.file, 4,996 s3.copied.file
Speed : 7.10 MiB in (270 KiB/s), 5.76 MiB out (219 KiB/s)
Total Time : 26s.
Migration ID: XCP_copy_2023-06-08_10.31.47.381883
Job ID : Job_XCP_copy_2023-06-08_10.31.47.381883_2023-06-08_10.34.02.964143_resume
Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-08_10.31.47.381883_2023-06-
08_10.34.02.964143_resume.log
STATUS : PASSED
resume -s3.endpoint <s3_endpoint_url>
Use the -s3.endpoint <s3_endpoint_url> parameter with the resume command to override the default AWS endpoint URL with the specified URL for S3 bucket communication.
|
|
By default, resume uses the S3 profile and S3 endpoint specified during the copy operation. However, if you specify a new S3 endpoint and S3 profile on resume, it overrides the default used with the copy command.
|
Syntax
xcp resume -s3.profile <profile_name> -s3.endpoint https://<endpoint_url>: -id <catalog_name>Show example
[root@client1 linux]# ./xcp resume -id XCP_copy_2023-06-13_11.48.59.454327
Job ID: Job_XCP_copy_2023-06-13_11.48.59.454327_2023-06-13_11.49.34.887164_resume
Index: {source: hdfs:///user/demo, target: s3://xcp-testing/}
Reviewing the incomplete index...
Found 0 completed directories and 2 in progress
9 reviewed, 4.53 KiB in (2.47 KiB/s), 188 out (102/s), 1s.
9 reviewed, 6.81 KiB in (3.70 KiB/s), 2.30 KiB out (1.25 KiB/s), 1s.
Starting second pass for the in-progress directories...
9 reviewed, 9 re-reviewed, 10.9 KiB in (5.65 KiB/s), 2.44 KiB out (1.26 KiB/s), 1s.
15,008 scanned*, 1,532 copied*, 9 indexed*, 1.50 MiB s3.data.uploaded, 1,539
s3.copied.single.key.file, 1,539 s3.copied.file, 4.64 MiB in (946 KiB/s), 1.77 MiB out (360
KiB/s), 6s
15,008 scanned*, 4,764 copied*, 9 indexed*, 4.67 MiB s3.data.uploaded, 4,784
s3.copied.single.key.file, 4,784 s3.copied.file, 8.21 MiB in (727 KiB/s), 5.38 MiB out (736
KiB/s), 11s
15,008 scanned*, 7,928 copied*, 9 indexed*, 7.75 MiB s3.data.uploaded, 7,935
5,008 scanned*, 7,928 copied*, 9 indexed*, 7.75 MiB s3.data.uploaded, 7,935
s3.copied.single.key.file, 7,935 s3.copied.file, 11.7 MiB in (703 KiB/s), 8.89 MiB out (708
KiB/s), 16s
15,008 scanned*, 10,863 copied*, 9 indexed*, 10.6 MiB s3.data.uploaded, 10,864
s3.copied.single.key.file, 10,864 s3.copied.file, 14.9 MiB in (660 KiB/s), 12.2 MiB out (664
KiB/s), 21s
15,008 scanned*, 14,060 copied*, 9 indexed*, 13.7 MiB s3.data.uploaded, 14,076
s3.copied.single.key.file, 14,076 s3.copied.file, 18.5 MiB in (716 KiB/s), 15.7 MiB out (725
KiB/s), 26s
Xcp command : xcp resume -id XCP_copy_2023-06-13_11.48.59.454327
Stats : 15,008 scanned*, 15,006 copied*, 15,009 indexed*, 14.6 MiB s3.data.uploaded,
14,996 s3.copied.single.key.file, 14,996 s3.copied.file
Speed : 19.2 MiB in (708 KiB/s), 17.1 MiB out (631 KiB/s)
Total Time : 27s.
Migration ID: XCP_copy_2023-06-13_11.48.59.454327
Job ID : Job_XCP_copy_2023-06-13_11.48.59.454327_2023-06-13_11.49.34.887164_resume
Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-13_11.48.59.454327_2023-06-
13_11.49.34.887164_resume.log
STATUS : PASSED
resume s3.profile <profile_name>
Use the -s3.profile <profile_name> parameter with the resume command to specify a profile from the AWS credential file for S3 bucket communication.
|
|
By default, resume uses the S3 profile and S3 endpoint specified during the copy operation. However, if you specify a new S3 endpoint and S3 profile on resume, it overrides the default used with the copy command.
|
Syntax
xcp resume -s3.profile <name> -s3.endpoint -id <catalog_name>Show example
[root@client1 linux]# ./xcp resume -s3.profile sg -s3.endpoint https://<endpoint_url>: -id
XCP_copy_2023-06-08_10.40.42.519258
Job ID: Job_XCP_copy_2023-06-08_10.40.42.519258_2023-06-08_10.52.18.453982_resume
Index: {source: hdfs:///user/demo target: s3://xxx-bucket/
Reviewing the incomplete index...
Found 0 completed directories and 2 in progress
9 reviewed, 4.53 KiB in (3.03 KiB/s), 188 out (126/s), 1s.
9 reviewed, 6.81 KiB in (4.52 KiB/s), 2.30 KiB out (1.53 KiB/s), 1s.
Starting second pass for the in-progress directories...
9 reviewed, 9 re-reviewed, 10.9 KiB in (6.76 KiB/s), 2.44 KiB out (1.51 KiB/s), 1s.
15,008 scanned*, 1,660 copied*, 9 indexed*, 1.64 MiB s3.data.uploaded, 1,675
s3.copied.single.key.file, 1,675 s3.copied.file, 4.75 MiB in (971 KiB/s), 1.92 MiB out (392
KiB/s), 5s
15,008 scanned*, 3,453 copied*, 9 indexed*, 3.39 MiB s3.data.uploaded, 3,467
s3.copied.single.key.file, 3,467 s3.copied.file, 6.79 MiB in (412 KiB/s), 3.91 MiB out (403
KiB/s), 10s
15,008 scanned*, 6,296 copied*, 9 indexed*, 6.16 MiB s3.data.uploaded, 6,305
s3.copied.single.key.file, 6,305 s3.copied.file, 9.86 MiB in (619 KiB/s), 7.08 MiB out (637
KiB/s), 15s
15,008 scanned*, 9,527 copied*, 9 indexed*, 9.33 MiB s3.data.uploaded, 9,554
s3.copied.single.key.file, 9,554 s3.copied.file, 13.4 MiB in (717 KiB/s), 10.7 MiB out (726
KiB/s), 20s
15,008 scanned*, 12,656 copied*, 9 indexed*, 12.4 MiB s3.data.uploaded, 12,648
s3.copied.single.key.file, 12,648 s3.copied.file, 16.9 MiB in (715 KiB/s), 14.1 MiB out (706
KiB/s), 25s
Xcp command : xcp resume -s3.profile sg -s3.endpoint https://<endpoint_url>: -id XCP_copy_2023-
06-08_10.40.42.519258
Stats : 15,008 scanned*, 15,006 copied*, 15,009 indexed*, 14.6 MiB s3.data.uploaded,
14,996 s3.copied.single.key.file, 14,996 s3.copied.file
Speed : 19.2 MiB in (661 KiB/s), 17.1 MiB out (590 KiB/s)
Total Time : 29s.
Migration ID: XCP_copy_2023-06-08_10.40.42.519258
Job ID : Job_XCP_copy_2023-06-08_10.40.42.519258_2023-06-08_10.52.18.453982_resume
Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-08_10.40.42.519258_2023-06-
08_10.52.18.453982_resume.log
STATUS : PASSED
resume -s3.noverify
Use the -s3.noverify parameter with the resume command to override the default verification of SSL certification for S3 bucket communication.
Syntax
xcp resume -s3.noverify -id <catalog_name>Show example
[root@client1 linux]# ./xcp resume -s3.noverify -id XCP_copy_2023-06-13_11.32.47.743708
Job ID: Job_XCP_copy_2023-06-13_11.32.47.743708_2023-06-13_11.33.41.388541_resume
Index: {source: hdfs:///user/demo, target: s3://bucket/
Reviewing the incomplete index...
Found 0 completed directories and 2 in progress
9 reviewed, 4.53 KiB in (3.70 KiB/s), 188 out (153/s), 1s.
9 reviewed, 6.81 KiB in (5.52 KiB/s), 2.30 KiB out (1.87 KiB/s), 1s.
Starting second pass for the in-progress directories...
9 reviewed, 9 re-reviewed, 10.9 KiB in (8.19 KiB/s), 2.44 KiB out (1.83 KiB/s), 1s.
15,008 scanned*, 1,643 copied*, 9 indexed*, 1.62 MiB s3.data.uploaded, 1,662
s3.copied.single.key.file, 1,662 s3.copied.file, 4.78 MiB in (969 KiB/s), 1.90 MiB out (385
KiB/s), 5s
15,008 scanned*, 4,897 copied*, 9 indexed*, 4.78 MiB s3.data.uploaded, 4,892
s3.copied.single.key.file, 4,892 s3.copied.file, 8.38 MiB in (735 KiB/s), 5.50 MiB out (737
KiB/s), 10s
15,008 scanned*, 8,034 copied*, 9 indexed*, 7.86 MiB s3.data.uploaded, 8,048
s3.copied.single.key.file, 8,048 s3.copied.file, 11.8 MiB in (696 KiB/s), 9.02 MiB out (708
KiB/s), 15s
15,008 scanned*, 11,243 copied*, 9 indexed*, 11.0 MiB s3.data.uploaded, 11,258
s3.copied.single.key.file, 11,258 s3.copied.file, 15.3 MiB in (709 KiB/s), 12.6 MiB out (724
KiB/s), 20s
15,008 scanned*, 14,185 copied*, 9 indexed*, 13.9 MiB s3.data.uploaded, 14,195
s3.copied.single.key.file, 14,195 s3.copied.file, 18.6 MiB in (662 KiB/s), 15.9 MiB out (660
KiB/s), 25s
Xcp command : xcp resume -s3.noverify -id XCP_copy_2023-06-13_11.32.47.743708
Stats : 15,008 scanned*, 15,006 copied*, 15,009 indexed*, 14.6 MiB s3.data.uploaded,
14,996 s3.copied.single.key.file, 14,996 s3.copied.file
Speed : 19.2 MiB in (736 KiB/s), 17.1 MiB out (657 KiB/s)
Total Time : 26s.
Migration ID: XCP_copy_2023-06-13_11.32.47.743708
Job ID : Job_XCP_copy_2023-06-13_11.32.47.743708_2023-06-13_11.33.41.388541_resume
Log Path : /opt/NetApp/xFiles/xcp/xcplogs/Job_XCP_copy_2023-06-13_11.32.47.743708_2023-06-
13_11.33.41.388541_resume.log
STATUS : PASSED