HANA database recovery
The following shows the steps for HANA database recovery
Start the required SAP services.
vm-pr1:~ # systemctl start sapinit
The following output shows the required processes.
vm-pr1:/ # ps -ef | grep sap root 23101 1 0 11:29 ? 00:00:00 /usr/sap/hostctrl/exe/saphostexec pf=/usr/sap/hostctrl/exe/host_profile pr1adm 23191 1 3 11:29 ? 00:00:00 /usr/sap/PR1/HDB01/exe/sapstartsrv pf=/usr/sap/PR1/SYS/profile/PR1_HDB01_vm-pr1 -D -u pr1adm sapadm 23202 1 5 11:29 ? 00:00:00 /usr/sap/hostctrl/exe/sapstartsrv pf=/usr/sap/hostctrl/exe/host_profile -D root 23292 1 0 11:29 ? 00:00:00 /usr/sap/hostctrl/exe/saposcol -l -w60 pf=/usr/sap/hostctrl/exe/host_profile root 23359 2597 0 11:29 pts/1 00:00:00 grep --color=auto sap
The following subsections describe the recovery process with and without forward recovery using the replicated log backups. The recovery is executed using the HANA recovery script for the system database and hdbsql commands for the tenant database.
Recovery to latest HANA data volume backup savepoint
The recovery to the latest backup savepoint is executed with the following commands as user pr1adm:
-
System database
recoverSys.py --command "RECOVER DATA USING SNAPSHOT CLEAR LOG”
-
Tenant database
Within hdbsql: RECOVER DATA FOR PR1 USING SNAPSHOT CLEAR LOG
You can also use HANA Studio or Cockpit to execute the recovery of the system and the tenant database.
The following command output show the recovery execution.
System database recovery
pr1adm@vm-pr1:/usr/sap/PR1/HDB01> HDBSettings.sh recoverSys.py --command="RECOVER DATA USING SNAPSHOT CLEAR LOG" [139702869464896, 0.008] >> starting recoverSys (at Fri Feb 19 14:32:16 2021) [139702869464896, 0.008] args: () [139702869464896, 0.009] keys: {'command': 'RECOVER DATA USING SNAPSHOT CLEAR LOG'} using logfile /usr/sap/PR1/HDB01/vm-pr1/trace/backup.log recoverSys started: ============2021-02-19 14:32:16 ============ testing master: vm-pr1 vm-pr1 is master shutdown database, timeout is 120 stop system stop system on: vm-pr1 stopping system: 2021-02-19 14:32:16 stopped system: 2021-02-19 14:32:16 creating file recoverInstance.sql restart database restart master nameserver: 2021-02-19 14:32:21 start system: vm-pr1 sapcontrol parameter: ['-function', 'Start'] sapcontrol returned successfully: 2021-02-19T14:32:56+00:00 P0027646 177bab4d610 INFO RECOVERY RECOVER DATA finished successfully recoverSys finished successfully: 2021-02-19 14:32:58 [139702869464896, 42.017] 0 [139702869464896, 42.017] << ending recoverSys, rc = 0 (RC_TEST_OK), after 42.009 secs pr1adm@vm-pr1:/usr/sap/PR1/HDB01>
Tenant database recovery
If a user store key has not been created for the pr1adm user at the source system, a key must be created at the target system. The database user configured in the key must have privileges to execute tenant recovery operations.
pr1adm@vm-pr1:/usr/sap/PR1/HDB01> hdbuserstore set PR1KEY vm-pr1:30113 <backup-user> <password>
The tenant recovery is now executed with hdbsql.
pr1adm@vm-pr1:/usr/sap/PR1/HDB01> hdbsql -U PR1KEY Welcome to the SAP HANA Database interactive terminal. Type: \h for help with commands \q to quit hdbsql SYSTEMDB=> RECOVER DATA FOR PR1 USING SNAPSHOT CLEAR LOG 0 rows affected (overall time 66.973089 sec; server time 66.970736 sec) hdbsql SYSTEMDB=>
The HANA database is now up and running, and the disaster recovery workflow for the HANA database has been tested.
Recovery with forward recovery using log/catalog backups
Log backups and the HANA backup catalog are being replicated from the source system.
The recovery using all available log backups is executed with the following commands as user pr1adm:
-
System database
recoverSys.py --command "RECOVER DATABASE UNTIL TIMESTAMP '2021-02-20 00:00:00' CLEAR LOG USING SNAPSHOT"
-
Tenant database
Within hdbsql: RECOVER DATABASE FOR PR1 UNTIL TIMESTAMP '2021-02-20 00:00:00' CLEAR LOG USING SNAPSHOT
To recover using all available logs, you can just use any time in the future as the timestamp in the recovery statement. |
You can also use HANA Studio or Cockpit to execute the recovery of the system and the tenant database.
The following command output show the recovery execution.
System database recovery
pr1adm@vm-pr1:/usr/sap/PR1/HDB01> HDBSettings.sh recoverSys.py --command "RECOVER DATABASE UNTIL TIMESTAMP '2021-02-20 00:00:00' CLEAR LOG USING SNAPSHOT" [140404915394368, 0.008] >> starting recoverSys (at Fri Feb 19 16:06:40 2021) [140404915394368, 0.008] args: () [140404915394368, 0.008] keys: {'command': "RECOVER DATABASE UNTIL TIMESTAMP '2021-02-20 00:00:00' CLEAR LOG USING SNAPSHOT"} using logfile /usr/sap/PR1/HDB01/vm-pr1/trace/backup.log recoverSys started: ============2021-02-19 16:06:40 ============ testing master: vm-pr1 vm-pr1 is master shutdown database, timeout is 120 stop system stop system on: vm-pr1 stopping system: 2021-02-19 16:06:40 stopped system: 2021-02-19 16:06:41 creating file recoverInstance.sql restart database restart master nameserver: 2021-02-19 16:06:46 start system: vm-pr1 sapcontrol parameter: ['-function', 'Start'] sapcontrol returned successfully: 2021-02-19T16:07:19+00:00 P0009897 177bb0b4416 INFO RECOVERY RECOVER DATA finished successfully, reached timestamp 2021-02-19T15:17:33+00:00, reached log position 38272960 recoverSys finished successfully: 2021-02-19 16:07:20 [140404915394368, 39.757] 0 [140404915394368, 39.758] << ending recoverSys, rc = 0 (RC_TEST_OK), after 39.749 secs
Tenant database recovery
pr1adm@vm-pr1:/usr/sap/PR1/HDB01> hdbsql -U PR1KEY Welcome to the SAP HANA Database interactive terminal. Type: \h for help with commands \q to quit hdbsql SYSTEMDB=> RECOVER DATABASE FOR PR1 UNTIL TIMESTAMP '2021-02-20 00:00:00' CLEAR LOG USING SNAPSHOT 0 rows affected (overall time 63.791121 sec; server time 63.788754 sec) hdbsql SYSTEMDB=>
The HANA database is now up and running, and the disaster recovery workflow for the HANA database has been tested.
Check consistency of latest log backups
Because log backup volume replication is performed independently of the log backup process executed by the SAP HANA database, there might be open, inconsistent log backup files at the disaster recovery site. Only the latest log backup files might be inconsistent, and those files should be checked before a forward recovery is performed at the disaster recovery site using the hdbbackupcheck
tool.
If the hdbbackupcheck
tool reports an error for the latest log backups, the latest set of log backups must be removed or deleted.
pr1adm@hana-10: > hdbbackupcheck /hanabackup/PR1/log/SYSTEMDB/log_backup_0_0_0_0.1589289811148 Loaded library 'libhdbcsaccessor' Loaded library 'libhdblivecache' Backup '/mnt/log-backup/SYSTEMDB/log_backup_0_0_0_0.1589289811148' successfully checked.
The check must be executed for the latest log backup files of the system and the tenant database.
If the hdbbackupcheck
tool reports an error for the latest log backups, the latest set of log backups must be removed or deleted.