Backing up Oracle Databases with the IBM Spectrum Protect TDP
Configuring the DP for Oracle
While the examples below are Unix specific, the principles apply to Linux and Windows installs. The main difference is in the default file locations, which are:
Windows: C:\Program Files\Tivoli\TSM\AgentOBA64
The Spectrum Protect API data is held in /.../tivoli/tsm/client/api/bin64
To make the examples below meaningful, I'm assuming that Oracle was installed with a userid called 'oracle' and the rman control files are located in /u01/app/oracle/admin/tsm_rman. We are backing up a database called PBW on an AIX server called U20614P545 to an AIX Spectrum Protect server called P2XT1, which has an IP address of 220.127.116.11
The Oracle TDP is installed in /usr/tivoli/tsm/client/api/bin64 and Spectrum Protect itself can be found in /usr/tivoli/tsm/client/ba/bin64.
First install the Oracle DP software. The IBM Spectrum Protect Data Protection for Oracle interfaces with Oracle RMAN, the integrated Oracle backup and recovery tool. RMAN understands how the Oracle databases and recovery logs fit together, so we don't need to. Essentially, Spectrum Protect is just used as a back-end data store. The one thing you will need to understand is the RMAN options file, tdpo.opt. The RMAN backup script must point to this file, with a statement like
allocate channel t1 type 'sbt_tape' parms 'ENV=(TDPO_OPTFILE=/home/rman/scripts/tdpo.opt)'
Note the path name must be fully qualified, and the variable name must be in uppercase for Unix or Linux.
If your database server hosts multiple databases, you will need a tdpo.opt file for every database, and each opt file will have a unique name. One standard I've seen is databasename.opt. Bottom line is that tdpo.opt is not a fixed name and the location of these files can be site dependent.
At a minimum the tdpo.opt files should set three DSMI variables as shown below.
It's useful to know where the RMAN logs are kept, as specified by the DSMI_LOG parameter, as you might need to check these out if you get problems.
DSM_DIR tells RMAN where you installed the TDP code, /usr/tivoli/tsm/client/api/bin64 is the default location for Unix.
DSMI_ORC_CONFIG points to the Oracle dsm.opt file
Other parameters that you might see include
Ths is the filespace name used at the Spectrum Protect server for this database. The default is adsmorc. In this case the database is called PBW, so we are calling the filespace PBW
The Spectrum Protect node name that will be used to backup this database
This is the path to the password directory if you are using passwordaccess prompt. Password processing is a little complicated as access is managed by the Spectrum Protect API and not Data Protection for Oracle. Depending on the value of passwordaccess, the API might use the nodename in the tdpo.opt file or in dsm.sys. IBM recommendations are:
If you have passwordaccess prompt in the dsm.sys file, you can have the tdpo_node option in the tdpo.opt file.
If you have passwordaccess generate in the dsm.sys file, do not put the tdpo_node option in the tdpo.opt file.
The userid that 'owns' the TDPO process
The location of the tdpo error log. The user who is running backups must have writable rights to this directory.
These options are used if RMAN is using duplex copy, and it can ask for up to 3 extra copies
Unix and Linux systems need both a dsm.sys and a 'dsm'.opt file for Spectrum Protect. The dsm bit is in quotes because there will be more than one opt file, each with a unique name. You will need a standard dsm.opt file for the local client, and another .opt file for oracle.
Some sites like to keep all their Spectrum Protect option files together, so they keep the ORC_CONFIG file in the default Spectrum Protect installation directory, usually /usr/tivoli/tsm/client/ba/bin64/ and call it something like dsm_ora.opt to distinguish it from the normal dsm.opt file. In this case you either need to change the DSMI_ORC_CONFIG parameter to point to the correct file and path, or you need to add a symbolic link from /usr/tivoli/tsm/client/api/bin64/dsm.opt pointing to /usr/tivoli/tsm/client/ba/bin64/dsm_ora.opt.
Other sites are quite happy to have a 'normal' dsm.opt file in ba/bin64 and an 'oracle' dsm.opt in api/bin64.
All the oracle dsm.opt file needs to contain is
Changes to dsm.sys
You also need to add at least one extra stanza to your dsm.sys file for Oracle database backups. This will typically look like
** Oracle backup stanza
Older Oracle backups needed a separate stanza from scheduling, like this
** Oracle backup scheduling stanza
If you want to use client-side data deduplication, then specify 'DEDUPLICATION YES' in the dsm.sys file, as well as setting up the necessary deduplication requirements at the Server Protect server. However, you cannot use client side deduplication with LAN free, or with client encryption. Large Oracle backups are excellent LAN free candidates.
Setting Passwords, checking licence, checking access rights
After you configure the option files as above, you may need to set the TDP password. To do this, you run the tdpoconf command
tdpoconf password -tdpo-optfile=/u01/app/oracle/admin/tsm_rman/PBW_tdpo.opt
You will then need to input the password for the Spectrum Protect Oracle node. If you need to create the oracle password directory you should assign ownership to the 'oracle' userid (or whatever userid you use to manage oracle) as follows. This links to the RMAN option, TDPO_PSWDPATH /u01/app/oracle/admin/tsm_rman/password
Navigate to the tsm_rman directory, then run
chmod 770 password
Make sure that you have a licence file, /usr/tivoli/tsm/client/oracle/bin64/agent.lic
Then check that 'oracle' can update the Spectrum Protect logs (666) and can read all the Spectrum Protect option files (644)
Spectrum Protect server definitions
All database backups have unique names, and backup retention is controlled by RMAN, so you must set backupdelete=yes. Your oracle management class should be set to keep just one active backup forever, with retonly and verdelete parameters both set to 0.
Define the client on your Spectrum Protect server as U20614P545_ORA, the only difference from your standard UNIX clients would be that you set backupdelete=yes and may invoke the oracle management class with a special client optionset that picks up a database management class. Oracle clients also usually have maxnummountpoints set to 2.
Start up the oracle client with dsmc -server=P2XT1_ORA and set the client password when prompted.
Finally, check the RMAN setup is working with the showenv option on the tdpoconf command;
tdpoconf SHOWENV -TDPO_OPT=/u01/app/oracle/admin/tsm_rman/PBW
We often get requests for special oracle database backup retentions, but these are also controlled by RMAN. Special backups can be retain for longer than the default cycle using the RMAN command, 'CHANGE BACKUPSET TAG ... KEEP UNTIL ...', usually controlled and issued by your DBA.
Utilities and Issues
It is possible for the RMAN catalog to get out of sync with the Spectrum Protect database, so Spectrum Protect is retaining backups that RMAN knows nothing about. Over time, this can result in a considerable amount of unwanted data at Spectrum Protect. The tdposync utility can compare the RMAN catalog with TSM, and give you the option to delete any discrepancies. You need to use the command with care, as deleted files and inactive files cannot be restored.
The process works like this:
Tdposync will ask you for the RMAN catalog owner ID or the Oracle database user name, password, and connect string.
Then it goes out and gathers information from Oracle.
Now it queries the Oracle backup catalog and the Spectrum Protect server.
Then it lists out files that exist on the Spectrum Protect server but not in the RMAN catalog or Oracle control file, and prompts you to take one of the following actions:
Delete any files found causing the discrepancy.
Delete all files.
Exit the program without deleting files from the Spectrum Protect server.
Oracle backups can fail with timeout errors, but one issue is that the error message does not make it clear that this is the problem, A typical error message might look like:
Oracle: RMAN output
- - - - - - - - - -
ORA-27192: skgfcls: sbtclose2 returned error - failed to close file
ORA-19511: Error received from media manager layer, error text:
ANS1235E (RC-71) An unknown system error has occurred ...
When an oracle backup starts, it often sits for quite a while waiting, while RMAN is calculating what it needs to back up. This wait time can be several minutes for a multi-terabyte database. I've seen an IBM recommendation that to calculate the best timeout values to use, you estimate how long your backup will run, then add an extra 50%. So if you expect a database backup to run for about 2 hours, plan timeout values at 3 hours, or 180 minutes, or 10800 seconds.
If you are running TSM 6.3 or above you can set these values dynamically from your Spectrum Protect server by running the following commands. Note that commtimeout is set in seconds, but idletimeout and resourcetimeout are in minutes.
setopt commtimeout 10800
setopt idletimeout 180
setopt resourcetimeout 180
For earlier versions of Spectrum Protect you need to set the values in the server .opt file, then recycle the server.
If you use separate library manager, then you need to set the timeout values on both the library manager server and the client manager server. If you are using LanFree, you have to to set the timeout values on the StorageAgent. All the Spectrum Protect servers that are involved in the backup must be set with the same, or greater values.
back to top