This Knowledgebase article describes best practices for integrating Neverfail Heartbeat V4.6 or later with Symantec Backup Exec for Windows Servers 11d (64-bit) and contains advice specific to topology #4.
Note: Symantec's Continuous Protection Server (CPS) component is NOT supported.
Please ensure you have read the following Knowledgebase article before proceeding:
- Knowledgebase article #1172 - 'Best Practices for Integrating Neverfail Heartbeat V4.6 or Later with Backup Solutions'
Deployment: Topology #4
Neverfail recommends installing and configuring backup software before installing Heartbeat.
Backup Exec can be deployed:
- With a local SQL Server instance
- With a remote SQL Server instance
- With its own SQL Express instance
Neverfail recommends using a remote SQL Server instance for Backup Exec to store its databases. This will reduce the complexity of the deployment and ensure that the environment is robust and easy to configure.
If a local SQL Server instance is used instead, Neverfail recommends that this instance be protected by Neverfail for SQL Server.
If there is not a protected SQL Server instance on the server pair, installing Backup Exec's SQL Express is recommended.
If Backup Exec is configured to use a local database engine (either SQL Server or SQL Express) which is NOT protected by Neverfail for SQL Server, this database engine must be considered as an integral part of the backup software, rather than as a separate entity. All advice below about installation, configuration, and service control applies to the database engine as well as to the backup tool.
Using Backup Exec's own SQL Express instance on a server pair together with another PROTECTED SQL Server instance is not recommended.
Installing backup software on a server pair after installing Neverfail Heartbeat.
ASSUMPTIONS: This procedure assumes that the Primary server is ACTIVE, the Secondary server is PASSIVE and that the backup software will be running on the Primary server, when active only. If the Secondary server is active, please switchover and wait for the Primary server to become active, before proceeding.
- Shutdown Heartbeat, leaving protected applications running.
- Install the backup software on the Primary server. If the installation process requires it, reboot the Primary server.
- Configure the backup software on the Primary server: backup devices, folders, etc.
- You must now set all backup software services to manual and include them in the start/stop scripts on the Primary server. Please see section 'C' below for advice on how to do this.
- Shutdown Heartbeat on the Primary server (leave protected applications running). Reboot both servers. The Primary server should start as active, and the Secondary server as passive.
- On the active or passive server, or on a remote client, open the Neverfail Heartbeat Management Client. On the System -> Status & Control tab, check that the 'Application Status' is 'Started'.
- On the Primary-active server, open the Windows Service Control Manager (SCM) and check that all backup software services are set to manual/started.
Note: If you are using Backup Exec's own SQL Express instance for Backup Exec to store its databases, and Neverfail for SQL Server is installed on the server pair, you must set its services ('SQL Server (BKUPEXEC)' and other services which have been installed by Backup Exec's SQL Express instance) to manual and add them to the SQLServer start/stop scripts on the Primary server (see section 'C' below for advice on how to edit the scripts).
- Installing backup software before installing Heartbeat - the recommended deployment strategy.
Once you have installed and configured the backup software on the production server, please follow these steps:
Set all the backup software services to manual/stopped.
If you are using Backup Exec's own SQL Express instance for Backup Exec to store its databases, and Neverfail for SQL Server will also be installed on the server pair, you must set the SQL Express services ('SQL Server (BKUPEXEC)' and other services which have been installed by Backup Exec's SQL Express) to automatic/started before installing Neverfail Heartbeat.
Neverfail will detect these services and protect/control them (so they will be automatically included in the start/stop scripts of the SQL Server AM).
Since these services will be added to the monitored services set, manually stopping Backup Exec's services will trigger any actions defined within the Configure Monitoring application, ranging from simple service restarts (default), to switchovers. It is recommended that the default actions be left unchanged for Backup Exec's services.
Because these services will be disabled on the Secondary server, when Neverfail Application Module Monitor runs, for each disabled protected service, it will raise an event of the form: "The service 'ProtectedServiceName' cannot be monitored or restarted as it is disabled. This service will not be rechecked until the Neverfail Monitor service is restarted or reconfigured". This has no impact on the server pair and should be ignored.
- Install Heartbeat as per the installation guide. Make sure Heartbeat and replication are started on both servers.
- You must now include backup software services in the start/stop scripts on the Primary active server only. Advice on doing this can be found in section 'C' below.
Disable any backup software services on the Secondary server. Remove all references to backup software services in the start/stop scripts of all protected applications on the Secondary server.
If you have chosen to use Backup Exec's own SQL Express for Backup Exec to store its databases, and Neverfail for SQL Server was installed on the server pair, you must also remove the SQL Express services (the ones set to automatic/started at step 1, above) from the SQL server start/stop scripts on Secondary server. Make sure to remove only the services that were added during Backup Exec's installation.
- On the active or passive server, or on a remote client, open the Neverfail Heartbeat Management Client. Stop replication (you may leave protected applications running) and then start replication.
- On the System -> Status & Control tab, check that the 'Application Status' is 'Started'.
- On the Primary-active server, open the Windows Service Control Manager (SCM) and check that all backup software services are set to manual/started. If you are using Backup Exec's own SQL Express, check that the SQL Express services are set to manual/started.
- On the Secondary-passive server, open the Windows SCM and check that all backup software services are disabled. If you are using Backup Exec's own SQL Express, check that the SQL Express services are disabled.
- Editing the Neverfail Heartbeat start/stop scripts.
This section describes the operation of editing the start/stop scripts. When editing the scripts, double check all changes since they will have a direct impact on the status of backup software and protected applications.
The start (start.bat) and stop (stop.bat) scripts for each application module can be found in the %install_dir%\R2\scripts\%application%\ folder, where %application% is the name of any protected application (e.g. FileServer, SQLServer).
The scripts must be edited to include start or stop commands for all the backup services that you want started or stopped. You must use the short name when referring to a service; commands controlling backup services must be included after all other commands controlling protected services.
The Start script should contain lines of the form:
NfNet Start "BackupService1" /R || set FAILED=1
The Stop script should contain lines of the form:
NfNet Stop "BackupService" /R || set FAILED=1
Deciding which scripts to modify to include backup software and the correct order of the services is based upon the following criteria:
- If there are service dependencies (i.e. backup software services depend upon protected services already included in the start/stop scripts), then each of these services has to be included in the same script (start.bat), after the parent service(s). A dependant service does not have to be added to the stop script (stop.bat) as it will be stopped when the parent service is stopped.
- Backup software services that do not depend on any protected services should be included in the start and stop scripts, after the protected services. It does not matter which start or stop script will include these services (i.e. you can add them to the start/stop scripts for SQL Server AM, or FileServer AM, or Exchange AM, etc.), unless there are logical dependencies (e.g. your backup tool will backup SQL Server data, or it uses SQL Server to store its databases, so it should be started after SQL Server is started), in which case you should take them into account. The order in which they should be listed depends on their own interdependencies: if there are two backup software services A and B, and B depends on A, then B should be included in the start script after A, but should not be included in the stop script.
- As a general recommendation, whenever possible, try to group all the backup software services in the same scripts.
A. Backup jobs:
- Backup jobs should be configured so that they do not overlap with Neverfail Heartbeat tasks (for example, DRM shadow creation, Rollback operations, or Full System Check).
- Please ensure that you exclude the following directory from any backup job:
%install_dir%\ R2\log including subdirectories
- Please avoid scheduling a backup job during a full system check. Competition for file access between Neverfail Heartbeat and backup software will significantly increase the durations of both the backup job and the full system check task. This is especially important in environments with large databases (Exchange or SQL Server) where the time required to backup data is considerable.
B. Restore jobs:
- Any restore should be performed under careful supervision of a system administrator.
Restores must take place on the active server only. Neverfail Heartbeat should be stopped before performing any restore. If prompted, reboot the machine in order to complete the restore. DO NOT start Heartbeat on the passive server yet. You now have the opportunity to examine the restored data (on the active server) without it being replicated:
- If, for any reason, you don't want to keep the restored data, you have the option to shutdown Heartbeat on the active server (if it is running), manually switch the roles of the servers (using the Configure Server Wizard), and then start Heartbeat and replication on both servers. This will bring the data on the server pair back to the state it was before the restore. Once the servers are synchronized, you can switchover to the pre-restore server pair configuration.
- If you want to continue using the restored data, simply start Heartbeat on the active (if required) and passive servers and allow the pair to get in synch.
- When restoring system state, service state, registry data, or any other selection containing the Neverfail installation folder, or folders which are vital to the operating system (for example, the Windows installation directory), a reboot is usually required. Following the reboot, Neverfail may detect an unclean shutdown, set the server role to passive, and not start - there will be two passive servers. Please refer to Knowledgebase article #984 - 'Resolve Two Passive Servers', for advice on how to resolve this situation.
Uninstalling Backup Software
When uninstalling backup software, if Neverfail Heartbeat is still installed on the server pair, you must perform the following steps:
- Shutdown Heartbeat (you may leave protected applications running).
Edit the start/stop scripts on the Primary server and remove any reference to services belonging to the backup software before the uninstall process.
If you have installed backup software on a server already running Heartbeat you only need to uninstall it on that server:
- Uninstall Backup Exec on the active server. Reboot the server if required.
- If a reboot was required, simply start Heartbeat on the passive server. If a reboot was not required, start Heartbeat on both servers.
If Backup Exec was installed before Heartbeat, you must uninstall it on both servers in the pair.
- Set the backup software services to manual /stopped on the Secondary server (if you are using Backup Exec’s SQL Express, you must also set its services to manual/stopped).
- Uninstall Backup Exec on the Primary server and then on the Secondary, rebooting the servers if required.
- If rebooting was not required, simply start Heartbeat on each server.
Both Neverfail Heartbeat task times and backup jobs times will increase significantly when they overlap; also, the overall performance of the server pair will be degraded.
Shadow creation tasks may fail when performed during certain phases of backup jobs, depending on the settings used. Even though this will not cause any significant problems, care should be taken when scheduling tasks on a server pair running Heartbeat.
SQL 2005 backups: When performing backups of SQL Server 2005, any consistency check performed before or after the backup may result in an “Unprotected Feature Detected” warning in the Neverfail Event Log. The unprotected feature refers to the sparse files created when the consistency checks were performed. This has no impact on the server pair and should be ignored.
Neverfail Heartbeat V4.6 or Later