CERN Accelerating science

Firmware upgrade of some components at safe host controllers.

 
Post date: 
Thursday, April 19, 2012 - 10:30
Description: 

Following advice from the Netapp support people and following-up last week intervention, three NAS storage controllers will be upgraded, BIOS and battery firmware.

The upgrade should be transparent, but due to its nature database/application server services are at risk. In worst scenario, users will lose connectivity with their services.

We will keep you inform on intervention progress.

Specific Service Detail: 
A number of services at AIS (aisdbp,edhp,ertp,ertt,wcerp,...) and DBoD (including drupal).
Effective from date: 
Tuesday, April 24, 2012 - 17:00
End date: 
Tuesday, April 24, 2012 - 18:30
Service Element Affected: 
DB & App Platform for AIS
Impact on service: 
Intervention should be transparent
Posted by: 
IT-DB
Unit responsible for resolution: 
IT Department
Termination time: 
Tuesday, April 24, 2012 - 18:30
Termination comments: 
Upgrade of one controller was transparent, second node was done three weeks ago, and upgrade was also transparent. Same procedure was applied to second cluster, but upgrade on second cluster dbnasg403/dbnasg404 resulted on one controller freezing which has affected services running on it (drupal, nova, aisrac, hammercloud-atlas). Despite that we tried to minimize the freezing time some database services got affected. The downtime was less than 15 minutes. A postmortem and further analysis with Netapp is on-going.