Date & time of incident:
Monday, July 4, 2011 - 17:00
Post date:
Monday, July 4, 2011 - 17:28
Incident Description:
During planned network intervention in LHCB pit, 2 storage arrays broke down unexpectedly resulting in unrecoverable corruption of whole LHCBONR (LHCB online) database.
Workaround:
The database has been switched to its standby installation in CC.
Service Element Affected:
DB & Application Platform Service for Projects & Experiments
Specific Service detail:
Unavailable LHCB online services:
lhcbonr_backup
lhcbonr_calodb
lhcbonr_conddb
lhcbonr_conf_con
lhcbonr_conf_rich
lhcbonr_conf_trg
lhcbonr_confdb_muon
lhcbonr_cool
lhcbonr_dss
lhcbonr_hist
lhcbonr_icinga
lhcbonr_integration
lhcbonr_lb
lhcbonr_nolb
lhcbonr_otras
lhcbonr_pvssprod
lhcbonr_recodb
lhcbonr_rundb
lhcbonr_s362_rich
lhcbonr_shiftdb
lhcbonr_sysinfodb
Impact:
Service is unavailable
Status:
Resolved
Resolution date:
Mon, Jul 4, 18:15
Posted by:
IT-DB
Unit responsible for resolution:
IT Department
Updates
The database is up and
The database is up and running on standby hardware since 18.30