Date: Thu, 27 Aug 2009 00:55:09 -0400 (EDT)
From:
Subject: Hill Center Machine Room Update


Hill Center Update:

As of 8:20pm on August 26, 2009, power to the Hill Center complex has been
restored.  Shortly there after, normal environmental conditions (temperature
and humidity) were also achieved.

Summary of Events:

Hill Center experienced a significant electrical issue the morning of
Wednesday, 8/26/09.

As a result of the electrical problem, HVAC (Hill Center machine room
cooling) was lost, which required the shut-down of services.  Not all
services were immediately affected.  However, during the initial attempt to
resolve this issue, additional electrical problems were detected. These
problems presented a safety issue and required major repair of the
electrical infrastructure supporting the Hill Center complex.  This work
required terminating electrical service to the entire facility for several
hours.

Work to restore power initially began at 10:40 A.M. on Wednesday, 8/26/09.
Work to rebuild key components of the electrical infrastructure to the
complex began at 12:00 P.M. on Wednesday, 8/26/09 and was completed at
7:30PM on August 26, 2009.

After ensuring the overall environment was stabilized around 08:20pm we
began services restoration procedures.

The following OIT services have been successfully restored:

EDEN
LDAP
Storage (with the exception of LDS)
RAMS
RATS/RUST
Mailman
Rutgers IM
CMS
Monitoring services
OSS
RCI hosted websites
RCI email services
Sakai
RULink
RUMail (was intermittent till noon 8/27/2009)