Penn State shield
Skip to content Skip to search

Headlines

ITS Alert - Resolved: Numerous Services Degraded or Unavailable

/alerts

ITS Alerts by Date


ITS Alerts by Service

ITS Alerts by Location

  • red boxCurrent Alert
  • green boxResolved Alert
  • orange boxFuture Alert

Resolved: Numerous Services Degraded or Unavailable

Last updated on June 10, 2017 at 9:38PM

Update on June 10, 2017 at 9:38PM

Identity Provisioning was restored by 9:17 pm. Other outstanding service issues previously mentioned are relatively minor, so this alert will now be resolved.

Update on June 10, 2017 at 4:17PM

WebAccess was restored to full functionality by 3:22 pm.

ANGEL (https://cms.psu.edu) was back as of 3:32 pm.

A RADIUS server affecting wireless authentication was unavailable until 3:25 pm. Shields Building wifi remains unavailable.

Identity Provisioning is also impacted and remains unavailable.

The restoration work endures but thins.

Update on June 10, 2017 at 3:17PM

WebAccess remains in a degraded (slow, reduced capacity) state.

An Access Account (dce.psu.edu realm) Kerberos server was offline thus some logins may have been slightly slower between 10:40 am and 1 pm.

Between 2:37 and 3:01 pm, the https://www.work.psu.edu/password/ web site was put into maintenance mode so that password changes to the affected Kerberos server could be restored. By 3:01, all password changes were caught up.

University Collaboration Suite (UCS) was restored to most functionality by 12:47 pm. An issue impacting some IMAP users remains.

git.psu.edu, sodium.tns.its.psu.edu, and all of the departmental / college web sites mentioned earlier, except for www.engr.psu.edu, have been restored shortly after 12:15. Additional servers were restored later that hour, and others shortly after 3pm. Staff continue to work on restoring remaining services.

For root cause, see power outage mentioned in alert-4633.

Update on June 10, 2017 at 12:23PM

Other services found to be impacted include: University Collaboration Suite (UCS), git.psu.edu, sodium (DNS, network time), web sites for Libraries, Office of Physical Plant, Office of Human Resources, Bryce Jordan Center, Nittany Lion Inn, College of Arts and Architecture, College of the Liberal Arts, College of Engineering, Penn State Law, College of Education, Smeal College of Business, etc.

WebAccess has reduced its dependency on failed network equipment around 11:18 am as a temporary measure for faster response during the interim.

One of the network problems was corrected around 12:15 pm and many servers recovered.

Staff continue to troubleshoot the remaining problems.

Original Alert

Starting around 10:35 am, Penn State IT staff have learned of a problem causing multiple services to become either slow or unavailable. Services known to be impacted so far include WebAccess, ANGEL, wikispaces, VM hosting and DIMC. Staff are continuing to investigate the problem.

For more information, please contact IT Service Desk (ITServiceDesk@psu.edu).


Back to ITS Alerts

Impact Information