System Status

Additional info on the Universal Catalog outage

This morning at 2:53AM, the Universal Catalog database stopped responding. The new Oracle version has a parameter that limits the amount of data that can be written to Archive Logs to 10GB. We have increased that setting for all databases and will monitor it to see if it should be increaed further. After making that change, the Universal Catalog started working again at 8:53AM this morning.

Resolved: Oracle Issues Affecting I-Share 6/17/2015

This issue has been resolved. If you start seeing problems with holdings displays in I-Share please email support@carli.illinois.edu

Oracle Issues Affecting I-Share 6/17/2015

This morning we are seeing Oracle issues affecting the display of holdings in I-Share. Searching is not affected. We are actively investigating this issue.

All Systems Back Online

A change made at 5PM had unintended consequences that didn't really manifest until about 7PM tonight. There were so many processes backed up waiting to run that we eventually had to take most systems offline to implement a fix.

We still have more tuning that needs to be done, but hopefully those changes will be scheduled on Sunday mornings from now on.

We have also put in place the threshold changes we were planning to make at 11PM, so there will be no need for another outage tonight.

Brandon Gant
CARLI

Oracle Performance Problems

We see some serious performance problems that are affecting Voyager, VuFind, and WebVoyage.

We have started investigating and will attempt to determine the cause and stabilize the system.

Voyager Restart Tonight at 11PM (Tuesday, June 16th)

We have found a threshold in Oracle that needs to be increased for some libraries. Unfortunately, this change requires a restart.

At 11PM tonight (Tuesday, June 16th), we will take Voyager down, make the Oracle changes, and then bring Voyager back online. We estimate about a half-hour of downtime for this process.

Brandon Gant
CARLI

I-Share Voyager Down for Software Upgrade

I-Share Voyager and its VuFind catalog interface are down this weekend (June 12-15) while CARLI staff upgrade its software to Voyager version 9.1.1 .

VuFind Maintenance this Sunday Morning (04/04)

This Sunday, April 4th between 6AM and 10AM, the VuFind service (http://vufind.carli.illinois.edu) will experience multiple outages while we upgrade three Linux servers running the SOLR indexes and MySQL database.

If you encounter any problems after 10AM, please report them to support@carli.illinois.edu.

Brandon Gant
CARLI

VuFind Outage, Saturday, Jan 31

On Saturday, January 31st, at 11:53 AM we received reports of VuFind not responding. CARLI System Services staff investigated the problem and determined that it was due to one of VuFind's services exhausting its memory resources. More memory was added and VuFind returned to normal operation by 3:30 PM.

Todd Pavlik
CARLI

Emergency Maintenance Complete

All Production CARLI Linux servers have been patched and rebooted.

Brandon Gant
CARLI

Pages