System Status

RESOLVED May 11, 2020 - 4:00pm - Local holdings are once again displaying in Primo VE.  CARLI has received word from Ex Libris that the May 10 software release reverted the setting that they fixed last week.  Ex Libris has noted this important setting for the June release and will make sure to check it.

UPDATE May 11, 2020 - 11:00am - CARLI has received and confirmed reports from I-Share institutions that local holdings are once again not displaying in Primo VE.  We have reopened the high priority case with Ex Libris.

RESOLVED May 7, 2020 - 8:00am - Ex Libris has corrected the problem and local holdings are once again displaying in Primo VE. Please contact CARLI if you notice any problems with local holdings displays that have not been resolved.  Thank you!

May 5, 2020 - 3:45pm - CARLI has received reports that local holdings are not reliably displaying in Primo VE. The "How to get it" section may not display your institution’s local holdings and items at all, and the Search Results list may show "Check for available services >" instead of your institution's holdings location, call number, and availability information.

This has been reported to Ex Libris as a high priority problem and they are actively investigating. CARLI does not have any estimate from Ex Libris as to when this problem will be corrected, but we will send an update as new information is known.

We have received all the information that we need, so no additional reports or examples are needed at this time.

Thank you for your patience.

This morning at around 10:30am, the network to CARLI services was down for a few minutes.
CARLI Office staff are working with networking to determine the cause of the interruption.

All CARLI services should be back up; if your library is experiencing connection issues, please contact the CARLI Office.
phone: (217) 244-7593; toll free: (866) 904-5843; email: support@carli.illinois.edu

Between 8AM and 10AM on Sunday, March 11, the Online Catalogs will be taken offline briefly to restart Apache and other OPAC related services.  This outage should be brief and will affect access to:

• I-Share and all local library catalogs VuFind 0.6 & New VuFind: searching will work, but holdings will not display and requesting will not be functional. WebVoyage Classic: will not be accessible until restart is complete.

If you have trouble connecting to these services after 10AM please contact CARLI after hours support at (866) 904-5843 and follow the instructions to page a tech.

This morning at around 10:30AM, we started seeing performance problems with Production Oracle. At around 11:15AM, we received an alert from our Production VuFind 0.6 server and some Help Desk tickets about VuFind issues.

After monitoring and analyzing both servers, we discovered that certain IP addresses were using the VuFind system in a way that could be causing problems. They were hitting an older PHP script that was no longer being used, but was still accessible. Although they were receiving "500 Internal Error" messages for their multiple attempts per second, the servers appeared to be launching processes to other servers (like Production Oracle) trying to complete each request.

We have disabled the problem script that is no longer needed and blocked the IP addresses. Everything appears to be running normally now and we will continue to monitor the systems in case this was only part of the problem.

Brandon Gant
CARLI