Categories
Planned Maintainance

[Resolved] vz1 issues

vz1 appears to have extremely high load and is being checked

Update: This isnt moving so giving it a hard reboot.

Update 2: FSCK is running on /vz

Update 3: VPS are now starting one by one, and we will be investigating which VPS was the cause, and take appropriate action.

Categories
Planned Maintainance

[Resolved] xn7 performance issues

xn7 is currently having some I/O performance issues.

In order to resolve this we are installing the latest kernel and Xen stack. We will be rebooting it shortly.

Update: Appologies for the delay, / needed a FSCK so we let it run. VPS are starting up one by one now.

Categories
Planned Maintainance

[Resolved] Planned maintainence on cp1

As per the email sent out today, we will  be taking cp1 down for approximatley 15 minutes at 9PM, in order to restore full redundancy to the RAID array after the events on Saturday.

Update: This is currently in progress

Update 2: Actual downtime 5 minutes. Machine is up and services are starting

Update 3: The RAID rebuild is now starting. It’s going to be 10-15 minutes before the load stabalizes. There is going to be substancially increased I/O wait unfortunatley until the rebuild completes.

Update 4: Load is now coming down and the rebuild is chugging along nicely. We are marking this resolved and will continue to monitor until full redundancy and performance has been stored to the array.

Categories
Planned Maintainance

[Completed] Maintainance Notification 11:00AM GMT Monday 1st March

UPDATE : This maintainence is now underway. All machines have been cleanly powered down. We are currently double checking all systems are powered down and will swap the PDU

UPDATE2: Due to a delay with onsite staff this is taking longer than expected. Appologies for the inconvenience.

UPDATE3: PDU has been replaced and we have connectivity on Edge #1. Servers are now being power cycled.

UPDATE5: All systems are now online and passed sanity checks. IF your VPS is offline please reboot via SolusVM or open a ticket

This is a reminder for the below maintainance which will begin in approx 1hr 45mins

Planned Maintenance Notification for 11:00AM GMT Monday 1st March.

This email is to inform you of some planned maintenance which will be service affecting.

Maintenance:

The main power bar in our rack which is supplied by our data centre has failed. The failure does not affect the power going through and ultimately to our servers however what has failed is the LCD Display which shows the current power usage which is very important to ensure that the rack isn’t overloaded.

Planned for:

11:00AM GMT on Monday 1st March 2010

Expected Downtime:

The downtime expected is approx 10 – 15 minutes. We will be powering all machines down cleanly then replacing the PDU and powering each machine back on.

Note: VPS may take longer due to the way that VPS start up.

We apologize for any inconvenience this may cause.