All affected virtual machines are back online. Our team + vendor engineers are continuing monitor. This incident will now be closed however customer tickets will remain open so that we can advise next steps in the coming hours. In addition, any emergency maintenance will also be posted via this status page.
Aug 28, 17:49 AEST
Important Update - Our team have been able to bring the affected host back online (Servers are booting up) however there is still an ongoing hardware fault.
Our checks indicate there was no data loss.
As a precaution the Ninefold team are taking backups of the Root volume of all affected servers.
We are awaiting the delivery of the replacement parts and will need to bring the severs down for the installation.
More information on this maintenance window shortly.
Aug 28, 16:59 AEST
All affected customers now have a ticket in the Ninefold portal for tracking purposes. Vendor and Ninefold Engineers onsite for Diagnostics. Next update in 30 mins.
Aug 28, 16:08 AEST
Engineers have identified that there has been a failure relating to the storage system on 1x physical host in Asia Pacific 1. Our support team will be logging individual tickets for each affected customer over the coming minutes to identify the impacted VM's and discuss options moving forward. No resolution time has been determined at this stage.
Aug 28, 15:18 AEST
Engineers are currently engaged with our hardware vendor, No restoration time has yet been determined.
Aug 28, 14:47 AEST
We have identified that 1 Physical host has gone offline affecting a subset of customers in APAC-1, Our engineers are currently working to restore this as a matter of urgency.
Aug 28, 14:22 AEST
We are currently investigating a small subset of customers in APAC1, Their servers may have just become unresponsive. More updates to come shortly
Aug 28, 14:16 AEST