Phoenix Power Systems Upgrade Maintenance Window

START TIME: 05/24/2012 09:00 CDT (Monday)
ESTIMATED END TIME: 05/31/2012 12:00 CDT (Thursday)
 
EQUIPMENT: Phoenix Back-up Power Equipment
TYPE OF WORK: Upgrade Automatic Transfer Switching (ATS) Gear
EXPECTED IMPACT: None

 

During the maintenance window above, Codero engineers will be working with our electrical systems vendors to upgrade our ATS Gear.  During this two week period, there will be few instances where our PHX data center will be operating briefly on our back-up power systems only. 
 
There is no expected customer impact during this time.

If you have any questions regarding this maintenance, please contact us by opening a support ticket in ServerPortal.com.

The Codero Hosting Operations Team

 

Updates

  • There are currently no updates. Please subscribe for updates or check back soon.

PHX Power Outage – No Customer Impact

At approximately 7:55 PM CST there was a power outage in the City Phoenix due to a weather system that disrupted utility power to our Phoenix Data center. our back up generators kicked in as designed and planned with no impact to customers. We ran on generator power till 9:28PM CST, when utility power came back on. Everything is running normally now, however, our operations and engineering teams are on high alert and monitoring the situation closely till the weather system passes

Updates

  • There are currently no updates. Please subscribe for updates or check back soon.

05.06.12 – Network Maintenance Window

START TIME: 05/06/2012 00:00 CDT (Sunday)
ESTIMATED END TIME: 05/06/2012 01:00 CDT (Sunday)

EQUIPMENT: Core Networking
TYPE OF WORK: Configuration Changes
EXPECTED IMPACT: None

During the maintenance window above, Codero network engineers will be making configuration changes to our core networking equipment. This will be done in a manner which should have no negative impact on customers.

There is no expected customer impact during this time.

If you have any questions regarding this maintenance, please contact us by opening a support ticket in ServerPortal.com.

The Codero Hosting Operations Team

Updates

  • There are currently no updates. Please subscribe for updates or check back soon.

04.13.2012-1 Investigating reports of service interruption

We are currently investigating reports of service interruption in the PHX datacenter. This does not appear to be related to yesterday’s issue. We will post more information as soon as it is available.

Updates

  • PatL says:

    The issue was resolved immediately and the failover in the networking systems functioned as designed and expected. The short traffic interruption is due to traffic in transit through the failed circuit dropping during the failover. Most customers may have not experienced any interruption. Only a few customers may have experienced a short instantaneous blip as the traffic was re-routed.

04.12.2012-1 Investigating network issues (Resolved)

We are currently investigating a network interruption for some customers in our PHX datacetenter over the last 15-30 minutes. We have switched off one of our redundant upstream providers that was having issues and are currently following up to ensure everything is stable.

Updates

  • PatL says:

    The issue was resolved immediately and the failover in the networking systems functioned as designed and expected. The short traffic interruption is due to traffic in transit through the failed circuit dropping during the failover. Most customers may have not experienced any interruption. Only a few customers may have experienced a short instantaneous blip as the traffic was re-routed.

Anonymous Group Threatens to Shut Down the Internet on March 31

Please note that the hacking group known as Anonymous has issued a threat to shut down the Internet on Saturday March 31, 2012, by attacking the 13 root DNS servers that enable the Internet. If the attack is successful, domain names will not be translated to IP addresses, effectively eliminating the ability for anyone to reach any website after DNS Time-to-Live (TTL) levels expire, except by IP address.

The root DNS servers are located throughout the world and are operated by different entities, including Verisign, NASA, ICANN, and the U.S. Army Research Lab. Note that each root server is actually a cluster of individual servers typically housed in multiple geographical locations to increase fault tolerances.

If the attack is successful, your server may be accessible (because routing to individual IP addresses will not be affected, and because DNS entries may be cached) but your web site may not be accessible (because the attack will impact web browsers and other systems that route traffic using domain names after caching expires). Because the attack will target servers outside of Codero’s control and part of the entities that host all DNS servers for the internet, in the case of a successful attack, there will be little that you or Codero will be able to do to restore access, till such a time that the attack subsides or is neutralized.

Though there is no action needed on your part, we wanted to inform of you of this in case the attack is successful and you are unable to browse the Internet as you are accustomed to.

Updates

  • There are currently no updates. Please subscribe for updates or check back soon.

Windows RDP Remote Code Execution Vulnerability

All currently supported versions of Microsoft Windows are vulnerable to remote code execution through the RDP protocol.  Patches were released today by Microsoft. If you have automatic updating enabled (the default setting),  the patch will be automatically installed on your server. It can also  be installed through Windows Update, or downloaded directly from Microsoft:

http://technet.microsoft.com/en-us/security/bulletin/ms12-020

Codero Windows Managed customers do not need to do anything, as this patch is already installed for you.

If you have any questions, please submit a ticket through Server Portal.

Updates

  • There are currently no updates. Please subscribe for updates or check back soon.

03.09.2012-1 Temporary network degradation

This afternoon some servers in our Phoenix datacenter saw a connectivity degradation related to a DDoS attack that affected traffic coming from one of our upstream providers at 1:10 – 1:15 PM CST. Codero network engineers temporarily shut down the upstream provider to work around the problem.

Between 1:55 and 2:00pm CST Codero engineers restarted our DDoS mitigation system and re-enabled the upstream provider which resolved all issues, but may have caused an additional short interruption of service during this window. Total impact time for affected customers was approximately ten minutes.

Updates

  • There are currently no updates. Please subscribe for updates or check back soon.

03.08.2012-2 : DG-1 Intermittent Issues

We are experiencing intermittent issues with DG-1 in PHX.  Network engineers are addressing the issue.  Update soon.

Updates

  • PatL says:

    The issue was resolved immediately and the failover in the networking systems functioned as designed and expected. The short traffic interruption is due to traffic in transit through the failed circuit dropping during the failover. Most customers may have not experienced any interruption. Only a few customers may have experienced a short instantaneous blip as the traffic was re-routed.

03.08.12 – DG1 Network Impact

At 12:19 pm Central, a network equipment issue caused latency to customers in PHX DG-1 distribution group.  Issue was immediately addressed by networking team with complete resolution by 12:24 pm.

Updates

  • There are currently no updates. Please subscribe for updates or check back soon.