Cloudy with a Chance of Anomalies

Update 2 (3:05pm PST): Looks like we're back. Here's what Google had to say:
At this point, we have stabilized service to App Engine applications. App Engine is now successfully serving at our normal daily traffic level, and we are closely monitoring the situation and working to prevent recurrence of this incident.

This morning around 7:30AM US/Pacific time, a large percentage of App Engine’s load balancing infrastructure began failing. As the system recovered, individual jobs became overloaded with backed-up traffic, resulting in cascading failures. Affected applications experienced increased latencies and error rates. Once we confirmed this cycle, we temporarily shut down all traffic and then slowly ramped it back up to avoid overloading the load balancing infrastructure as it recovered. This restored normal serving behavior for all applications.

We’ll be posting a more detailed analysis of this incident once we have fully investigated and analyzed the root cause.

Update 1 (10:41am PST): Read more about the Google AppsEngine outage.

Google AppsEngine is experiencing slow performance and dropped connections from one of the components of AppsEngine, where the Viewpath application is hosted. Google is working on the issue now, and we will let you know as soon as they have resolved it.

The blog and support systems are still live. While we wait for Google to bring their datacenters back online, why not browse our Feature Announcements. You might find features you didn't know were available!

We're really sorry. We know you depend on Viewpath to manage your projects. Follow us on Twitter or Facebook and we'll let you know as soon as you can get back to Viewpath.


Add comment