[Update] Yammer Username and Group Lookup Issues; 9/04/2014; 8:20AM PDT

Our engineers have identified an issue and have deployed a fix.

Access to the affected service has been re-opened.

We will continue to monitor the situation.

Posted in Uncategorized

Yammer Username and Group Lookup Issues; 9/04/2014; 7:52AM PDT

Yammer is currently experiencing problems with one of our services which provides Username and group lookups.

This will affect search, online now and message composition.

Posted in Uncategorized

[RESOLVED] Slow Yammer Load Times; 08/28/2014; 12:22PM, PDT

This issue is resolved. Yammer networks are loaded normally. No further updates.

Posted in Uncategorized

SLOW YAMMER LOAD TIMES; 08/28/2014; 12:01PM, PDT

Yammer networks are experiencing some unusually slow load times. Our on-call team is working to get this resolved as quickly as possible. More updates to follow.

Posted in Uncategorized

ROOT CAUSE ANALYSIS; Yammer Loading Issues; August 18 & 20, 2014

At 6:00AM, PDT, on August 18, some Yammer users experienced issues loading their networks and feeds. This impacted users beginning fresh Yammer sessions, especially. During this time, the Yammer on-call team observed that requests being made to our assets servers had unexpected pauses of a second or more while data were being returned. As a result, our content delivery network (CDN) was returning incomplete assets and Yammer content could not be consistently loaded. This issue cleared up without direct intervention from the on-call team, but the situation was monitored from this point on. The on-call team posted the all-clear at 8:20AM, PDT.

On August 20 at 6:39AM, PDT, an elevated server load was again detected, resulting in slow loading times for Yammer feeds and pages. The platform recovered again at 8:00AM, PDT.

Following further investigation into these two incidents, it was determined that this was due to some asset compression at the load balancer, which was causing inconsistent asset caching behavior at the CDN. This resulted in the CDN making multiple requests for the same content, which then built up and could not be returned.

To avoid a reoccurrence of this in the future, the Yammer Engineering team has disabled the asset compression that was identified as the root cause of this behavior. Additionally, the routing rules for some Yammer services were rerouted from the main load balancer to reduce the load on it. New alerting mechanisms have also been implemented to catch load balance risks sooner.

There will be no further updates on this incident.

Posted in Uncategorized

UPDATE: FILE UPLOAD ISSUES [22/08/2014][3:43 PDT]

THIS ISSUE HAS NOW BEEN FULLY RESOLVED BY OUR ON-CALL ENGINEERING TEAM

Thank you for your patience

Posted in Uncategorized

FILE UPLOAD ISSUES [22/08/2014] [3:02 PDT]

YAMMER IS CURRENTLY FACING ISSUES WITH FILE UPLOADS OF A CERTAIN TYPE.

CURRENTLY AFFECTED FILE TYPES INCLUDE, BUT NOT LIMITED TO WORD DOCUMENTS (.docx) AND PDFs

[ANY FILE WHICH PREVIEWS IN YAMMER IS AFFECTED]

Users receive a HTTP ERROR on upload.

Our On-call engineers are currently investigating thisĀ and are working to bring about a speedy resolution.

Thank you for your patience while we deal with this.

Posted in Uncategorized