Monthly Archives: October 2015

Membee’s Data Center Maintenance

Posted on by

Hi Everyone,

Data Center Maintenance Window Declared for Oct. 8 at 2:00 AM ET

Here is a brief update from the ongoing investigation into last week’s service interruption. While we plan to provide as much detail as possible once the investigation is completed, at this preliminary point, the issue has been narrowed to new network hardware installed “upstream” from Membee. The hardware was brought online on October 2 and hence created the issue of making it impossible to reach Membee’s servers.

While knowing “what” happened is helpful, we are more interested in “why” it happened and the specific steps the vendors involved are taking to prevent it from happening again. Those answers are yet to come but we have been assured that they will be forthcoming once the investigation is completed.

In the course of the investigation to date, it has been discovered that preventative revisions to the upstream network hardware should be done as a precaution. As a result, a 2-hour maintenance window has been declared in the data center beginning at 2:00 AM ET (UTC -4) on October 8th. For a minute or two at some point during this window, you may experience soon slowness in Membee as the network traffic is rerouted.

These revisions are precautionary but are deemed to be prudent.

Thanks,

Membee Customer Support Team

Membee Services are Restored

Posted on by

Hi Everyone,

As of 7:00 pm ET, all Membee services are back up.

We will continue to monitor everything here. However, if you encounter any issues with accessing Membee, please email us immediately at support@membee.com

We will post a full post mortem here as soon as we have the details from our hosting provider as to exactly what caused this service interruption and what has been put in place to ensure that it does not happen again.

We would like to thank you for your patience as our provider worked to resolve this issue.

Membee Customer Support Team

Membee Service Disruption

Posted on by

Hi Everyone,

As of 6:15 ET, all Membee services are back up but we are continuing to test things here to make sure that everything is working as it should be.

We will provide another update as soon as we are confident that all our systems are back to normal.

Membee Customer Support Team

Membee Service Disruption

Posted on by

Hi Everyone,

We received a recent update. The issue has been narrowed to a specific network vendor. They are currently working on resolving the issue. Often one of the biggest challenges is identifying where the issue is and we will provide more updates as soon as they become available.

Thank you for your continued patience.

Membee Customer Support Team

Service Disruption to Membee

Posted on by

Hi everyone,

The issue has been identified as upstream from the Internet, and likely a denial of service attack that is happening before you reach Membee. Our data center is well aware and is actively working on the issue to identify the source of the attack, and resume services as soon as possible. They have promised us an update within the next 30 minutes and we will pass that update along.

 

Membee Customer Service Team

Membee Service Disruption

Posted on by

Hi Everyone,

This morning at 11:30 AM EST, Membee’s hosting provider is currently experiencing a service interruption.  This effects all current services within Membee.  Support teams are engaged to restore services as quickly as possible.

We will post an update once we have more information available.

 

Thank you for your patience,

Membee Customer Service Team

Membee Services are Restored

Posted on by

Hi everyone,

The services are back up and running. We will continue to monitor everything here at Membee.

If you encounter any issues with accessing Membee, please email us at support@membee.com

Once there is more information available, we will post an update here

We apologize for any inconvenience this may cause you and we thank you for your patience.

Membee Customer Service Team

Service Disruption

Posted on by

Hi Everyone,

Today at 2:30pm MST, Membee’s hosting provider is experiencing a service interruption that is affecting all current services within Membee. We are working as with the provider’s support team to restore services as quickly as possible.

We will post an update once we have more information available.

Thank you for your patience,

Membee Customer Service Team

Report Service Is Running

Posted on by

The report service is up and running. This morning, there was an issue that caused a long line up, your report was queued and waiting for it’s turn to be run, but it was taking far more time then it normally would. The service up and running is clearing out the backlog in the queue at the moment. We appreciate your patience with the reports and they will complete if they are sitting in the queue, it just needs a bit of time to clear.

If you ran into an error running a report, our monitoring service has notified us and we’re on it. We are investigating the errors and please check here for updates before re-running the report.

We sincerely thank you for your patience and we apologize for the inconvenience.

Membee Customer Service Team