We did a database upgrade this morning, and some users may have received an error message during the approximately 1 minute the database was down. If they re-submitted their page everything would continue to process as normal. We upgraded from MySQL 5.5…
Read MoreWe invest a lot in our behind-the-scenes infrastructure. We just completed a fairly major set of projects to improves our resiliency and fault tolerance. In addition, we upgraded the versions of the number of the components we use in our infrastructure. The…
Read MoreWe had a non-critical cache outage last night that caused some response time to be over 2 seconds from 4:05 AM until 5:15AM. Due to our highly available design, the only thing users would have noticed is the system being a bit slower….
Read MoreThere have been outages on Amazon AWS, our cloud infrastructure provider, this morning. This has caused some delays in completion of transactions and notification to customers. The good news is that unlike other systems with less fault tolerance built into them, RunSignup stayed…
Read MoreRunSignUp will be unavailable for 1-2 minutes between 3:45-4:15AM Eastern on Tuesday, September 22 to do a database upgrade. We apologize for the inconvenience.
Read MoreFor the first 6 months of 2015 we had 99.998 availability, with NO unplanned outages (knock on wood). We have had 1,590 releases of our site this year thru August 3, with only 2 requiring us to take the site down (2…
Read MoreAt around 2:00 AM on July 31 our Cloud provider, Amazon AWS, had trouble with three of the services that we use (SQS, SNS, and SES) simultaneously. The outage lasted until about 3:40 AM. This impacted about 50 transactions. We have been able to recover…
Read MoreWe have been asked by a customer to document our disaster recovery plan, and we figured that it might be useful to document this for other customers as well as provide an example to other websites who might want to use a…
Read MoreHere is a video that show what happens when a race opens and a lot of people are waiting to register quickly. The Murfreesboro Half Marathon has a cap of only 3,250 people on their beautiful course in Tennessee, so they always…
Read More
If you are not familiar with Amazon’s Annual Letter from Jeff Bezos, it is worth reading (annually of course). I’ve been a big fan for years, and enjoyed reading this year’s annual letter, which also always includes a copy of his first annual letter…
Read More