RR 345: App Failure Emergencies and Holidays

Episode 352 · January 16th, 2018 · 1 hr 4 mins

About this Episode


Charles Max Wood

Dave Kimura

David Richards

Special Guest: 

Amit Choudary

In this episode, the Ruby Rogues speaks with Amit Choudary, Amit is based in India as a Ruby and Ruby on Rails, Javascript, and Fullstack Developer. Amit is working with a company called Big Binary.  Big Binary builds web apps and a variety of mobile applications.  Amit mentions his informative blog on Ruby 2.5 at blog at Big Binary.

Amit and the panel discuss app failure emergencies and holidays. Importantly this episode is about how holidays affect the schedules, staff, and emergency deploying apps or repairing crashes and servers. This is a great episode to learn about strategies to recover from crashes, emergencies, and disaster recovery,

In particular, we dive pretty deep on:

  • Holiday and emergency deployment
  • Staff availability is the biggest problem during that holidays
  • Coming in on holidays
  • "The Server is Down email”
  • Adapting and avoiding the email
  • Crashes - stories
  • Redundant storage array
  • Disaster recovery
  • Having a plan
  • Communication
  • Having the team in-place
  • Dealing with management and giving updates
  • Covering things during holidays
  • Documentations
  • Deployment
  • Running tests, CI Code
  • Guard
  • Continuous deployment
  • Rolling back
  • Database
  • Debugging
  • Irreversible migration
  • Risk assessment
  • Mistakes happen
  • and much much more.


  • https://www.bigbinary.com
  • https://blog.bigbinary.com
  • @bigbinary





  • Eternium
  • Atari - Sega Games
  • Smoker
  • Instant Pot


  • 2.5 Ruby