Bad motherboard caused site outage
Posted: Fri Mar 01, 2019 2:52 pm
The bad motherboard that has been causing periodic crashes caused the website and the share operator virtual machines to go offline. We were at a Toastmasters meeting and did not have access to cell phones to be notified during that time.
Fortunately, the system performed as designed and the only impact was that the website was unavailable for an hour. The share inserters will insert the missed shares over the next two hours, and no action will need to be taken by us or by customers. You can watch the progress of the share inserters on the homepage in the "share recorder status" box. At the same time, you'll see balances increase very quickly.
A replacement motherboard is sitting on top of the server rack, but the intermittent crashes were never frequent enough to justify installing it. Chris will now schedule a time to travel to Philadelphia and install it, which will require some scheduled downtime later in March.
Fortunately, the system performed as designed and the only impact was that the website was unavailable for an hour. The share inserters will insert the missed shares over the next two hours, and no action will need to be taken by us or by customers. You can watch the progress of the share inserters on the homepage in the "share recorder status" box. At the same time, you'll see balances increase very quickly.
A replacement motherboard is sitting on top of the server rack, but the intermittent crashes were never frequent enough to justify installing it. Chris will now schedule a time to travel to Philadelphia and install it, which will require some scheduled downtime later in March.