DanubeData Blog

News, tutorials, and insights about cloud infrastructure.

Search titles and content with at least 2 characters.

Engineering

Showing 1–3 of 3 articles

Engineering11 min read

A Server Lost Power at 00:32. We Found Out at 08:18.

One machine stopped, and S3, the container registry and every deployment stopped with it for eight hours. Our monitoring caught it in three minutes and told nobody. Here is the full postmortem: why single-machine redundancy was not what we thought it was, the near-miss we nearly caused ourselves, and the pager and hardware watchdog we shipped the same day.

Adrian Silaghi914 views
Engineering12 min read

Incident review — S3 object storage instability, April 30 2026

On April 30 2026, our S3 object storage service experienced intermittent disruptions over a six-hour window. A faulty 10 Gigabit network card on a newly added storage server triggered repeated kernel watchdog reboots. Here is what happened, what our diagnosis got wrong on multiple occasions, and what we are changing as a result.

Adrian Silaghi845 views

Stay in the loop

Get the latest articles, tutorials, and product updates delivered to your inbox.