Reproduce “SHADOW: Seamless Handoff And Zero-Downtime Orchestrated Workload Migration for Stateful Microservices” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Hai Dinh-Tuan
A Kubernetes-native framework, SHADOW, enables zero-downtime, zero-message-loss migration for stateful microservices, including StatefulSets, by leveraging an Operator pattern to manage the process and circumventing Kubernetes' identity constraints. This approach consistently achieved zero downtime and zero message loss across 280 migration runs, reducing total migration time by up to 76% at low message rates and accelerating checkpoint transfer by 30 times.
Key insights
- Kubernetes' StatefulSet identity constraints can be circumvented by decoupling traffic routing from pod ownership, enabling concurrent source and target operation for zero-downtime migration.
- Implementing complex migration logic as a Kubernetes Operator integrates the process into the native control plane, providing declarative management, automatic recovery, and enhanced observability.
- Direct node-to-node transfer of CRIU checkpoints, bypassing container registry overhead, substantially reduces the checkpoint transfer phase, improving overall migration efficiency.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.