Database Resiliency Engineering: Dell Accepts Chaos

System outages can be caused by abrupt surges in user activity, network problems, or software bugs

[{"selector":"#anim-4e9d9080-38d0-4084-8d1e-74760ab752a3 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(31.284090795523493%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-1e99c8a0-13de-432c-85e0-269da4e0f7fa","keyframes":{"transform":["translate3d(116.90140%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-51cd8db8-70c2-4365-9c96-a73b0829dcbf","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-c8f1eeeb-1d2c-4192-948f-f8d60455cb32","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

These events can cause downtime, financial loss, and reputational harm to brands

[{"selector":"#anim-7fa40e8c-a02e-4d65-833c-d39f5103d0d9","keyframes":{"transform":["translate3d(125.73529%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-a344d95d-fd50-4580-b836-7394fefc6360","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2faff602-6630-437a-a07d-e0357ebacc2a","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] [{"selector":"#anim-677e7945-b6e1-46b9-9d21-9f71b756b682 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(46.43749997838289%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}]

The exercise purposefully exposes servers to controlled instances of chaos

[{"selector":"#anim-5458c1b1-1774-4d51-84b0-96c126106f5b [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-37.481453929972666%, 0, 0) translate(-25%, 0%) scale(1.5)","translate3d(0%, 0, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-77ad6f81-3053-485a-bc01-08d9bf94e838","keyframes":{"transform":["translate3d(116.55172%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-903323ff-1d6f-466a-8e1a-732dbc28d33f","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-5cbebc5a-a7c9-40a9-85f4-0534581a06a0","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

This is similar to stress-testing a bridge to make sure it can take the weight of high traffic

[{"selector":"#anim-4563cea7-e3c3-4c58-8907-b716faab432f [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-21.874999829338588%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-010c48a1-fd8a-4851-8b9d-5270005650b0","keyframes":[{"offset":0,"transform":"translate3d(0, -195.30766%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.29,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.45,"transform":"translate3d(0, -54.920513992000004%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.61,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.71,"transform":"translate3d(0, -18.671412296%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.8,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.85,"transform":"translate3d(0, -7.011544994%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.92,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.96,"transform":"translate3d(0, -3.0467994959999998%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":1,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"}],"delay":0,"duration":600,"fill":"both"}]

They may test the limits of Dell server with Dell’s Chaos Experiment tool, identifying potential vulnerabilities and proactively reinforcing key areas

[{"selector":"#anim-40380d34-c368-45e9-b627-cc7621ea4fee [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-d7709a2b-896c-4599-8046-368fa9534624","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":1450,"easing":"ease-in-out","fill":"both","iterations":1}]

The objective is to strengthen Dell systems through multi-phase, iterative changes that begin with a well-defined hypothesis

[{"selector":"#anim-89a24fcd-9070-48d9-8d94-ec179bcbc2d6 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(28.824806821316702%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-b234961d-6613-4a2e-bc92-4b1fa0e03bcf","keyframes":{"transform":["translate3d(-123.74101%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-4c42bb3b-3697-4f05-a79d-63fa301a1cfd","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}]

This serves as the foundation for Dell analysis and a benchmark for gauging the effects of the studies

[{"selector":"#anim-8039dfd3-3422-44ae-b31f-ec22ab32fc29 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-efa3c7a7-9468-41c7-ad14-92ec1460fafb","keyframes":{"transform":["rotate(-540deg) scale(0.1)","none"],"opacity":[0,1]},"delay":0,"duration":1000,"fill":"both","iterations":1}]

They may increase Dell ability to endure possible disruptions iteratively with each trial thanks to the ongoing cycle of testing, discovering, and improving for more details govindhtech.com

[{"selector":"#anim-d2b4ecca-79b1-47e1-af44-b6826f4210d5 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-21.874999829338588%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-9cbfcb57-06e2-49d0-a6d2-e6cc66de2366","keyframes":[{"offset":0,"transform":"translate3d(0, -131.75764%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.29,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.45,"transform":"translate3d(0, -37.050248368000005%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.61,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.71,"transform":"translate3d(0, -12.596030384000002%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.8,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.85,"transform":"translate3d(0, -4.730099276000001%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.92,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.96,"transform":"translate3d(0, -2.0554191840000002%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":1,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"}],"delay":0,"duration":600,"fill":"both"}]