Scaling Data Solutions: Amazon ECS and EBS Integration

Amazon Elastic Container Service (Amazon ECS) thanks to the integration with Amazon Elastic Block Store (Amazon EBS), which AWS are announcing currently. You can provision Amazon EBS storage for your ECS tasks running on AWS

[{"selector":"#anim-350c4b0e-123c-4d2b-a0c5-c63a349e77e8 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(31.249999886225726%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-ff931efb-c9a7-46eb-addb-4720eeb9919d","keyframes":[{"offset":0,"transform":"translate3d(0, -134.58953%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.29,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.45,"transform":"translate3d(0, -37.846575836%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.61,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.71,"transform":"translate3d(0, -12.866759068%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.8,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.85,"transform":"translate3d(0, -4.8317641270000005%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.92,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.96,"transform":"translate3d(0, -2.0995966679999998%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":1,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"}],"delay":0,"duration":600,"fill":"both"}]

Data workloads that need high transaction volumes and throughput support storage, like extract, transform, and load (ETL) jobs for big data, can be executed

[{"selector":"#anim-89e2f92f-f267-4edf-88f6-b0609068e6f4 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 12.822578985280279%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] [{"selector":"#anim-d042c91e-810f-4c62-9389-b2b70aa663c5","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e54f6370-9355-428e-b32a-2afe6d586154","keyframes":{"transform":["translate3d(0px, -137.22222%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

Common examples of such workloads include web applications such as content management systems, internal DevOps tools, and machine learning (ML) frameworks

[{"selector":"#anim-c9644836-550f-4e9b-973e-813fdcb0a61e [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(21.874999829338595%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-ff6690fa-9343-4d7b-80da-209988209af6","keyframes":{"transform":["rotate(-540deg) scale(0.1)","none"],"opacity":[0,1]},"delay":0,"duration":1000,"fill":"both","iterations":1}]

You can set up Amazon ECS to provision and attach Amazon EBS storage to your tasks that are running on both Amazon EC2 and Fargate, for applications that require high-performance, low-cost storage that does not need to be shared among

[{"selector":"#anim-2f55c5d7-dd40-4485-85a8-e7bab10a99b7 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(31.249999886225726%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-363b46b5-201c-4ded-b474-d2fe0cd628b2","keyframes":[{"offset":0,"transform":"translate3d(0, -134.53454%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.29,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.45,"transform":"translate3d(0, -37.831112648%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.61,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.71,"transform":"translate3d(0, -12.861502024%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.8,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.85,"transform":"translate3d(0, -4.829789986%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.92,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.96,"transform":"translate3d(0, -2.098738824%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":1,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"}],"delay":0,"duration":600,"fill":"both"}]

For your Amazon ECS task, you can pass the Amazon EBS storage requirements at runtime and set the volume mount point for your container in the task definition

[{"selector":"#anim-43cdba7a-bd32-4b4f-8c27-3e9edc8b30e2 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(29.599435345275708%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-a43db0e8-aad1-48a7-b4c1-bade506b7641","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-b4ca4307-b954-4f35-b484-9fd21653b8e3","keyframes":{"transform":["translate3d(0px, -133.8414%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

When you choose Configure at task definition creation, you can configure existing storage options such as bind mounts, Docker volumes, EFS volumes, Amazon FSx for Windows File Server volumes, or Fargate ephemeral storage

[{"selector":"#anim-752c7800-0674-475c-8ee4-bca611acd555 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(-31.249999886225726%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-e9b49efa-df30-4ee6-b33a-c77740a3aa30","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bc5ca553-c8a4-4e22-888b-5a55b2c59dec","keyframes":{"transform":["translate3d(0px, -114.54304%, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

A new or existing ECS service can be configured to use EBS volumes with the desired configuration, even though this example focuses on deploying a standalone task with an attached EBS volume

[{"selector":"#anim-3abe0626-b91a-45c8-9b93-afdaadf9c5cf [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(0, -4.186925707961588%, 0) translate(0%, -25%) scale(1.5)","translate3d(0, 0%, 0) translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"fill":"forwards"}] [{"selector":"#anim-42a61cc4-224b-4594-8707-1a2fe45f6a48","keyframes":{"transform":["translate3d(-115.55555%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-379cb54a-3b6f-4bd7-ad5d-a15b5d7d9946","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-20b013fe-8c88-45aa-864c-7c201c8afe5a","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

DevOps engineers can configure the actual EBS volume attributes at runtime when the application is deployed For more details visit govindhtch.com

[{"selector":"#anim-f0e4b7be-0159-4bbf-8a06-f270bf51db66 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate3d(21.874999829338595%, 0, 0)","translate3d(0%, 0, 0)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-74744076-ad26-4882-bd06-3524d018ff27","keyframes":{"transform":["translate3d(-123.57143%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-41acf4d8-bb0f-47e3-a8d4-0f6aa595f5e8","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}]