AWS Lake Formation

AWS Lake Formation enables the global sharing, protection, and central governance of data for analytics and machine learning

[{"selector":"#anim-8d67f6a1-0488-425a-a54d-384746a1ea17","keyframes":{"opacity":[1,1]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-329b6429-0320-4cf5-87a4-22940b9e908e","keyframes":{"transform":["scale(3)","scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}]

Amazon Athena, QuickSight, Redshift Spectrum, EMR, and Glue enforce Lake Formation permissions at the column, row, and cell levels with granular controls

[{"selector":"#anim-ae5620a1-30ff-454b-9b3f-ccbfe6bdf382","keyframes":{"opacity":[0,1]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"both"}] [{"selector":"#anim-10b385cf-476d-4bb4-82e6-dd05b3c5ba94","keyframes":{"transform":["scale(0.3333333333333333)","scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}]

The administrator or a user assigned by the administrator grants Lake Formation access to Data Catalogue databases and tables on Amazon S3

[{"selector":"#anim-5a95ab51-5042-4acc-aed8-dd78173a2e31","keyframes":{"transform":["translate3d(-115.87301%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-4db5f35a-b8a9-461f-b98b-aff279a618d2","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}]

Data Catalogue receives a request for metadata once the integrated analytical engine determines which table is being sought

[{"selector":"#anim-73271779-46bf-454d-8ad9-7b9c433f4879","keyframes":{"transform":["translate3d(122.55891%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-784878b0-70f0-4380-bd6d-1d2be7509b41","keyframes":{"transform":["rotateZ(180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}]

The analytical engine retrieves data from Amazon S3 via temporary access and filters by cell, row, or column

[{"selector":"#anim-adc5cbce-c32c-4dd9-8870-42888c08f7e1","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-fccfac5e-9518-4d41-9e29-883ba61b9da2","keyframes":{"transform":["translate3d(-115.2381%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]

For the creation and management of your data lake, AWS Lake Formation depends on the interplay of multiple elements

[{"selector":"#anim-92c3d336-a836-4e6c-af5b-6640c09df31a","keyframes":{"transform":["translate3d(-115.2381%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-911249ff-3f50-48e4-9b9f-0f7390932097","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}]

Data can be found, cleaned, transformed, and ingested using blueprints on the console

[{"selector":"#anim-2b938378-f6fc-422c-86e8-d35a69653a06","keyframes":[{"offset":0,"transform":"translate3d(0, -542.20364%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.29,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.45,"transform":"translate3d(0, -152.46766356799998%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.61,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.71,"transform":"translate3d(0, -51.834667984%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.8,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.85,"transform":"translate3d(0, -19.465110676%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":0.92,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"},{"offset":0.96,"transform":"translate3d(0, -8.458376783999999%, 0)","easing":"cubic-bezier(.5, 0, 1, 1)"},{"offset":1,"transform":"translate3d(0, 0%, 0)","easing":"cubic-bezier(0, 0, .5, 1)"}],"delay":0,"duration":600,"fill":"both"}]

Using the AWS Command Line Interface (AWS CLI) and a number of language-specific SDKs, Lake Formation offers API functions

[{"selector":"#anim-a3c48230-d54e-43a9-bf39-ae373c2916d9","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}]

AWS Glue to coordinate tasks and crawlers to apply AWS Glue transforms to data

[{"selector":"#anim-5702423a-ec96-4844-bbba-141ed9f75c5c","keyframes":{"transform":["scale(1)","scale(1.5)","scale(0.95)","scale(1)"],"offset":[0,0.33,0.66,1]},"delay":0,"duration":1450,"easing":"ease-in-out","fill":"both","iterations":1}]

To secure your data lake, the IAM permission model is enhanced by the Lake Formation permission model Read more on Govindhtech.com

[{"selector":"#anim-ccea54ec-c39a-468a-ae2d-b99c2ea2e9e5","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-00968cd5-4571-49d4-8446-50e0e3932194","keyframes":{"transform":["translate3d(115.55555%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}]