ETL from AWS S3 bucket to Amazon RDS Aurora PostgreSQL Serverless V2 DB in VPC Using AWS Lambda

===================================================================
1. SUBSCRIBE FOR MORE LEARNING :
   / @cloudquicklabs  
===================================================================
2. CLOUD QUICK LABS - CHANNEL MEMBERSHIP FOR MORE BENEFITS :
   / @cloudquicklabs  
===================================================================
3. BUY ME A COFFEE AS A TOKEN OF APPRECIATION :
https://www.buymeacoffee.com/cloudqui...
===================================================================

This video shows how configure and set up ETL infrastructure to load raw data (big size csv file) from AWS S3 bucket to Amazon RDS Aurora PostgreSQL Serverless V2 DB which is integrated in VPC using AWS lambda (also integrated in same VPC) dynamically on S3 object creation.

It has pictorial overview and each component configuration level explanations and also python code used walk through.

Finally a demo of scenario where a file (.csv) file uploaded in s3 bucket , invoking AWS lambda , which loads and reads the data and uploads the same data in RDS Aurora DB table by one-to-one map.

This video also shows how to achieve the data security while configuring the ETL scenario, here data does not flow over internet but AWS backbone nework.

This video helps, Data Engineer , Developers and SMEs at ETL.

Use code files can be found at repo : https://github.com/RekhuGopal/PythonH...
#awsrds #amazonrdsauroradb #awslambda #aws #etl