How to perform ETL with AWS lambda using Python | AWS | Lambda | Python | Lambda Layers

In this video, we will develop AWS Lambda ETL script using Python. We can use Python scripts in AWS Lambda to run small to medium-sized ETL (extract, transform, and load) workflows. In Lambda environment Python scripts are compatible with Python 2 and 3 and come pre-loaded with libraries such as the Boto3, Numpy, SciPy, pandas, and others. We can also, install other libraries via a zip file.

Link to code, GitHub: https://github.com/hnawaz007/pythonda...

Link to article on the subject, medium: https://blog.devgenius.io/how-to-perf...

AWS Lambda Environment Variables: https://docs.aws.amazon.com/lambda/la...

Subscribe to our channel:
   / haqnawaz  

---------------------------------------------
Follow me on social media!

GitHub: https://github.com/hnawaz007
Instagram:   / bi_insights_inc  
LinkedIn:   / haq-nawaz  

---------------------------------------------

#Python #ETL #awslambda

Topics covered in this video:
0:00 - Introduction AWS Lambda
1:31 - Overview of ETL with Lambda
2:00 - Create Python zip file
3:23 - Create a Layer in AWS with zip file
4:17 - Write Lambda function
5:11 - Import Libraries from Layer
6:11 - Code ETL Script
6:29 - Lambda Environment Variables
8:07 - Execute Lambda function to load data
8:18 - Review Redshift table