Name		Name	Last commit message	Last commit date
airflow		airflow
aws		aws
mage-zoomcamp		mage-zoomcamp
.gitignore		.gitignore
README.md		README.md
answers.txt		answers.txt
image-1.png		image-1.png
image-2.png		image-2.png
image-3.png		image-3.png
image-4.png		image-4.png
image-5.png		image-5.png
image-6.png		image-6.png
image-7.png		image-7.png
image.png		image.png
main.tf		main.tf

Repository files navigation

Data_Engineering_Zoomcamp

My participation Repo for Data Engineering Zoomcamp

Flow Diagram:

Overall Pipeline in Mage:

Fetched Data using Data Loader

Transformed and Tested Data

Loaded data to Postgres

Loaded data to S3

Loaded data in partitions

Added Trigger to run pipeline daily

About

A repo to practice Data Engineering Zoomcamp

0 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages