Built an Azure e-commerce data platform that ingests more than 1.5 million Olist records from HTTP, SQL, and MongoDB sources, transforms them with PySpark, and serves curated Parquet through Synapse Serverless SQL.
mysql ecommerce big-data apache-spark mongodb azure pyspark data-engineering data-lake parquet data-pipeline azure-data-lake azure-data-factory olist etl-pipeline metadata-driven azure-databricks azure-synapse serverless-sql cetas
-
Updated
Aug 19, 2026 - Jupyter Notebook