Built with AWS Serverless Stack

Leverages AWS Lambda, SQS, S3, and EventBridge to create a scalable and cost-efficient pipeline.

🏗️

IaC with AWS SAM

Full infrastructure is provisioned using AWS SAM, enabling repeatable, version-controlled deployments.

🏅

Medallion Architecture

Data is organized in Bronze, Silver, and Gold layers — enabling progressive refinement and analytics readiness.

🧪

Unit & Integration Tests

Robust test coverage with Pytest ensures reliability across core functions and infrastructure boundaries.

📊

Visual Insights with QuickSight

Data from the Gold layer is visualized through interactive dashboards using Amazon QuickSight.

🔐

Secure by Design

Secrets are managed with AWS Secrets Manager, and all functions include retry logic and detailed logging.

Welcome to the IMDb Serverless ETL Project

This project builds a fully serverless data pipeline using AWS services. It fetches the top 250 movies from IMDb, enriches them using the OMDb API, stores the results in S3, and enables visual insights — all while following cloud-native best practices.

Read the Full Guide