Production-grade data engineering: Alpha Vantage API → Python → PostgreSQL → ClickHouse → FastAPI → Next.js
Data flows through seven stages from external API to interactive dashboard
Production-grade tools chosen for reliability, performance, and real-world adoption
Data ingestion & ETL
Async REST API layer
OLTP data store
OLAP analytics engine
React frontend framework
Interactive visualizations
Container orchestration
Utility-first styling
Data Points
Symbols Tracked
Technical Indicators
Real-Time Pipeline
Automated schema analysis and DDL generation for legacy database migrations
Migrate SQL Server workloads with automated T-SQL conversion and schema mapping.
Move MySQL analytics with ENUM handling, charset conversion, and type mapping.
Scale PostgreSQL analytics with JSONB, array types, and custom domain support.
LegacyToCloud is a portfolio project demonstrating end-to-end data engineering skills. It showcases a production-grade pipeline that ingests real financial market data from Alpha Vantage, processes it through PostgreSQL and ClickHouse, serves it via FastAPI, and renders interactive dashboards with Next.js and Chart.js.
The project also includes database migration tooling for MSSQL, MySQL, and PostgreSQL to Snowflake, featuring automated schema analysis and DDL generation.
Explore the Dashboard