Skip to content
View HarveyC1999's full-sized avatar

Block or report HarveyC1999

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
HarveyC1999/README.md

Hi, I'm Harvey 👋

Data Engineer focused on building reliable data platforms, real-time pipelines, and AI-enabled data systems.

Current Focus

  • Real-time data processing with Kafka and Spark
  • Data orchestration with Airflow
  • Analytics engineering with dbt
  • AI systems for DataOps and engineering workflows

Featured Projects

Real-Time Commerce Platform

A production-minded data platform built with Kafka, Spark Structured Streaming, PostgreSQL, dbt, and Airflow.

Key areas:

  • event-driven architecture
  • Bronze / Silver / Gold data layers
  • streaming deduplication and watermarking
  • idempotent processing
  • data quality and quarantine pipelines

DataOps Incident Copilot

An AI-assisted system for investigating data incidents and supporting DataOps workflows.

Technologies

Python • SQL • PostgreSQL • Kafka • Spark • Airflow • dbt • Docker

Currently Learning

  • Spark Structured Streaming
  • Airflow orchestration
  • distributed data reliability patterns

Pinned Loading

  1. real-time-commerce-platform real-time-commerce-platform Public

    Production-minded real-time data platform built with Kafka, Spark, PostgreSQL, dbt, and Airflow.

    Python

  2. dataops-incident-copilot dataops-incident-copilot Public

    AI-assisted DataOps incident investigation and troubleshooting platform.

    Python

  3. agent-skill-registry-and-evaluation-platform agent-skill-registry-and-evaluation-platform Public

    Platform for versioning, evaluating, comparing, and governing AI agent skills with deterministic and model-based evals.

    Python

  4. asr-nlp-keyword-pipeline asr-nlp-keyword-pipeline Public

    End-to-end ASR and NLP pipeline for speech transcription, text normalization, and business keyword extraction.

    Python