Compact Template
Data Engineer
Data engineer with 8 years of building and operating pipelines that keep analytics and ML teams fed with trustworthy data. I favor boring, observable infrastructure over clever one-offs.
Other: Python, Apache Airflow, Apache Spark, Snowflake, Kafka, Terraform, Data modeling, Data warehousing, Great Expectations, Airbyte, Scala, Git, Linux, Data governance
Databases: SQL, dbt, PostgreSQL
Cloud: AWS (S3, Glue, Redshift)
DevOps: Docker, Kubernetes, CI/CD, ETL/ELT pipelines
- Build and operate the data platform powering real-time analytics for 15 industrial clients.
- Redesigned the ingestion pipeline with Kafka and Spark, cutting end-to-end latency from 45 minutes to under 3 minutes.
- Migrated 40+ legacy batch jobs to Airflow and dbt, reducing pipeline failures by 65%.
- Built a data-quality framework with Great Expectations that catches roughly 98% of schema issues before they reach production.
Python · Apache Airflow · Apache Spark
- Owned the ETL pipelines feeding the company's marketing analytics warehouse.
- Rebuilt the nightly ETL suite in dbt, cutting runtime from 6 hours to 50 minutes.
- Introduced automated data tests that cut data-quality incidents reported by analysts by 80%.
SQL · Python · Snowflake
Python, Grafana, Prometheus
github.example.com/john-doe/realtime-pipeline-metrics
Kafka, Spark Streaming, Python
Finnish — Native · English — Fluent
Orienteering · Home automation
