AWS Lakehouse Data Engineer

McLean, VA · 3 days ago

About the job

Job Title: AWS Lakehouse Data Engineer Work Model: Remote – offsite Responsibilities • Build and operate data pipelines (batch and streaming) from APIs, relational databases, file drops, event streams, and external partners. • Design, implement, test, and optimize ETL/ELT pipelines using Python and PySpark to produce analytics-ready datasets for reporting, visualization, and machine learning. • Implement incremental processing, change data capture (CDC), data contracts, schema validation, and reusable transformation frameworks. • Improve pipeline reliability through automated testing, orchestration, monitoring, retries, and operational runbooks. • Design and implement a Delta...