Data Quality Engineer

TX · 2 weeks ago

About the job

Job Description Position: Data Quality Engineer (Databricks DQX) Location: Windrose Ave., Plano, TX 75024 Job Type- 12-months contract Job Description: Design and run the data quality layer of our new Databricks lakehouse using Databricks Labs DQX. You will turn business rules from the legacy SQL platform into automated checks, quarantine bad records before they reach Gold tables, and give the business visibility into data health. Key responsibilities: • Profile source and Bronze data with the DQX profiler and turn the output into reviewed quality rules. • Define DQX checks (completeness, uniqueness, validity, ranges, referential and custom SQL checks) in YAML/JSON config or code. • Set...