Data Engineer with Scala/Spark and Java

CA · 113 months ago

About the job

Job Description Primary Skills: • Big Data experience • 8+ years exp in Java, Python and Scala • With Spark and Machine Learning (3+) • Data mining, Data analysis Roles and Responsibilities: • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.). • Work closely with our engineering team to integrate and build algorithms • Process unstructured data into a form suitable for analysis – and then do the analysis. • Support business decisions with ad hoc analysis as needed • Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools • Inform the selection of...