Melza
Data Engineer
About the job
Data Engineer Primary mission: As a Senior Data Engineer, you will contribute to bring data analytics to production at scale. Establish the core discipline and guidelines. Taking part on data teams building data platforms and data products. Core activities: Data Platform, provision infrastructure for other teams to work with. Data Pipelines Development (Batch + Real Time pipelines) Data Operations (Exploring, Provisioning, Cleansing and Testing) Technical stack: Languages (required): Python, SQL Languages (appreciated): Java, .NET and others Experience with Data Ops, infrastructure as Code (Terraform, Ansible, etc) Experience in data architecture design (Data lakes, Data Warehousing, Event Streams. Etc) Big Data Frameworks: Spark, Kafka, Kubernetes, Hive.. strongly appreciated experience with Databricks. Data Base: relational (SQL Server) & non-relational (MongoDB, ELK, Cassandra) Experience working in cloud environments (Azure appreciated) Experience in Agile methodology. As a bonus, knowledge in Machine Learning tools (Scikit-Learn, Pandas, Spark ML, MLflow) Soft skills and competencies: Passion for learning new tools, languages and frameworks Ability to be creative and innovation-minded, self-motivated and proactive. Fast adaptation to changing requirements and strong problem-solving skills. To work in a collaborative model, side by side with the business Experience: MSs degree in Computer Science, Engineering, or related field 4+ years experience in software development & Data Frameworks Proven experience in setting up data infrastructures from scratch