Global Channel Management, Inc.
Hadoop Developer
About the job
Qualifications
Hadoop Developer needs 5+ years of Python, Java/ Scala.
Hadoop Developer requires:
• B.S. and M.S. in mathematics, computer science or engineering
• 3+ years of demonstrated technical proficiency with SPARK, big data projects, and experience in data modeling.
• Experience
designing and developing data ingestion and processing/transformation
frameworks leveraging tools such as ADF, NiFi, Sqoop, Eclipse
• Should
have worked in Big data space for at least 5 years in Apache Spark,
Hive and MapReduce. Experience with a variety of Big Data ETL tools,
e.g. Spark, Hive, Kafka, Sqoop, MapReduce, Scala, Zookeeper, Etc
• Should have experience in Cloudera or Hortonworks and exposure to Teradata is beneficial.
Hadoop Developer duties:
• Translate complex functional and technical requirements into detailed design
• Proficiency in SPARK for technical development and implementation
• Load disparate data sets by leveraging various big data technology (Kafka)
• Ability to utilize Hive, Spark, Cassandra, MLlib, Typescript,NodeJS, Pyspark, Eclipse
Additional Information
$56hr
6 MONTHS