Big Data

NC · 112 months ago

About the job

Job Description • At least 7+ years of overall experience • HDFS architecture and understanding of all critical architectural concepts including type of nodes, node interaction, YARN, Zoo Keeper, and Map reduce etc. • Hand on experience in Hive: All concepts including Hive queries, UDF, Different file formats like ORC, AVRO, and Parquet etc. • Hand on experience in developing Sqoop, Spark. • Experience in processing structured data - Warehousing Concepts like de-duplication, cleansing, look ups, transformation, data versioning etc. • Hand on experience in developing Oozie workflow definition and execution • Knowledge of a HDFS distribution preferably Cloudera. Understanding of Monitoring...