MogiMogiJobsPowered by MobiusEngineLet Mogi apply

Pyramid IT

Hadoop Admin / Hadoop Developer

New York, NY · 149 months ago

Contract

About the job

Job Description
Role Description:- • Configure parameters for best cluster performance • Install and implement security policies for the cluster • Maintain and monitor the cluster • Load Data in Cluster • Create Unix scripts for managing Hadoop cluster • Troubleshoot and fix issues • Hadoop batch Workflow Management • Performance and memory tuning • Collaboration and coordination with onsite stakeholders from NBCU's IT as well as business groups Responsibilities:- • Physical Unix Side Cluster (Maintaining and Installing OS / Pivotal HD, Removing Node, Reconfiguring Hadoop Cluster, Pivotal HD failover Implementation, Patches/Upgrade) • HAWQ Administration (HAWQ DBA Role, Manage HAWQ Space, Maintain Hawq data/ Performance, HAWQ Failover Implementation, Administer fallback and provide periodic report on failback tables, Patches/Upgrades) • HAWQ Interfaces (Admin, Installation & Configuration), Micro Strategy / Tableu Interface, HAWQ Access User IDs & Roles, New Software Access, Chorus Workspaces/Analysis) • Pivotal HD / Hadoop Tools ( (a) Installation and configuration of Hive, Pig, Mahout, Chorus Trifacta,Datameter,Platfora (b) Analysis of Hive, Pig, Mahout (c) Admin support for all above and related Pivotal HD/ Bigdata/Hadoop Tools) • User Setup (Creating Unix Users, Pivotal HD Setup for user Access, HAWQ Users and Permissions, connection to other tools)

Additional Information
All your information will be kept confidential according to EEO guidelines.