Big Data Architect (with ETL Background)

NY · 114 months ago

About the job

Job Description • The Data Lake engineer should come from the background of a Big Data Architect. The position will be in support of data management, ingestion, and client consumption. This individual has an absolute requirement to be well versed in Big Data fundamentals such as HDFS and YARN. More than a working knowledge of Hive is required with an understanding of partitioning/reduced size/block sizing/etc. • Preferably, the candidate has a strong knowledge of Spark on either Python or Scala. • Good Spark knowledge is required. • Knowledge of other industry ETL tools (including No SQL) such Cassandra/Drill/Impala/etc. is a plus. • Ability to meet deadlines and handle multiple tasks...