Specialist - Data Engineering

Job Description

Job Summary Very strong in Scala programming languages Big Data technologies including Spark Scala and Kafka have a good understanding of organizational strategy architecture patterns Microservices Event Driven and technology choices and coaching the team in execution in alignment to these guidelines Mandatory Certification anyone Cloudera CCA Spark and Hadoop Developer CCA175 Databricks Certified Developer Apache Spark 2X Hortonworks HDP Certified Apache Spark Developer Key Roles and Responsibilities Skill Big Data Spark SQL Scala Mandatory Certification any one Cloudera CCA Spark and Hadoop Developer CCA175 Databricks Certified Developer Apache Spark 2X Hortonworks HDP Certified Apache Spark Developer Job Description Experience in Scala programming languages Experience in Big Data technologies including Spark Scala and Kafka You have a good understanding of organizational strategy architecture patterns Microservices Event Driven and technology choices and coaching the team in execution in alignment to these guidelines You can apply organizational technology patterns effectively in projects and make recommendations on alternate options You have Handson experience working with large volumes of data including different patterns of data ingestion processing batch Realtime movement storage and access for both internal and external to BU and ability to make independent decisions within scope of project You have a good understanding of data structures and algorithms You can test debug and fix issues within established SLAs You can design software that is easily testable and observable You understand how teams goals fit a business need You can identify business problems at the project level and provide solutions You understand data access patterns streaming technology data validation data performance cost optimization Strong SQL skills ETL Talend preferred Any other ETL tool Experience with Linux OS user level Python or R programming skills good to have but not mandatory Skills : Primary Big Data Spark Scala developer Kafka Real time Streaming Secondary Hive Impala No SQL Starburst Optional Java Spring Show more Show less