SENIOR, DATA ENGINEER

Job Description

Establishes modify, and document data governance projects and recommendations. Implement data governance practices in partnership with business stakeholders and peers. Interpret company and regulatory policies on data. Educate others on data governance processes, practices, policies, and guidelines. Provide recommendations on needed updates or inputs into data governance policies, practices, or guidelines. Demonstrate up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales. Provide and support the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organizational changes, and new responsibilities. Required Tools: Python, SQL, Spark, Scala, Hadoop, HIVE, and Google Cloud Platform (GCP) What youll bring: Bachelor s degree in Computer Science and 6years experience in software engineering or related field or Masters degree in Computer Science and 4 years experience in data engineering, database engineering, business intelligence, or business analytics. Experience in Spark and Distributed computing frameworks. Professional hand-on experience in scala/python. Professional hand-on experience in Sql and Query Optimization. Experience in programming design patterns. Experience in system design. Should have Experience with CI/CD tool like Jenkins etc. Should have Experience with Orchestration tools like Airflow/ Automic etc. Should have hand-on experience in Data processing and Data manipulation skills like Data warehousing concepts, SCD types etc. Atleast one cloud exposure (GCP is preferred). Exposure to Streaming data use-cases via kafka or structured streaming etc. Experience collaborating with multiple teams. Experience in Big Data applications Follows the industry trends in the online world. Good knowledge of High-performance Stream processing, Large Scale Messaging Systems Exposure to multi-hop Architecture would be added advantage. Mandatory Skills: Spark, Scala/Python, Sql, GCP, Airflow