Sr & Lead Data Engineer @ Hyderabad, Bangalore, Chennai, Noida, Mumbai

Job Description

About Role - We are building a Data Engineering Platform using Azure and Databricks, which requires good coding skills on Python + PySpark along with Databricks and Azure services understanding. Because this is a platform so deployment and testing through code is a must - Pytest and CI/CD using Jenkins are needed. Senior/Lead Data Engineer Strong Python Developer with good software design fundamentals Experience of CI/CD is must (preferably Jenkins) Strong Hands-on Pytest experience Strong Databricks PySpark, Delta Tables, Delta Live Tables Experience Best Practices of Data Engineering, Unity Catalog (Experience or atleast theoretical understanding) Azure Cloud Understanding :: Working experience on ADLS, Key Vault, Azure Config Services, IAM BI platform collaboration experience preferably PowerBI Terraform understanding is a plusRole & responsibilities