Lead Data Engineer - Azure Databricks

Job Description

Job Description We are looking for a skilled and experienced Data Engineer to join our team and contribute to enhancement work in the Advanced Master Data Management (AMDM) space. The ideal candidate will have strong hands-on experience with Databricks, SQL, and Python, and must possess practical expertise in Azure Cloud services. You will play a key role in designing, developing, and optimizing scalable data pipelines and solutions to support enterprise-wide data initiatives. Responsibilities Develop and maintain scalable ETL/data pipelines using Databricks, SQL, and Python on Azure Cloud. Design and implement data integration workflows across structured and unstructured sources within the AMDM domain. Collaborate with data architects and business teams to translate requirements into efficient data solutions. Ensure data quality, consistency, and integrity across systems. Monitor, troubleshoot, and optimize data workflows in Azure-based environments. Leverage Azure services like Azure Data Factory, Azure Data Lake, Azure Synapse, and Azure Key Vault as part of solution delivery. Qualifications 6+ years of hands-on experience in Data Engineering or ETL development. Strong proficiency in Databricks for distributed data processing and transformation. Advanced skills in SQL and Python for building and automating data workflows. Solid working experience with core Azure Data Services Experience with relational and non-relational database technologies (e.g., SQL Server, PostgreSQL, Oracle). Familiarity with Stibo or similar Master Data Management (MDM) tools.