Senior Data Engineer

Job Description

Dreaming big is in our DNA Its who we are as a company Its our culture Its our heritage And more than ever, its our future A future where were always looking forward Always serving up new ways to meet lifes moments A future where we keep dreaming bigger We look for people with passion, talent, and curiosity, and provide them with the teammates, resources and opportunities to unleash their full potential The power we create together when we combine your strengths with ours is unstoppable Are you ready to join a team that dreams as big as you do AB InBev GCC was incorporated in 2014 as a strategic partner for Anheuser-Busch InBev The center leverages the power of data and analytics to drive growth for critical business functions such as operations, finance, people, and technology The teams are transforming Operations through Tech and Analytics, Do You Dream Big We Need You, Job Description Job Title: Azure Data Engineer Location: Bengaluru Reporting to: Senior Manager Data Engineering Purpose of the role We are seeking an experienced Data Engineer with over 4 years of expertise in data engineering and a focus on leveraging GenAI solutions The ideal candidate will have a strong background in Azure services, relational databases, and programming languages, including Python and PySpark You will play a pivotal role in designing, building, and optimizing scalable data pipelines while integrating AI-driven solutions to enhance our data capabilities, Key tasks & accountabilities Data Pipeline Development: Design and implement efficient ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB), Ensure high performance and scalability of data pipelines, Relational Database Management: Work with relational databases to structure and query data efficiently, Design, optimize, and maintain database schemas, Programming and Scripting: Write, debug, and optimize Python, PySpark, and SQL code to process large datasets, Develop reusable code components and libraries for data processing, Data Quality and Governance: Implement data validation, cleansing, and monitoring mechanisms, Ensure compliance with data governance policies and best practices, Performance Optimization: Identify and resolve bottlenecks in data processing and storage, Optimize resource utilization on Azure services, Collaboration and Communication: Work closely with cross-functional teams, including AI, analytics, and product teams, Document processes, solutions, and best practices for future use, Qualifications, Experience, Skills Previous Work Experience 4+ years of experience in data engineering, Proficiency in Azure Data Factory (ADF) and Azure Databricks (ADB), Expertise in relational databases and advanced SQL, Strong programming skills in Python and PySpark, Experience with GenAI solutions is a plus, Familiarity with data governance and best practices, Level Of Educational Attainment Required Bachelor's degree in Computer Science, Information Technology, or a related field, Technical Expertise: Knowledge of machine learning pipelines and GenAI workflows, Experience with Azure Synapse or other cloud data platforms, Familiarity with CI/CD pipelines for data workflows, And above all of this, an undying love for beer! We dream big to create future with more cheers,