Senior Data Engineer

Job Description

We are seeking an experienced Data Engineer with strong expertise in workflow orchestration, Python programming, and cloud-based ETL pipelines. The ideal candidate will have 5+ years of hands-on experience working with Apache Airflow, Python, and Azure Data Factory to design, develop, and maintain scalable data pipelines and workflows. Key Responsibilities: Design, develop, and maintain data pipelines and workflows using Apache Airflow . Write efficient, reusable, and well-documented code in Python to support data transformation, ingestion, and automation. Build and manage ETL/ELT pipelines leveraging Azure Data Factory . Collaborate with data scientists, analysts, and other engineering teams to ensure smooth data operations and integration. Monitor, troubleshoot, and optimize workflows and data pipelines for performance and reliability. Implement best practices for data security, governance, and compliance in cloud environments. Participate in code reviews, testing, and deployment activities. Continuously improve pipeline architecture for scalability and maintainability. Required Skills & Experience: Minimum 5 years of professional experience with Apache Airflow . Minimum 5 years of experience programming in Python . Minimum 5 years of hands-on experience with Azure Data Factory . Strong understanding of cloud data platforms and ETL best practices. Experience with version control systems (e.g., Git). Familiarity with containerization (Docker) and orchestration (Kubernetes) is a plus. Excellent problem-solving skills and ability to work independently or in a team. Job Types: Full-time, Permanent Pay: ₹1,500,000.00 - ₹2,200,000.00 per year Benefits: Health insurance Life insurance Paid time off Provident Fund Schedule: Monday to Friday Supplemental Pay: Performance bonus Application Question(s): Are you based out of hyderabad Work Location: In person