Python Data Engineer

Job Description

Job Description Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a leading Big4 Consulting firm and provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive digital transformation, and shape the future of global markets. We are looking for a Python Data Engineer with deep expertise in API development, big data processing, and cloud deployment. The ideal candidate will have experience with FastAPI, PySpark, and DevOps pipelines, and be capable of leading a team while delivering high-performance, scalable data-driven applications. Key Responsibilities API Development: Design, build, and maintain scalable APIs using FastAPI and RESTful principles. Big Data Processing: Develop efficient data pipelines using PySpark to process and analyze large-scale datasets. Full-Stack Integration: Collaborate with frontend teams to implement end-to-end feature integration and ensure seamless user experiences. CI/CD Pipelines: Create and manage CI/CD workflows using GitHub Actions and Azure DevOps to support reliable and automated deployments. Containerization: Build and deploy containerized applications using Docker for both development and production environments. Team Leadership: Lead and mentor a team of engineers; conduct code reviews and provide technical guidance to ensure best practices and quality standards. Code Optimization: Write clean, maintainable, and high-performance Python code with a focus on scalability and reusability. Cloud Deployment: Deploy, monitor, and maintain applications in Azure or other cloud platforms ensuring high availability and resilience. Cross-Functional Collaboration: Work with product managers, designers, and other stakeholders to transform business requirements into technical solutions. Documentation: Maintain clear and comprehensive documentation for APIs, systems, and workflows to support ongoing development and maintenance. Requirements Programming: Advanced proficiency in Python, with hands-on experience in FastAPI and REST API development. Big Data: Expertise in PySpark and large-scale data processing techniques. DevOps Tools: Strong knowledge of GitHub Actions, Azure DevOps, and Docker. Cloud Platforms: Experience with Azure or similar cloud environments for deployment and scaling. System Integration: Demonstrated experience in backend-to-frontend integration. Leadership: Proven track record of leading and mentoring software development teams. Collaboration: Excellent communication skills Note: We are looking for immediate joiners only - who can join us in less than a month.