Job Description

We are looking for an experienced Data Engineer to build and optimize a high-performance data platform that powers associate experience, analytics, and bulk data integrations . This platform will source data from multiple business databases and core data assets in batch and real-time while ensuring data quality, governance, lineage, and discovery . As a Data Engineer, you will work with Apache Spark, Airflow, Java/Scala, Google Cloud Storage (GCS), Apache Hudi, and BigQuery to develop and maintain scalable data pipelines. You will play a key role in shaping data architecture, processing frameworks, and governance strategies to ensure efficient and secure data operations. What youll do: We are looking for a seasoned and energetic staff engineer who can drive the development of the platform working with a group of high energy engineers, other architects, product managers and report to leadership team. This role requires to be technically strong and be able to drive the development in a fast paced environment. The candidate is expected to work with global teams, provide thought leadership, understand the business context and help provide right solutions, work with product and program managers to plan the releases, participate in sprint planning and handle deployments to production. What youll bring: 10+ years of Data engineering experience You have consistently high standards, your passion for quality is inherent in everything Well versed with Hive, Spark , Kubernetes, Cloud, API and Data Lake concepts . You evangelize an extremely high standard of code quality, system reliability, and performance You have a proven track record coding with at least one programming language (e.g., Java, Python) You re experienced in computing platforms (e.g., GCP, Azure) You re skilled in data modelling data migration protocols Experience with Kafka connect, , Big Query and Looker is added advantage. Experience with the integration tools like Automic, Airflow