Job Description

About the Role: We are seeking a hands-on Data Platform Engineer to lead the design, development, and maintenance of our scalable data infrastructure. You’ll build data pipelines, manage our data lake, and enable reliable analytics and reporting across the business. Key Responsibilities: Design and develop robust data pipelines using Python, Spark, and Big Data tools Own and manage our AWS-based data lake (S3, Glue, Athena, Lambda, EMR) Build and orchestrate ETL workflows with Airflow Develop and manage Kafka-based data streaming platforms Ensure data reliability, scalability, and performance Collaborate with Analysts, Scientists, and stakeholders for data-driven decisions Promote best practices in data governance and quality Enable BI integration with tools like Tableau Mentor junior team members Required Skills: 8+ years in data engineering or platform roles Strong Python/Java and advanced SQL skills Expertise in Airflow, Spark/PySpark, and AWS data stack Experience with large-scale ETL and real-time streaming (Kafka) Solid grasp of data warehousing, governance, and big data systems Nice to Have: Tableau or BI tools experience Familiarity with open-source data platforms (Druid, Iceberg, Nessie) Knowledge of data observability, cataloging, and quality frameworks Show more Show less