Data Engineer II

Job Description

We are seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex data pipelines. The candidate must be able to design and drive large projects from inception to production. The right person will work with stakeholders, analysts, scientists to gather requirements and translate them into a data engineering roadmap. Must be a great communicator, team player, and a technical powerhouse. ---- What You Will Do ---- Collaborate with engineering/product/analyst teams across tech sites to collectively accomplish OKRs to take Uber forward. Enrich data layers to effectively deal with the next generation of products which are a result of Ubers big bold bets. Design and build data pipelines to schedule & orchestrate a variety of tasks such as extract, cleanse, transform, enrich & load data as per the business needs. ---- What You Will Need ---- Strong SQL skills Strong in Data Warehousing and Data Modelling concepts Hands on experience in Hadoop tech stack: HDFS, Hive, Oozie, Airflow, MapReduce, Spark. Programming languages - Python, Java, Scala etc. Experience in building ETL Data Pipelines Performance Troubleshooting and Tuning Experience with DW (Data Warehouse) or BI (Business Intelligence) or OLAP tools like Anaplan, TM1, Hyperion etc. Experience building high-quality end-to-end data solutions in an agile environment from requirements to production. Strong in Data Warehousing concepts Should be self-motivated and passionate about bringing efficiency into the system through optimizations. Should be able to raise the bar for other engineers by proposing and driving innovative ideas. Experience in mentoring junior team members technically. If need be, Act as a Leader to drive big efforts in collaboration with other engineers or team members