Lead Data Engineer- Hybrid- An IT Start

8 - 10 years

40.0 - 55.0 Lacs P.A.

noida

Posted:2 months ago| Platform: Naukri logo

Apply Now

Skills Required

pysparkdata engineeretlpythonsqldata qualitydata lakesdata pipelinedata infrastructuredata lakedata warehouses

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are seeking a talented Lead Data Engineer to join our team and play a pivotal role in transforming raw data into valuable insights. As a Data Engineer, you will design, develop, and maintain robust data pipelines and infrastructure to support our organization's analytics and decision-making processes, with team handling. Responsibilities: Data Pipeline Development: Build and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources (e.g., databases, APIs, files) into data warehouses or data lakes. Data Infrastructure: Design, implement, and manage data infrastructure components, including data warehouses, data lakes, and data marts. Data Quality: Ensure data quality by implementing data validation, cleansing, and standardization processes. Performance Optimization: Optimize data pipelines and infrastructure for performance and efficiency. Collaboration: Collaborate with data analysts, scientists, and business stakeholders to understand their data needs and translate them into technical requirements. Tool and Technology Selection: Evaluate and select appropriate data engineering tools and technologies (e.g., SQL, Python, Spark, Hadoop, cloud platforms). Documentation: Create and maintain clear and comprehensive documentation for data pipelines, infrastructure, and processes. (Immediate Joiners)

RecommendedJobs for You