Data Engineer Lead (GCP Big Query) - Gurugram

Job Description

This role will be responsible for working with the engineering team and be hands on handling end-to-end data Lifecyle management. With primary focus on data pipeline creation, scripting to transform, cleanse & process data. Schedule, monitor & deploy the data pipelines. • Work on data movement from one system to another involving legacy system & cloud system. • Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. • Work on building data pipelines in the cloud platform. • Experience in Data Modelling is a must. • Responsible to work with the internal & vendor side engineering team to ensure any roadblocks are cleared well ahead in time. Primary skills required: • Strong query building experience in any of query eco systems such as Python, SQL, Big query, Redshift ecosystem, Azzure synapse • Have worked on high volume of data from ingestion to consumption & hands on experience. • Suitable candidate will also demonstrate experience with big data infrastructure. • The candidate will additionally demonstrate substantial experience and a deep knowledge of relational databases. • Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning • Creating technical design documentation of the projects/pipelines • Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop (Cloudera, Hortonworks) and AWS/GCP/Azure. Cloud exposure will be an added advantage.