Big Data Developer

Job Description

Project Description Our data engineering team is building and maintaining mission-critical data infrastructure to power Grid dynamics business intelligence and analytics capabilities. This involves developing robust data pipelines, implementing scalable data architectures, and establishing data governance frameworks to support data-driven decision making across the organization. Details on Tech Stack SQL (Primary tool for data manipulation and analysis) Python for data processing and automation BigQuery, Cloud SQL Google Cloud Platform (DataFlow, DataProc, Data Fusion) Data warehousing solutions ETL/ELT tools and frameworks Minimum Requirements for the Candidate 8-10 years of experience in data engineering or related field Expert knowledge of SQL Mid-level knowledge of Python (expert preferred) Experience with cloud platforms, particularly Google Cloud Strong understanding of data modeling and warehouse concepts Experience with ETL pipeline design and implementation Experience with big data technologies (Hadoop, Spark) Nice to Have Requirements for the Candidate Knowledge of data governance and security practices Experience with real-time data processing Familiarity with BI tools and reporting platforms Strong background in performance optimization and tuning Advanced debugging and troubleshooting skills Responsibilities Design and implement efficient, scalable data pipelines Optimize data storage and retrieval processes Ensure data quality and consistency across systems Collaborate with cross-functional teams to understand data requirements Implement data security and compliance measures Project insights Work with large-scale data in a global automotive company Opportunity to shape data engineering practices Exposure to modern cloud technologies and data solutions Collaborative environment with experienced professionals