Senior Data Engineer

5.0 - 10.0 years

7.0 - 12.0 Lacs P.A.

Bengaluru

Posted:5 days ago| Platform: Naukri logo

Apply Now

Skills Required

System architectureVersion controlGITorchestrationPostgresqlData qualityAdvertisingAnalyticsSQLPython

Work Mode

Work from Office

Job Type

Full Time

Job Description

About the Role Were seeking a Senior Data Engineer to join our team and take ownership of our advertising platforms data ingestion pipeline. Youll be working on a sophisticated system that processes website data at scale for advertising insights. Key Responsibilities - Maintain and enhance our data pipeline that integrates with BigQuery, PostgreSQL, and Vector databases - Optimize web scraping systems for high-volume domain processing - Implement content analysis workflows using LLM APIs (OpenAI/Google Gemini) - Design and maintain data aggregation systems for domain-level analytics - Ensure data quality and pipeline reliability - Collaborate with team members to improve system architecture Required Skills - 5+ years of experience in data engineering - Strong Python programming skills - Experience with: - Google BigQuery and SQL databases - Web scraping (BeautifulSoup or similar) - ETL pipeline development - Vector databases - REST APIs integration - Understanding of advertising technology and IAB categories (preferred) Technical Requirements - Python ecosystem (pandas, requests, BeautifulSoup) - SQL (PostgreSQL) - Google Cloud Platform (BigQuery) - Experience with LLM APIs - Version control (Git) - Data pipeline orchestration tools

No locations

RecommendedJobs for You

Hyderabad, Pune, Bengaluru