Job Description

Dear team, Kindly find JD for Big Data Developer Client : Scadea Mode : FTE Job Title: Big Data Developer Location: Chennai / Pune Experience: 5 8 Years Salary: Up to 30 LPA Job Summary: We are seeking an experienced Big Data Developer to join our dynamic team. The ideal candidate will have a strong background in big data technologies, data engineering, and distributed systems. This role requires expertise in handling large-scale data processing systems, ensuring data reliability, and driving data-driven insights. Key Responsibilities: Design, develop, and implement scalable Big Data solutions using Hadoop, Spark, and other data processing frameworks. Develop ETL pipelines to ingest, process, and transform large data sets efficiently. Work with structured, semi-structured, and unstructured data to create data pipelines that enable actionable insights. Build and maintain data workflows and automated solutions for data processing. Collaborate with cross-functional teams to gather requirements and deliver data solutions. Ensure data quality, consistency, and security throughout the data lifecycle. Optimize performance of data pipelines, ensuring minimal latency and high throughput. Troubleshoot and resolve data-related issues, ensuring data integrity and availability. Document system designs, data flows, and key technical details. Technical Skills Required: Expertise in Hadoop Ecosystem (HDFS, Hive, HBase, YARN, etc.). Proficiency in Apache Spark , Kafka , and Scala/Java/Python . Strong understanding of SQL and data manipulation techniques. Experience with cloud platforms like AWS , Azure , or GCP . Familiarity with data streaming technologies such as Kafka or Flink . Hands-on experience with data visualization tools and BI platforms is a plus. Qualifications: Bachelors/Masters degree in Computer Science, IT, or a related field. 5-8 years of experience in Big Data development and data engineering. Strong problem-solving skills with excellent analytical capabilities. Ability to work independently and as part of a collaborative team environment. Preferred Skills: Experience with real-time data processing. Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes . Knowledge of CI/CD pipelines and DevOps practices. Note: Kindly Highlight the Skillsets in Resume. Feedback Date Role Name Contact Number Email Id Current Company Experience Relevant Experience Notice period Current location Preferred location Current CTC Expected CTC Holding offer budget