Job Description

Role & responsibilities We are seeking a highly skilled Big Data Architect with deep expertise in AWS, Kafka, Debezium, and Spark. This role offers an exciting opportunity to be a critical player in optimizing query performance, data synchronization, disaster recovery (DR) solutions, and simplifying reporting workflows. The ideal candidate will have hands-on experience with a broad range of AWS-native services, big data processing frameworks, and CI/CD integrations to drive impactful system and performance enhancements. Required Skills & Qualifications: 12+ years of experience in Big Data architecture and engineering, with a proven track record of successful large-scale data solutions. Extensive expertise in AWS services such as DMS, Kinesis, Athena, Glue, Lambda, S3, EMR, Redshift, etc. Hands-on experience with Debezium and Kafka for real-time data streaming, change data capture (CDC), and ensuring seamless data synchronization across systems. Expertise in Spark optimization, particularly for batch processing improvements, including reducing job execution times and resource utilization. Strong SQL and Oracle query optimization skills, with a deep understanding of database performance tuning. Experience with Big Data frameworks like Hadoop, Spark, Hive, Presto, and Athena. Proven background in CI/CD automation and integrating AWS services with DevOps pipelines. Exceptional problem-solving abilities and the capacity to work effectively in an Agile environment. Skills Data Architecture, AWS, Spark, SQL Interested candidates, please share your updated resumes to saideep.p@kksoftwareassociates.com or contact 9390510069.