Data Engineer (1 Year Contract)

Job Description

Job Description:- Required Skills and Qualifications: Proficiency in SQL and experience optimizing SQL queries for large-scale data processing . Solid understanding of ETL/ELT processes and data pipeline architecture. Experience working with big data technologies such as Kafka, S3, BigQuery or similar platforms. Experience with cloud environments such as AWS, GCP. Experience in developing near real-time distributed data processing solutions using Kafka, Flink, Spark, Kubernetes, Airflow . Strong programming skills in languages such as Python, Java, and Scala is a plus. Excellent problem-solving and communication skills, with the ability to work effectively in a collaborative environment. Key Responsibilities: Platform Support: Perform on-going production support and on-call support duties. Work with both Onsite and offshore resources daily to resolve any incidents and issues. Platform Development: Evolve, design, and maintain our orchestration platforms which aim to abstract complexities of big data technologies and simplify ETL/ELT operations for users across Nordstrom. Integration: Develop seamless connectivity to diverse data sources and destinations, ensuring high performance and reliability. Scalability: Design solutions that are scalable and resilient, capable of handling large data volumes, high velocity, and diverse data formats. Innovation: Stay up-to-date with emerging big data and ETL technologies, incorporating them into the framework as needed to enhance functionality and user experience. Documentation: Create and maintain comprehensive documentation, ensuring users can easily understand and utilize the framework.