Senior Big Data Developer

Job Description

Role & responsibilities: Develop scalable, distributed software systems and work on other projects that require research, awareness, interactivity, and the ability to ask the right questions. Design, develop, debug, support, maintain and test software applications. Work closely with other teams across a wide breadth of applications and solutions. Assist SME in providing consultation to help ensure new and existing software solutions are developed with insight into industry best practices, strategies, and architectures; and pursue professional growth. Help improve code quality through writing unit tests, automation and performing code reviews. Recognize opportunities for continuous improvement to a technology solution whether its optimizing the performance of the system or identifying tech debt. Preferred candidate profile 5+ years of experience developing commercial software in an agile SDLC environment. Strong understanding of triaging data & performance issues with strong analytical and problem-solving skills with the ability to explore, analyze and interpret large datasets Cloud-based technologies such as AWS/GCP, certification good to have Proficiency in distributed processing systems such as Spark/Hadoop and programming skills such as Python, Scala and Java Experience in ETL tools and data pipeline orchestration Frameworks such as Airflow Strong understanding of SQL and NoSQL databases is essential and familiar with data warehousing solutions such as BigQuery Show an ownership mindset in everything you do; be a problem solver, be curious and be inspired to take action, be proactive, seek ways to collaborate and connect with people in support of driving success. Where applicable, fluency in English and languages relevant to the working market.