Job Description

Team Overview We are a cross-functional team who's responsibility is to work on new and existing products across the business which may be used by internal or external stakeholders. We have built some of our company's newest suite of products which are used in BI reporting and help to facilitate decision making. Others are more real-time that help traders to view KPIs to trade across multiple counterparties. In this role you will mix your knowledge of real time and batch processing to ensure we are able to deliver data to the business, helping them make decisions and drive revenue. If you are a passionate Specialist Data Engineer based in Bengaluru then we would love to hear from you! Role Responsibilities Lead the design and development of ETL data pipelines using Python on Spark. You will combine the discipline of software engineering with the knowledge and experience of building data solutions to deliver business value. Mentor and support other team members. Take a leading role in design discussions ensuring that solutions in line with business requirements. As a data engineer, youll help deploy data pipelines and processes in a production-safe manner. Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility. Implement processes and systems to monitor data quality, ensuring production data is accurate and available. Work closely with all business units and engineering teams to develop a strategy for long-term data platform architecture. Required Skills 8+ years of relevant commercial experience as a Software Engineer with at least 4 years experience specifically in Data Engineering. Have excellent knowledge of Python/PySpark or other Object Oriented languages such as Scala or Java. Experience with scheduling and monitoring tools such as Airflow or similar. Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. A background in software development in high-volume environments. Worked with stream processing technologies (such as Kafka, Spark and AWS Kinesis). Working knowledge of AWS. Thrive in a diverse, open and collaborative agile environment. Role Location Benefits Hybrid Working: You can work remotely for up to 50 days each year. Discretionary Annual Cash Bonus: A discretionary cash bonus is available to reward your performance and contributions to the company’s success. Generous Vacation Days Per Year: Take advantage of 30 vacation days annually, plus public bank holidays. Family Health Insurance Coverage: Comprehensive health insurance coverage for you and your dependents available from your first day. Personal Accidental Injury Insurance: Feel secure with personal accidental injury insurance provided from the start of your employment. Annual Team Building Retreat: Participate in an annual team-building retreat at a new and exciting location each year with a hackathon and the chance to bring ideas to reality!