Data Engineer

Job Description

Job Overview: We are looking for a passionate and detail-oriented candidate/Data Engineer to join our dynamic team. In this role, you will assist in designing, developing, and maintaining scalable data pipelines and support the overall data infrastructure. You will work closely with various teams to gather requirements, develop innovative solutions, and ensure data integrity and security. This position offers an excellent opportunity to learn and grow in the field of data engineering while contributing to impactful data-driven projects. Job Details Data Engineer: Datawarehouse: Support the development & validation of Datawarehouse and BI systems, maintaining user connectivity and security, while developing data architecture, data modelling, and ETL mapping solutions within a structured data warehouse environment. Data Pipeline: Assist in designing, developing, and maintaining scalable data pipelines while collaborating with teams to create elegant solutions for the business's data needs. ETL Processes: Develop and optimize ETL routines according to Data Warehouse design and architecture, following best practices for data loading and extraction. Database Management: Work with relational and NoSQL databases to store and retrieve data efficiently along with maintaining the platform to perform optimally. Data Quality: Implement and monitor data quality checks to ensure the accuracy and completeness of data. Data Analysis: Collaborate with data analysts and data scientists to understand data requirements and support their analytical needs. Monitor the DWH and BI systems performance and integrity provide corrective and preventative maintenance as required. Facilitate requirements gathering to develop effective solutions for business needs and maintain clear documentation of data pipelines, processes, and procedures. Continuously learn and apply new technologies and best practices in data engineering. Skill set: Logical Skills Python/JAVA MySQL, AWS Redshift, NoSQL-MongoDB Big Data concepts along with Spark ETL Concepts - Any Tool preferably Open Source Data Warehouse concepts Data Visualization Tool Preferably Tableau Cloud Knowledge Preferably AWS Good to have: Data Quality Solutions, Apache Kafka