Senior Data Engineer

Job Description

Job Title: Senior Data Engineer Location: Remote Experience: 6 years Job Summary: We are seeking a highly skilled and motivated Senior Data Engineer with over 6 years of experience, primarily in Python development, and a strong working knowledge of IBM DataStage, Perl, and Java. The ideal candidate will play a key role in designing, developing, and maintaining data pipelines and ETL solutions, ensuring data integrity, scalability, and performance across systems. Key Responsibilities: Design, develop, and optimize scalable data pipelines using Python as the primary language. Build and maintain ETL processes with IBM DataStage, integrating diverse data sources. Maintain and enhance legacy scripts written in Perl and Java, ensuring smooth migration or integration with modern systems. Collaborate with data analysts, architects, and business stakeholders to understand requirements and deliver high-quality solutions. Troubleshoot data issues and ensure high data quality and integrity across systems. Develop unit and integration tests, participate in code reviews, and follow best practices for code documentation and deployment. Required Skills: 6+ years of professional experience in software/data engineering. Strong expertise in Python for data processing, scripting, and automation. Experience with IBM DataStage for ETL development and maintenance. Hands-on experience with Perl for scripting and maintenance of legacy systems. Working knowledge of Java, particularly for backend data-related services. Proficient in working with relational databases (e.g., Oracle, SQL Server, PostgreSQL). Familiarity with version control tools like Git and CI/CD pipelines. Strong problem-solving skills and the ability to work independently or as part of a team. Preferred Qualifications: Experience with cloud platforms (AWS, Azure, GCP) is a plus. Knowledge of data warehousing and big data technologies. Familiarity with Agile methodologies. Show more Show less