Data Engineer

Job Description

Our stack: Python, SQL, Airflow, PostgreSQL, MySQL, REST, Aptible, Docker, Tonic.ai, Terraform, Spark, Kafka, Fivetran, Databricks, AWS (S3, Lambda, Kinesis, RDS, Glue). Our workflow is trunk-based CI/CD, and our security/compliance posture is at the highest standards of healthcare, including HIPAA, HITRUST, SOC 2, CCPA. WHAT YOULL ACCOMPLISH Create compliance strategies (HIPAA, GDPR, CCPA), tooling, processes, and coaching that enables service and application teams to take full ownership of their data in a growing organization Architect and build data pipelines and data aggregation systems to deliver quality real-time and batch analytical reports Participate in hiring and mentoring of team members Assist and coach teams to optimize poorly performing data pipelines Work with the SRE team to establish best practices around database monitoring, alerting, and availability WHAT WE'RE LOOKING FOR 5+ years of software engineering experience, 6+ in data engineering Mastery of SQL and Python Solid background in processing and storing large scale data using distributed systems as well as a mastery of database designs and data warehousing Good understanding of a broad spectrum of data stores like PostgreSQL, MySQL, MongoDB, Redis, Snowflake and Redshift Experience building data pipelines using Spark, Kafka, Airflow Knowledge of software engineering best-practice development (e.g., linting, testing) Ability to collaborate and problem-solve across teams Excellent communication skills, both written and verbal Bachelors degree in C.S. or equivalent experience BONUS POINTS Experience building data infrastructure on AWS Prior DBA experience Prior experience with healthcare data (PHI/PII/HIPAA) Prior experience working with Kubernetes Extensive NoSQL knowledge