DataBricks Engineer (Cell Therapy sphere)

Company Background

Our client is revolutionizing the field of cell therapy manufacturing by developing an advanced, scalable, and cost-effective solution that improves accessibility for patients in need. With a mission-driven culture and a multidisciplinary team, they are dedicated to accelerating life-saving therapies using cutting-edge technologies and innovation.

Project Description

Our client develops a unique device - a “factory-in-a-box” designed for industrial-scale cell therapy manufacturing. The accompanying web application enables users to define customized cell therapy workflows with complete control over process parameters, scale manufacturing execution and process monitoring, and seamlessly track in-process data while automatically generating comprehensive electronic batch records.

Technologies

• DataBricks
• PySpark
• SparkSQL
• SQL

What You'll Do

• Design, build, and maintain data pipelines using Databricks and Delta Live Tables for real-time and batch data processing;
• Collaborate with cross-functional teams to ensure smooth data flow from diverse log-based sources;
• Participate in both individual and collaborative work, ensuring scalability, reliability, and performance of data solutions;
• Define and implement best practices for data development and deployment processes on the Databricks platform;
• Proactively address technical challenges in a project environment, proposing and implementing effective solutions;

Job Requirements

• 5+ years of experience in Data Engineering with strong technical expertise;
• Proven hands-on experience with the Databricks Data Platform and Delta Lake;
• Experience building and managing Databricks Lakehouse solutions;
• Knowledge of Delta Live Tables or similar frameworks for real-time data ingestion is a strong plus;
• Ability to define processes from scratch and establish development workflows in a new or evolving team;
• Familiarity with data testing best practices and collaboration with QA teams to ensure data quality;
• Strong problem-solving mindset, initiative, and readiness to work in a dynamic, evolving environment;
• Ability to work with a time shift, ensuring overlap with the client until approximately 10:30 AM Pacific Time for meetings and collaboration.
• English level: Upper-Intermediate (written and spoken);

What Do We Offer

The global benefits package includes:

• Technical and non-technical training for professional and personal growth;
• Internal conferences and meetups to learn from industry experts;
• Support and mentorship from an experienced employee to help you professional grow and development;
• Internal startup incubator;
• Health insurance;
• English courses;
• Sports activities to promote a healthy lifestyle;
• Flexible work options, including remote and hybrid opportunities;
• Referral program for bringing in new talent;
• Work anniversary program and additional vacation days.