Design, build, and maintain production data pipelines and analytics-ready datasets, optimizing data quality, performance, and reliability while supporting reporting and business stakeholders.
Data Engineer (Clinical)
📜 Description
- Build ingestion pipelines for clinical protocols, regulatory documents, and published research, including PDF parsing and text extraction.
- Design relational and knowledge-graph data models for clinical trial entities and their relationships.
- Develop embedding and vectorization pipelines for RAG retrieval workflows.
- Build ETL/ELT workflows that transform unstructured clinical content into linked, queryable data.
- Create data-serving APIs and data-quality checks, and maintain lineage and audit trails for regulatory traceability.
- Analyze stakeholder needs, advise on data engineering practices, and help plan and prioritize engineering work.
🛠️ Requirements
- Build ingestion pipelines for clinical trial protocols, ICF documents, SmPCs, CSRs, and published articles (PubMed, CTIS, ClinicalTrials.gov) - handling PDF parsing, text extraction, and structured data normalization
- Design and implement data models in Amazon Aurora (relational) and GraphDB (knowledge graph) to represent trial design entities: endpoints, eligibility criteria, study arms, interventions, therapeutic areas, and their relationships
- Develop embedding and vectorization pipelines to prepare extracted clinical text for RAG-based retrieval in LangGraph agentic workflows - chunking strategies, metadata enrichment, and vector store population
- Build and maintain ETL/ELT workflows that transform unstructured clinical content into queryable, linked data across both relational and graph stores
- Implement data quality validation specific to clinical data - protocol section classification accuracy, entity extraction completeness, cross-reference integrity (NCT IDs, EudraCT numbers, MeSH terms)
- Build data serving APIs (Python/FastAPI) that expose curated datasets to the Angular frontend and LangGraph agent layer
- Set up data lineage tracking and audit trails to support regulatory traceability of AI-generated trial design recommendation
✨ Benefits
- Accrued vacation
- Medical insurance
- Dental insurance
- Vision insurance
- 401(k) with company matching
- Life insurance
- Flexible spending accounts
Full job description
Does the prospect of data management, cloud, and technology transformation to enable the biopharma industry to data-centric, AI/ML-driven enterprises excite you?
We are looking for motivated & self-driven data engineers to join our expanding Scientific Data Foundation team. Zifo serves the pharma & health industry to accelerate the discovery, development, and manufacturing of new drugs, therapies, and vaccines - to save lives faster!
This is an exciting opportunity to support pharmaceutical and biotech companies deploying innovative scientific R&D technologies globally. You will enable R&D Digital Transformation, design efficient data pipelines using the latest in Big Data Cloud Infrastructure and engineer new data analytics/visualization capabilities. You will empower our clients to build their future data landscape for data-driven decisions.
Requirements
- Build ingestion pipelines for clinical trial protocols, ICF documents, SmPCs, CSRs, and published articles (PubMed, CTIS, ClinicalTrials.gov) - handling PDF parsing, text extraction, and structured data normalization
- Design and implement data models in Amazon Aurora (relational) and GraphDB (knowledge graph) to represent trial design entities: endpoints, eligibility criteria, study arms, interventions, therapeutic areas, and their relationships
- Develop embedding and vectorization pipelines to prepare extracted clinical text for RAG-based retrieval in LangGraph agentic workflows - chunking strategies, metadata enrichment, and vector store population
- Build and maintain ETL/ELT workflows that transform unstructured clinical content into queryable, linked data across both relational and graph stores
- Implement data quality validation specific to clinical data - protocol section classification accuracy, entity extraction completeness, cross-reference integrity (NCT IDs, EudraCT numbers, MeSH terms)
- Build data serving APIs (Python/FastAPI) that expose curated datasets to the Angular frontend and LangGraph agent layer
- Set up data lineage tracking and audit trails to support regulatory traceability of AI-generated trial design recommendation
Required Skills
Responsibilities:
- Identify and analyze business needs to determine data related requirements,
- Clean, transform, and organize big data for analysis,
- Conduct data analysis to identify trends, patterns, and insights,
- Develop data visualization tools to communicate insights,
- Provide consulting inputs for guidelines, design ideas, standards, & best practices,
- Help stakeholders to estimate, plan, and prioritize data engineering efforts,
- Build relationship with clients, internal and partners’ leadership team, and
Required Skills:
- Expertise in Python, Spark, Java, Scala for building data pipelines, warehouses, and data processing systems,
- Expertise in relational databases like SQL & NoSQL,
- Strong understanding of NoSQL databases like MongoDB, Cassandra, and HBase,
- Familiarity with data standards such as FAIR, JSON, OWL and markup languages such YAML
- Understanding of AI/ML, data science concepts & cloud architecture
Qualifications:
- Bachelor’s or Master’s degree in data engineering / computer science or related field
- Experience with scientific informatics solutions OR background in biological science, chemistry, health sciences OR an experience working in the life or health science industry,
- Experience in cloud computing platforms like AWS, Azure, and Google Cloud Platform (GCP) for deploying and managing data infrastructure in the cloud.
- Experience using version control systems like Git for collaborative code development,
- Experience in data focused solutions such as Snowflake, Databricks, Kafka, Cloudera, Knime, Airflow, etc.
- Experience with AI/ML & data science libraries like Scikit-Learn, TensorFlow, PyTorch, HuggingFace, etc. for preparing data for downstream AI/ML applications,
- Familiarity with data visualization solution like Tableau, Power Bi and D3.js,
- Data engineering related certification from cloud platform like Azure/AWS/Cloudera, and
- Customer centricity to deliver at the highest standards and elevate customer experience.
- Expereince with Clinical Data is a plus.
Benefits
CURIOSITY DRIVEN, SCIENCE FOCUSED, EMPLOYEE BUILT. Our culture is unlike any other, one where we debate, challenge ourselves, and interact with all alike. We are a curious bunch, characterized by our passion to learn and spirit of teamwork. Zifo is a global R&D solutions provider focused on the industries of Pharma, Biotech, Manufacturing QC, Medical Devices, specialty chemicals and other research-based organizations. Our team’s knowledge of science and expertise in technology help Zifo better serve our customers around the globe, including 18 of the Top 20 Biopharma companies.
We look for Science – Biotechnology, Pharmaceutical Technology, Biomedical Engineering, Microbiology etc. We possess scientific and technical knowledge and bear professional and personal goals. While we have a “no doors” policy to promote free access within, we do have a tough door to walk in. We search with a two-point agenda – technical competency and cultural adaptability.
We offer a competitive compensation package including accrued vacation, medical, dental, vision, 401k with company matching, life insurance, and flexible spending accounts.
If you share these sentiments and are prepared for the atypical, then Zifo is your calling!
Zifo is an equal opportunity employer, and we value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Similar jobs
Search more Data Engineer jobsDesign, build, and operate scalable data platforms and pipelines that power campaign measurement, customer insights, reporting, and AI/ML initiatives for financial services products.
Data Engineer in FCP DVR team – GCP migration project (temporary contract)
Lead part of the FCP Data Visualization and Reporting team’s migration from on-premises to GCP, refactoring data pipelines and coordinating technical solutions, requirements, estimates, and project updates.
Data Engineer: Merchant Intelligence Agent
Build the data pipelines, analytics models, and quality systems that power merchant dashboards and an AI agent, turning e-commerce questions into trusted insights and product features.
Convert and validate Informatica pipelines in Maia (Matillion) and Snowflake, build reusable migration tools, optimize data workflows, and partner with technical leads and clients on testing and cutover readiness.
