🕒 4 days ago
Design and operate scalable data infrastructure for athlete performance and sensor data, including streaming ingestion, time-series and graph architectures, and reliable foundations for machine learning and AI evaluation.
1155 | Senior Data Ingestion Engineer
🕒 5 days ago
PythonSQLAWSAmazon S3
📜 Description
- Process PDFs, scans, emails, Word, Excel, and PowerPoint files using OCR and document extraction.
- Clean and normalize text, extract and tag metadata, and validate extraction results.
- Prepare documents for AI solutions through semantic chunking, vector storage, and RAG workflows.
- Integrate document sources such as SharePoint and email, and monitor pipeline errors.
🛠️ Requirements
- At least 7 years of experience as Data Engineer with Python and SQL
- At least 5 with AWS, the rest should be more or less but should be real experience that the candidate is able to talk about and give a concrete example/
- English Level C1
- Duration of the mission : 1 year
✨ Benefits
- Design and implement scalable ingestion pipelines for high-volume structured and unstructured insurance documents.
Full job description
The Data/Ingestion Engineer will design and implement scalable ingestion pipelines for high-volume structured and unstructured insurance documents, including PDFs, scans, emails, Word, Excel and PowerPoint files.
The role includes OCR/document extraction, text cleaning and normalization, semantic chunking, metadata tagging, vector storage/RAG preparation, validation, monitoring and integration with downstream AI solutions.
Requirements
- At least 7 years of experience as Data Engineer with Python and SQL
- At least 5 with AWS, the rest should be more or less but should be real experience that the candidate is able to talk about and give a concrete example/
- Must to have :
- Python
- SQL
- AWS
- S3
- Step Functions
- CloudWatch
- Data/document ingestion pipelines
- Processing of unstructured documents:
- scanned documents
- Word
- Excel
- PowerPoint
- emails
- OCR / document extraction technologies
- AWS Textract or equivalent
- Connectors/integrations with sources such as:
- SharePoint
- Text cleaning and normalization
- Metadata extraction/tagging
- Automated error monitoring
- Validation of OCR/extraction results
- Git
- CI/CD
- Testing
- Public-cloud data processing/document ingestion experience
- Good to have :
- Vector databases
- RAG
- Semantic chunking
- Vector-storage schema design
- Retrieval mechanisms
- Azure
- Databricks
- AWS Textract specifically
- Experience within insurance / financial services
- Experience handling enterprise security and low-latency SLA requirements
- English Level C1
- Duration of the mission : 1 year
Similar jobs
Search more Data Engineer jobs
🕒 2 days ago
Own the end-to-end data platform, designing multi-source ingestion, event-driven processing, and orchestrated workflows that deliver reliable, current data for downstream products.
🕒 3 days ago
Projeta, implementa e mantém pipelines de dados escaláveis na AWS, garantindo qualidade, integridade e segurança, otimizando processos de ETL e colaborando com equipes de dados, engenharia e negócios.
[C3A] Senior Data Platform Engineer (Microsoft Fabric)
🕒 3 days ago
Software Mind👥 501 - 1000 employees🏢 Information Technology And Services
🕒 3 days ago
Own the end-to-end Microsoft Fabric medallion data architecture for a risk analysis platform, building Delta pipelines, feature engineering, Gold risk tables, and Direct Lake models while optimizing performance and reliability.
🕒 3 days ago
Designs and operates reliable data pipelines and models that power customer-facing application features and shared analytics, partnering with engineering and product teams to deliver secure, accurate, accessible data.