🕒 3 days ago
Build and own marketplace data pipelines, entity-resolution systems, and pricing models that turn inconsistent sold-listing data into reliable comparable sales, estimates, and confidence signals.
Senior Data Engineer (Flink)
📅 Sep 17
Apache FlinkDatastream APIFlink SQLKafka
📜 Description
- Build and operate low-latency, high-volume real-time streaming pipelines.
- Develop streaming jobs with Apache Flink DataStream API and Flink SQL.
- Manage event-time processing, checkpoints, savepoints, and production state.
- Stream and model data for analytics and lakehouse use cases.
- Monitor pipeline health and recover jobs when failures occur.
🛠️ Requirements
- Strong hands-on experience with Apache Flink, including DataStream API and Flink SQL.
- Experience with high-volume Kafka streaming and real-time data processing.
- Strong knowledge of event time processing, checkpointing, savepoints, and state management.
- Experience with data modelling for analytics and streaming into a lakehouse.
- Experience monitoring pipeline health and handling job recovery and failures.
- Apache Iceberg or other open table formats.
- On premises or self managed cluster experience.
Full job description
Builds and runs real time streaming pipelines, keeping latency low and jobs recoverable at high
volume.
- Strong hands
on Apache Flink across DataStream API and Flink SQL. - Event time processing, checkpointing, savepoints, and state management in
production. - High volume Kafka streaming.
- Data modelling for analytics and streaming into a lakehouse.
- Monitors pipeline health and handles recovery when jobs fail.
Requirements
Requirements
pache Flink
(DataStream, Flink SQL), Kafka, Java, Scala, Python, SQL, Docker, Kubernetes
- Strong hands-on experience with Apache Flink, including DataStream API and Flink SQL.
- Experience with high-volume Kafka streaming and real-time data processing.
- Strong knowledge of event time processing, checkpointing, savepoints, and state management.
- Experience with data modelling for analytics and streaming into a lakehouse.
- Experience monitoring pipeline health and handling job recovery and failures.
- Apache Iceberg or other open table formats.
- Airflow.
- On premises or self managed cluster experience.
Similar jobs
Search more Data Engineer jobs
🕒 3 days ago
Extract, transform, and validate clinical and administrative data from ambulatory EHR/EMR systems, building governed data pipelines and audit-ready calculations for CMS MIPS and value-based care reporting.
Senior Technical Systems Analyst (Data Engineering & AWS)
🕒 4 days ago
Enroute👥 51 - 200 employees🏢 Information Technology And Services
🕒 4 days ago
Designs and maintains AWS data pipelines, models, and integrations while translating stakeholder needs into technical requirements and ensuring reliable, secure data across systems.
Semi Senior / Senior Data Engineer (AWS, Python & SQL)
🕒 4 days ago
Devsu👥 201 - 500 employees🏢 Computer Software
🕒 4 days ago
Design, build, and optimize scalable data platforms as a Senior Data Engineer, focusing on analytics, ecommerce, logistics, and marketing initiatives.
🕒 4 days ago
Own the end-to-end data platform, designing multi-source ingestion, event-driven processing, and orchestrated workflows while ensuring reliable storage, transformation, validation, and production operations.