Scale and advance data infrastructure by building reliable tooling, improving research and production workflows, guiding large engineering initiatives, and shaping the team's technical roadmap and developer experience.
Senior Data Platform Engineer
π Description
- Build complex, high-volume batch and near-real-time ingestion services while evolving the platform's streaming capabilities.
- Design and implement data solutions for application requirements in a distributed microservices environment.
- Develop and optimize large-scale data pipelines for batch and streaming use cases.
- Ensure data quality, compliance, and governance.
- Manage and optimize Kubernetes infrastructure, utilizing KEDA for dynamic resource scaling.
- Own the full lifecycle of our data stack using Terraform and Kubernetes.
π οΈ Requirements
- 5+ years of experience as a Data Platform/Infra Engineer
- Proven track record of building and operating scalable data infrastructure specifically within Data Lake architectures.
- Proven experience designing and operating large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA.
- Experience with Snowflake.
- Strong proficiency in Python and SQL.
- Hands-on experience with Infrastructure as Code, preferably Terraform.
- Experience with managing a data orchestration platform such as Airflow or Prefect
β¨ Benefits
- Comfortable environment, challenging tasks and a long-term interesting project;
- Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues).
- Covered 20 days of vacation;
- Working with top notch equipment;
- Bookkeeping by a professional accountant;
- Help and support from our caring HR-team;
Full job description
We are looking for a highly skilled Senior Data Platform Engineer to join our Data Platform team and play a key role in designing, building, and evolving the companyβs data infrastructure.
This is a hands-on engineering position focused on developing scalable data platforms, high-volume ingestion pipelines, and the foundational data systems that power analytics, product applications, AI workloads, and large-scale model execution. You will help architect our data lake, build reliable ingestion capabilities at scale, and shape the core infrastructure that supports the companyβs future growth.
This is an exciting opportunity to work with cutting-edge technologies and have a defining impact on the architecture and evolution of our data platform.
Requirements:
- 5+ years of experience as a Data Platform/Infra Engineer
- Proven track record of building and operating scalable data infrastructure specifically within Data Lake architectures.
- Proven experience designing and operating large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA.
- Experience with Snowflake.
- Strong proficiency in Python and SQL.
- Hands-on experience with Infrastructure as Code, preferably Terraform.
- Experience with managing a data orchestration platform such as Airflow or Prefect
Responsibilities:
- Build complex, high-volume batch and near-real-time ingestion services while helping evolve the platformβs streaming capabilities.
- Design and implement data solutions for all application requirements in a distributed microservices environment
- Develop and optimize large-scale data pipelines for batch and streaming use cases.
- Ensure data quality, compliance, and governance.
- Manage and optimize Kubernetes infrastructure, utilizing KEDA to dynamically scale resources for large-scale data processing workloads.
- Own the full lifecycle of our data stack using Terraform and Kubernetes, from provisioning to application-level frameworks.
- Provide technical guidance for the team, drive best practices around infrastructure, CI/CD, testing, and system design.
- Deep-dive into memory management and performance tuning to ensure our large-scale distributed systems are both cost-effective and lightning-fast.
What we offer:
- Comfortable environment, challenging tasks and a long-term interesting project;
- Mobilization reservation available upon successful completion of the probation period (for Ukrainian colleagues).
- Covered 20 days of vacation;
- Working with top notch equipment;
- Bookkeeping by a professional accountant;
- Help and support from our caring HR-team;
Similar jobs
Search more Data Engineer jobsSenior/Staff Software Engineer on the Data Engineering team, building scalable data systems and pipelines that support trading and research while leading complex projects and guiding the team's technical direction.
Design, build, and operate production data pipelines, search and retrieval systems, and LLM-powered features for learning experiences, with ownership of quality, reliability, security, and cost.
[VKS] Data Engineer (Mid/Senior)
Build and operate reliable data pipelines on GCP, develop SQL and dbt transformations in BigQuery, and improve production workflows using streaming and ingestion tools such as Kafka and Apache NiFi.
Build and scale reliable data pipelines, establish dbt standards and quality controls, and create self-service tools and AI agents that help teams access and use data independently.
