Build and operate secure, governed data-sharing infrastructure for publisher partners, using Terraform, Databricks, and AWS to automate provisioning, compliance controls, data exchange, and platform reliability.
Data Software Engineer
📜 Description
- Design, develop, and maintain high-throughput data pipelines across the ecosystem.
- Model data and design schemas using DDL and DML for performance and scalability.
- Implement automated testing, CI/CD pipelines, and Terraform-based infrastructure.
- Partner with Data Science and AI teams to build feature stores and production MLOps pipelines.
- Monitor containerized and orchestrated environments, including Kubernetes, Docker, and Airflow.
- Advise stakeholders and explain data architectures in clear, non-technical terms.
🛠️ Requirements
- 4+ years of professional software engineering experience, with a proven track record of building and maintaining production-grade data systems.
- Deep Data Architecture expertise, with the ability to design modern data stack components and schemas that balance immediate performance with future growth.
- Proficiency in Infrastructure as Code, specifically using Terraform to manage and deploy your own infrastructure.
- A high level of software rigor, including a strong background in automated testing, CI/CD, and general software engineering best practices
- Expert-level SQL skills (particularly MySQL), with a focus on optimizing complex queries for maximum performance.
- Experience in a modern technical environment, ideally having worked with Python, AWS (S3, Aurora, RDS), Snowflake, Apache Spark, and DBT
- Exceptional communication skills, with the talent to distill complex technical concepts into clear, actionable insights for both technical and non-technical peers
✨ Benefits
- Medical benefits paid 100% for employees and 50% for dependents.
- Dental benefits paid 100% for employees and 50% for dependents.
- Vision expense reimbursements.
- Complimentary telehealth services.
- Free Calm subscription.
- LinkedIn Learning and professional development programs.
- Paid time off.
- Pension scheme with matching up to 1.5% of employee contributions.
Full job description
What your day could consist of:
Technical environment:
The Ideal Candidate Will Bring:
Similar jobs
Search more Data Engineer jobsOwn and scale the data pipelines and infrastructure powering Lexroom’s legal knowledge base and document processing, with a focus on security, reliability, data quality, and performance.
Build and maintain reliable data pipelines for QiCore, migrate acquired-business data into a shared warehouse and customer view, and support analytics, data quality, governance, and future platform migrations.
Desenvolve e mantém pipelines de dados, processos distribuídos e integrações, usando Python, SQL e Spark/PySpark para apoiar a qualidade, o desempenho e a evolução das soluções de dados.
Desenvolve pipelines e modelos de dados, cria dashboards e KPIs de TI e monitora a qualidade das informações, transformando dados de diferentes fontes em insights para apoiar decisões estratégicas.
