Build and optimize production data pipelines on Databricks for enterprise customers, owning engagement components from ingestion and transformation through production quality, performance, and downstream analytics readiness.
Semi Senior / Senior Data Engineer (AWS, Python & SQL)
📜 Description
- Design, build, and maintain scalable data pipelines for analytics, ecommerce, logistics, and marketing.
- Improve and maintain the company's data infrastructure and tooling, including Redshift/Snowflake, Airflow, and Fivetran.
- Architect data processing systems capable of handling complex data flows and large-scale datasets.
- Develop reliable, efficient, and cost-effective data solutions in an AWS environment.
- Ensure high standards of data quality through automation and best engineering practices.
- Optimize platform performance, resiliency, scalability, and operational costs.
🛠️ Requirements
- 4+ years of experience as a Data Engineer working with modern data technologies.
- Strong proficiency in Python and SQL.
- Experience processing large-scale datasets.
- Hands-on experience with Apache Spark and Apache Airflow.
- Experience designing and architecting data processing systems in AWS.
- Experience with Redshift and/or Snowflake.
- Knowledge of Fivetran or similar data ingestion tools.
- Strong understanding of data quality, automation, and data engineering best practices.
- Excellent communication and interpersonal skills.
- Experience with streaming technologies such as Kafka or AWS Kinesis Firehose.
✨ Benefits
- A stable, long-term contract.
- Continuous training.
- Private health insurance.
- Flexible schedule.
- Flexible Paid Time Off (PTO) policy and paid holiday days.
Full job description
We are looking for a Senior Data Engineer to design, build, and optimize scalable data platforms that support analytics, ecommerce, logistics, and marketing initiatives. This role will be responsible for developing robust data pipelines, improving the data infrastructure, and ensuring high-quality, reliable data solutions in an AWS environment. The ideal candidate has strong expertise in Python, SQL, Spark, Airflow, and cloud-based data architectures, along with excellent communication skills and a collaborative mindset.
Responsibilities
- Design, build, and maintain scalable data pipelines for analytics, ecommerce, logistics, and marketing.
- Improve and maintain the company's data infrastructure and tooling, including Redshift/Snowflake, Airflow, and Fivetran.
- Architect data processing systems capable of handling complex data flows and large-scale datasets.
- Develop reliable, efficient, and cost-effective data solutions in an AWS environment.
- Ensure high standards of data quality through automation and best engineering practices.
- Optimize platform performance, resiliency, scalability, and operational costs.
- Collaborate closely with software engineers, analysts, and business stakeholders.
- Mentor engineers and analysts on data engineering best practices.
- Participate in architecture discussions and technical decision-making.
Requirements
Must Have
- 4+ years of experience as a Data Engineer working with modern data technologies.
- Strong proficiency in Python and SQL.
- Experience processing large-scale datasets.
- Hands-on experience with Apache Spark and Apache Airflow.
- Experience designing and architecting data processing systems in AWS.
- Experience with Redshift and/or Snowflake.
- Knowledge of Fivetran or similar data ingestion tools.
- Strong understanding of data quality, automation, and data engineering best practices.
- Excellent communication and interpersonal skills.
Nice to Have
- Experience with streaming technologies such as Kafka or AWS Kinesis Firehose.
- Knowledge of Docker and/or Kubernetes.
- Familiarity with Ruby or R.
- Experience building or migrating a Data Warehouse.
- Experience leading projects or mentoring technical teams.
Benefits
A stable, long-term contract. Continuous Training. Private Health insurance. Flexible schedule. Work with some of the most talented software engineers in Latin America and the US, doing challenging work and world-class software for clients in the US and around the world.
At Devsu, we believe in creating an environment where you can thrive both personally and professionally. By joining our team, you’ll enjoy:
• A stable, long-term contract with opportunities for career growth
• Private health insurance
• A remote-friendly culture that promotes work-life balance
• Continuous training, mentorship, and learning programs to keep you at the forefront of the industry
• Free access to AI training resources and state-of-the-art AI tools to elevate your daily work
• A flexible Paid Time Off (PTO) policy as well as paid holiday days
• Challenging, world-class software projects for clients in the US and LatAm
• Collaboration with some of the most talented software engineers in Latin America and the US, in a diverse work environment
Join Devsu and discover a workplace that values your growth, supports your well-being, and empowers you to make a global impact.
Similar jobs
Search more Data Engineer jobsSenior Data Engineer
Build and optimize petabyte-scale data pipelines and cloud data platforms, establish data quality and governance practices, and guide technical decisions while mentoring junior engineers.
Data Forward Deployed Engineer – Applied Data & ML Engineering
Own client-facing delivery of trusted enterprise data products and production ML models, transforming fragmented ERP, CRM, HCM, and finance data into validated, reusable solutions.
Design, build, and maintain reliable, scalable data pipelines and infrastructure, partnering with analysts and stakeholders to support analytics and business initiatives in banking.
Senior Engineer – Data Engineering (Databricks) - Contractor - India
Lead delivery of Databricks data engineering solutions, designing and optimizing scalable batch and streaming pipelines while contributing to data platform architecture and reusable solution accelerators.
