Remote Jobs RockRemote Jobs Rock

Data Engineer (AWS)

📅 Nov 15, 2024
AWSPythonPysparkApache Spark
Apply Now

📜 Description

  • Design, build, and maintain AWS data pipelines for ingestion, transformation, and curation.
  • Process and decode large-scale vehicle signals and telemetry into analytics-ready datasets.
  • Assemble complex datasets that meet business and analytics requirements.
  • Implement ETL/ELT infrastructure using Python, PySpark, SQL, and AWS big data services.
  • Build analytics tooling and deliver actionable business insights.
  • Own architecture decisions and align data delivery with business stakeholders and international teams.

🛠️ Requirements

  • 5+ years of hands-on Data Engineer or Software Engineer experience in big-data environments.
  • Strong production-grade Python skills.
  • Experience with PySpark/Spark and distributed processing; production experience expected for senior profiles.
  • Hands-on experience with AWS S3, Glue, Athena, Lambda, and IAM.
  • SQL skills including complex queries, optimization, and data modeling.
  • Proven experience building and operating ETL pipelines.
  • Knowledge of Data Lake, Data Warehouse, and RDS architectures.
  • Fluent written and spoken English.

✨ Benefits

  • 1200€ to equip your home office
  • Flex allowance: 720€/year (60€ per month x12)
  • Performance bonus
  • Health insurance extendable to your household
  • Wellbeing program extendable to your household
  • Life insurance
  • Pension fund
  • Smartphone & phone data plan
Full job description

We're looking for Data Engineers to join our team in Lisbon, hiring multiple experience positions, from graduate to senior.

You'll design and operate production-grade data pipelines on AWS, working with vehicle data at massive scale (datasets in the order of multiple terabytes) that power analytics and decision-making across the business.

This role involves working with vehicle signals and telemetry data into structured, analytics-ready datasets — a unique technical challenge that combines distributed processing, domain knowledge and engineering rigor.

You'll own architecture decisions, collaborate with international stakeholders (including German teams), and contribute to a mature data platform

You’ll be focused in
• Designing, building and maintaining data pipeline architecture on AWS for ingestion, transformation and curation
• Processing and decoding large-scale vehicle datasets (multi-terabyte) — raw signals and telemetry transformed into ready-to-use analytics data
• Assembling large, complex datasets meeting business and analytics requirements
• Implementing ETL/ELT infrastructure using Python, PySpark, SQL and AWS big data services
• Building analytics tooling on top of these pipelines to deliver actionable business insights
• Working at scale - getting data into a ready-to-use state in close alignment with business stakeholders
In order to succeed, you’ll need
• +5 years of hands-on experience as a Data Engineer or Software Engineer working on big-data environments
• Strong Python — production-grade, not scripting
• PySpark / Spark — real experience with distributed processing (academic exposure acceptable for junior profiles; production experience expected for senior)
• AWS core stack: S3, Glue, Athena, Lambda, IAM — hands-on experience
• SQL — comfortable with complex queries, optimization and data modeling
• ETL pipelines — proven experience building and operating them
• Knowledge of Data Lake, Data Warehouse and RDS architectures
• Fluent English, written and spoken (you'll work daily with international teams)
Nice to have
• Experience in the automotive sector or working with vehicle/telemetry data
• IaC: AWS CDK, Terraform, or equivalent
• CI/CD pipelines (GitHub Actions, GitLab CI)
• SQS, SNS, EventBridge, Step Functions
• Experience with Apache Iceberg or Hive — or strong willingness to learn Iceberg
• Experience working with large-scale datasets (TB-scale
Company benefits • 1200€ to equip your home office • Flex allowance: 720€/year (60€ per month x12) • Performance bonus • Health insurance extendable to your household • Wellbeing program extendable to your household • Life insurance • Pension fund • Smartphone & phone data plan • Discounts on VW Group cars and special financing conditions Cool things you’ll experience in our work environment • Tailored remote-friendly setup for every team's vibe! • Flexible working hours • Multicultural reality with + 30 different nationalities • Pet friendly environment • Boost your career with our internal mobility program, focused on your personal & professional growth • Mix and mingle across teams for idea-sharing and bonding   About VW Group Digital Solutions [Portugal] Technology-driven trends such as diverse mobility, electrification and connectivity will revolutionize the mobility industry in the next decade. Volkswagen Group, as world leader in the automotive industry, is setting the pace for this revolution.   At Volkswagen Group Digital Solutions [Portugal] we are the go-to team to tackle complex systems and programming challenges. We make sure that our products flow smoothly in all stages of the digital value chain.   Our main areas of focus: vehicle software & operations, mobile online services, IT security, fleet management, sales & after sales, purchasing & logistics and product portfolio management.   Ready to #ExploreNewRoads? Join us! 🚗
SD Solutions

SaaS e-commerce Client #3 | Senior MLOps Engineer (Data & ML Platform)

🕒 3 days ago
SD Solutions👥 201 - 500 employees🏢 Staffing And Recruiting

Own production data pipelines and platform workflows powering an offer-ranking model, from onboarding raw sources and building training features to monitoring data quality and deploying reliable, cost-aware pipelines.

SparkDatabricksSnowflakeSQL

Trusted by Remote Workers