Build backend systems and large-scale data pipelines for Lyft Ads, supporting real-time ad serving, campaign management, analytics, targeting, and measurement in collaboration with product and data teams.
Data Engineer II
๐ Description
- Develop data pipelines and transformations for data production and consumption across the organisation.
- Ensure data is trusted and delivered in a timely, appropriate way to support business needs.
- Model raw data into consumable datasets for end users.
- Build and maintain feature pipelines and training and scoring workflows for predictive models in production.
- Support platform maintenance and collaborate with application teams on website data features.
- Use AI tools such as Amazon Bedrock for marketplace use cases and internal data self-service.
๐ ๏ธ Requirements
- At least 2 years of data engineering experience, including some exposure to machine learning in production.
- Hands-on experience with SQL, including DDL and DML, and Python.
- Experience with relational databases such as Redshift, Postgres, or MySQL.
- Experience with large-scale data warehousing and analytics on highly available, distributed systems.
- Collaborative spirit and growth mindset.
โจ Benefits
- 22 days of annual leave, 3 company days over Christmas, and four August Fridays off.
- Additional annual leave on each of the first four anniversaries, up to 26 days.
- Fully paid Irish Life Healthcare.
- 5% employer pension contribution through a contributory scheme.
- TaxSaver Commuter Scheme.
- Bike to Work Scheme.
- Personal development plan to support career growth.
Full job description
Whatโs the Opportunity
Weโre looking for a Data Engineer II to help us turn the vast amounts of data generated by Irelandโs leading online marketplaces - Daft.ie, DoneDeal.ie and Adverts.ie - into useful insight for our users and employees.
In this role, you will build processes to ingest, store and transform the data so that it can be used for reporting and insights, to power features on our websites including predictive models.
How youโll Create with Impact
Developing data pipelines and associated data transformations that support data production and consumption throughout the organisation
Ensuring our data is trusted by our data consumers, colleagues and partners and that we provide timely and appropriate data to support the business
Driving data modeling activities to simplify raw data into consumable data sets for end-users
Building and maintaining feature pipelines and training/scoring workflows for predictive models in production
Supporting the platform maintenance activities to ensure ongoing smooth operation
Collaborating with Daft and DoneDeal application development teams to provide the data needed for some data features for end users on our websites
Working with modern AI tooling such as Amazon Bedrock to power AI use cases on Daft and DoneDeal; and internal tooling for data self-serve
Similar jobs
Search more Data Engineer jobsBuild and operate end-to-end data pipelines and warehouse models that turn app events and marketing data into trusted analytics, while growing across a modern Google Cloud data platform.
Build and maintain reliable, secure data pipelines and platform systems, shaping data for analytics, data science, and operational use while collaborating across engineering, product, and business teams.
Build and maintain scalable, reliable data pipelines and platform systems, shaping data for analytics, data science, and operational use while collaborating across engineering, product, and data teams.
Build and operate healthcare data pipelines and core data models, writing production Python and SQL, resolving issues through root cause, and owning components from development through production support.
