The Data Engineer will design, develop, and optimize data engineering solutions to ensure reliable information integration and availability for analytical and operational initiatives.
Data Engineer
📅 Aug 20
Data ArchitectureETLELTSQL
📜 Description
- Contribute to the design of scalable and secure data solutions.
- Develop and optimize efficient pipelines to ingest, transform, and load data.
- Analyze structured and unstructured data sources for ingestion and processing.
- Assist in building a robust data layer for batch and real-time processing.
- Implement strategies for validating and cleansing data.
- Write and optimize SQL queries for performance across large datasets.
🛠️ Requirements
- 4+ years of experience in data engineering or related roles.
- Strong knowledge of SQL, relational databases, and query optimization.
- Hands-on experience with ETL/ELT tools and cloud platforms (AWS, Azure, or GCP).
- Familiarity with data governance, security, and compliance frameworks.
- Solid understanding of batch and real-time data processing.
- Collaborative mindset with ability to work across technical and business teams.
Full job description
Key Responsibilities
- Data Architecture Design: Contribute to the design of scalable and secure data solutions, ensuring alignment with business and technical needs.
- ETL/ELT Pipeline Development: Develop and optimize efficient pipelines to ingest, transform, and load data from diverse sources into structured formats for analytics.
- Data Source Analysis: Analyze structured and unstructured data sources, recommending strategies for ingestion, processing, and classification.
- Data Layer Development: Assist in building a robust data layer that supports both batch and real-time processing.
- Data Ingestion & Cleansing: Implement strategies for validating and cleansing data to ensure quality and compliance with governance policies.
- Query Optimization: Write and optimize SQL queries to improve performance and efficiency across large datasets.
- Data Migration: Support migration projects from legacy systems to cloud platforms, ensuring accuracy and minimal downtime.
- Performance Monitoring: Monitor data workflows, troubleshoot bottlenecks, and propose improvements.
- Collaboration: Work closely with analysts, scientists, and business teams to translate requirements into data models.
- Data Governance & Security: Apply governance standards and security best practices, ensuring compliance with regulations (e.g., GDPR).
- Continuous Learning: Stay updated on emerging tools and practices, contributing to team innovation and improvement.
Qualifications
- 4+ years of experience in data engineering or related roles.
- Strong knowledge of SQL, relational databases, and query optimization.
- Hands-on experience with ETL/ELT tools and cloud platforms (AWS, Azure, or GCP).
- Familiarity with data governance, security, and compliance frameworks.
- Solid understanding of batch and real-time data processing.
- Collaborative mindset with ability to work across technical and business teams.
Similar jobs
Search more Data Engineer jobs🕒 3 days ago
🕒 3 days ago
Design, develop, and maintain data engineering solutions to ensure reliable information integration and processing for analytical and business initiatives.
🕒 3 days ago
Design and build scalable data pipelines using Python, Apache Spark, and Databricks, while modernizing legacy systems and ensuring data quality and reliability.
People Data Engineer - 100% Remote Job.
🕒 9 days ago
Bertoni Solutions👥 11 - 50 employees🏢 Information Technology And Services
🕒 9 days ago
The People Data & AI Readiness Engineer is responsible for building and maintaining the data architecture that supports people analytics and AI solutions, ensuring data quality and governance.
🕒 yesterday
As a Data Engineer, you'll design and implement big data solutions, focusing on batch and streaming ETL processes while collaborating with business analysis teams.
