Design and build scalable data pipelines using Python, Apache Spark, and Databricks, while modernizing legacy systems and ensuring data quality and reliability.
Data Engineer
π Description
- Design and implement batch processing pipelines using Spark (Python or Scala) and SQL.
- Design and implement streaming ETL/ELT processes from diverse data sources.
- Write code for big data solutions, implementing data integration and analytic use cases.
- Design and implement APIs using modern Python frameworks.
- Communicate effectively with Business Analysis teams to align with business requirements.
- Implement monitoring solutions for the data platform through alerts and dashboards.
π οΈ Requirements
- Bachelorβs degree in Computer Science or Software Engineering;
- Thorough knowledge of Apache Spark;
- Advanced knowledge of Python and Databases;
- Experience as a Data Engineer;
- Understanding Azure Data Lake Storage and Delta Live Tables;
- Fluency in verbal and written English.;
- Strong analytical skills, team and quality oriented;
- Keen to learn and grow as a data engineer.
- Experience with Databricks;
- Experience in API development with fast-api;
β¨ Benefits
- Competitive full-time salary;
- Private Health Coverage on the Companyβs group program;
- Flexible Working Hours;
- Top-of-the-Line Tools;
- Professional Development: Benefit from language courses
- Specialized training
- Continuous learning opportunities
- Career Growth: Work with some of the most innovative and exciting specialists in the industry;
- Dynamic Work Environment: Thrive in a setting that offers challenging goals, autonomy, and mentoring, fostering both personal and company growth.
Full job description
Are you ready to take your career to the next level? Join our expanding development teams in Athens, or work remotely as a Data Engineer. As part of our agile team, you'll play a key role in designing and implementing big data solutions on a scalable cloud platform, analyzing millions of real-life and real-time data points to derive advanced insights and enhance analytics capabilities for end users.
What You'll Do:
- Design and implement batch processing pipelines using Spark (Python or Scala) and SQL;
- Design and Implement streaming ETL/ELT processes from a diverse set of data sources;
- Write code supporting the development of big data solutions, implementing complete data integration or analytic use cases;
- Design and implement APIs in any modern Python API framework;
- Communicate effectively with our Business Analysis teams to ensure alignment with business requirements;
- Write representative end-to-end and functional tests using open-source tools;
- Implement monitoring solutions for our data platform through alerts and dashboards.
Requirements
Must-Have Qualifications:
- Bachelorβs degree in Computer Science or Software Engineering;
- Thorough knowledge of Apache Spark;
- Advanced knowledge of Python and Databases;
- Experience as a Data Engineer;
- Understanding Azure Data Lake Storage and Delta Live Tables;
- Fluency in verbal and written English.;
- Strong analytical skills, team and quality oriented;
- Keen to learn and grow as a data engineer.
Nice-to-Have Qualifications:
- Experience with Databricks;
- Experience in API development with fast-api;
- Experience with cloud platforms (AWS, Azure, GCP, etc.);
- Experience with Docker.
Benefits
We believe in rewarding talent and dedication. Here's what you can expect as part of our team:
- Competitive full-time salary;
- Private Health Coverage on the Companyβs group program;
- Flexible Working Hours;
- Top-of-the-Line Tools;
- Professional Development: Benefit from language courses, specialized training, and continuous learning opportunities;
- Career Growth: Work with some of the most innovative and exciting specialists in the industry;
- Dynamic Work Environment: Thrive in a setting that offers challenging goals, autonomy, and mentoring, fostering both personal and company growth.
If you want an exciting challenge, work with some of the coolest technologies, and enjoy your time doing it, then join us! Submit your detailed CV in English, quoting reference: (SDE/10/26).
You may also consider all our other open vacancies by visiting the career section of our website (www.eurodyn.com) and follow us on Twitter (@EURODYN_Careers) and LinkedIn.
EUROPEAN DYNAMICS (ED) (www.eurodyn.com) is a leading European Software, Information, and Communication Technologies company, operating internationally (Athens, Brussels, Luxembourg, Copenhagen, Berlin, Stockholm, London, Nicosia, Valetta, Vienna, Den Haag, Hong Kong, etc.) The company employs over 1100 engineers, IT experts, and consultants (around 3% PhD, 41% MSc, and 54% BSc). We design and develop software applications using integrated, state-of-the-art technology. Our current IT projects have a value exceeding 300 million EURO. EUROPEAN DYNAMICS is a renowned supplier of IT services to European Union Institutions, international organizations, European Agencies, and national government Administrations in 40 countries and 4 continents.
As part of our dedication to the diversity of our workforce, we are committed to Equal Employment Opportunity without regard for race, colour, national origin, ethnicity, gender, disability, sexual orientation, gender identity, or religion.
EUROPEAN DYNAMICS (ED) adheres to the General Data Protection Regulation principles by applying its Privacy Policy as published at www.eurodyn.com/privacy. By submitting an application to this position and by sharing your personal data with ED, you acknowledge and accept its Policy and authorize ED to process your personal data for the purposes of the company's recruitment opportunities, in line with the Policy.
Similar jobs
Search more Data Engineer jobsAs a Data Engineer in the Tax Care team, you will design and maintain data pipelines, migrate platforms, and ensure data integrity for accounting and tax processes.
The Data Engineer will design, develop, and optimize data engineering solutions to ensure reliable information integration and availability for analytical and operational initiatives.
Data Engineer Middle
Design, develop, and maintain data engineering solutions to ensure reliable information integration and processing for analytical and business initiatives.
Engenheiro de Dados - Pleno
As a Data Engineer, you will design, implement, and optimize ETL pipelines, manage cloud functions, and ensure data quality and observability.
