Remote Jobs RockRemote Jobs Rock

Data Engineer (Data Engineering Team)

πŸ•’ 3 days ago
Data EngineeringData PipelinesETL ProcessesData Modeling
Apply Now

πŸ“œ Description

  • Design, develop, and maintain data pipelines that ingest, process, and deliver data from various sources.
  • Create and maintain data models to support reporting, analytics, and business intelligence needs.
  • Implement ETL processes to transform raw data into meaningful insights.
  • Monitor and address data quality issues and establish data governance practices.
  • Manage and optimize data storage, processing, and distribution systems.
  • Collaborate with data scientists and analysts to understand data requirements.

πŸ› οΈ Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
  • Minimum of 3 years of experience in data engineering or a related field.
  • Proven experience with Redshift and Snowflake.
  • Experience with DBT.
  • Experience with Apache Airflow for workflow orchestration.
  • Proficiency in Python for data pipeline development and scripting.
  • Experience with AWS cloud services, including S3, EC2, and EMR.
  • Familiarity with Kafka for real-time data streaming.
  • Familiarity with data visualization and reporting tools (e.g. Tableau, Power BI or Looker).
  • Project management skills using Jira or similar tools.
Full job description

We are a leading trading platform that is ambitiously expanding to the four corners of the globe. Our top-rated products have won prestigious industry awards for their cutting-edge technology and seamless client experience. We deliver only the best, so we are always in search of the best people to join our ever-growing talented team.

As a Data Engineer, you will play a crucial role in our data team, contributing to developing and maintaining data pipelines and systems. You will work closely with data scientists, analysts, and other stakeholders to ensure the availability and reliability of data for decision-making and analytics. Your responsibilities will encompass data ingestion, transformation, and delivery, as well as maintaining and optimizing data infrastructure.

The Data Engineer is expected to contribute to developing and maintaining data infrastructure, ensuring data reliability and availability. You should be able to work independently and as part of a team, adapting to changing data needs and collaborating with data professionals to provide valuable insights to the organization. Staying current with data engineering best practices and emerging technologies is essential for success in this role.

Responsibilities:

  • Design, develop, and maintain data pipelines that ingest process, and deliver data from various sources, ensuring data quality and reliability.
  • Data Modeling: Create and maintain data models to support reporting, analytics, and business intelligence needs, optimizing data structures for performance and efficiency.
  • Implement ETL processes to transform raw data into meaningful insights, handling data transformation, aggregation, and enrichment.
  • Monitor and address data quality issues, implement data validation processes, and establish data governance practices.
  • Manage and optimize data storage, processing, and distribution systems, ensuring scalability and performance.
  • Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Document data engineering processes, pipelines, and systems to maintain clear and accessible knowledge for team members.
  • Requirements:

  • Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
  • Minimum of 3 years of experience in data engineering or a related field.
  • Proven experience with Redshift and Snowflake.
  • Experience with DBT.
  • Experience with Apache Airflow for workflow orchestration.
  • Proficiency in Python for data pipeline development and scripting.
  • Experience with AWS cloud services, including S3, EC2, and EMR.
  • Familiarity with Kafka for real-time data streaming.
  • Familiarity with data visualization and reporting tools (e.g. Tableau, Power BI or Looker).
  • Project management skills using Jira or similar tools.
  • Ability to collaborate effectively with cross-functional teams and understand business data needs.
  • Strong problem-solving skills, a proactive approach to troubleshooting data issues, and critical thinking abilities.
  • Adaptable and open to learning new technologies and methodologies.
  • Afya

    Engenheiro de Dados Pleno (foco em Analytics)

    πŸ•’ 8 days ago
    AfyaπŸ‘₯ 1001 - 5000 employees🏒 Higher Education

    As a Mid-level Data Engineer, you will transform and model data, connecting business needs to reliable data sources ready for analysis within a multidisciplinary team.

    SQLPythonData ModelingData Structuring
    EUROPEAN DYNAMICS

    Data Engineer - Spark Developer

    πŸ•’ 3 days ago
    EUROPEAN DYNAMICS🏒 Technology

    As a Data Engineer - Spark Developer, you will design and improve data pipelines, utilizing Apache Spark and Azure services to create robust big data architectures.

    Apache SparkAzure DatabricksAzure Data FactoryService Bus

    Trusted by Remote Workers