Design and implement specialized data collection infrastructure to support Centerfield's proprietary Data Architecture while troubleshooting and resolving technical issues.
Data Engineer GCP/ Dataform
📅 Jul 24
Google Cloud PlatformBigqueryDataformCloud Run
📜 Description
- Design, develop, and maintain data pipelines.
- Integrate and process information using GCP services.
- Work with BigQuery for data storage, transformation, and querying.
- Implement transformation and modeling processes using Dataform.
- Develop automated and orchestrated processes with Airflow.
- Utilize services like Cloud Run, Cloud Storage, and Cloud Functions for data solutions.
🛠️ Requirements
- Experience with Google Cloud Platform (GCP)
- Proficiency in BigQuery
- Knowledge of Dataform
- Familiarity with Cloud Run, Cloud Storage, and Cloud Functions
- Experience with Apache Airflow
- Advanced SQL skills preferred
- Strong Python skills preferred
- Experience with CI/CD processes and Git/GitHub
Full job description
Data Engineer – GCP
🚀 ¡Estamos buscando un Data Engineer!
Buscamos un Data Engineer con experiencia de más de 3 años en desarrollo y gestión de soluciones de datos sobre Google Cloud Platform (GCP), capaz de participar en la construcción, integración y optimización de pipelines de datos y procesos de ingeniería de datos.
🎯 ¿Qué harás?
🔹 Diseñar, desarrollar y mantener pipelines de datos.
🔹 Integrar y procesar información utilizando servicios de GCP.
🔹 Trabajar con BigQuery para almacenamiento, transformación y consulta de datos.
🔹 Implementar procesos de transformación y modelado utilizando Dataform.
🔹 Desarrollar procesos automatizados y orquestados mediante Airflow.
🔹 Utilizar servicios como Cloud Run, Cloud Storage y Cloud Functions para implementar soluciones de datos.
🔹 Participar en procesos de optimización, automatización y mejora continua de las soluciones de datos.
🔹 Aplicar buenas prácticas de desarrollo, control de versiones y CI/CD.
Similar jobs
Search more Data Engineer jobs
As a Data Engineer, you will build reliable data systems and pipelines that empower teams at Stake to make informed decisions and enhance operational efficiency.
As a Data Engineer, you will build and optimize data pipelines, support analytics tooling, and extend the machine learning platform while mentoring junior engineers.
Data Engineer
Sigmasoftware2👥 1001 - 5000 employees🏢 Computer Software
As a Data Engineer, you will design and maintain scalable ETL/ELT pipelines and optimize data processing solutions for a high-traffic E-commerce platform.
Data Developer - Robotics IS Data Platform
Fusionconsulting👥 201 - 500 employees🏢 Information Technology And Services
The Data Developer is responsible for designing and maintaining data integration and analytics solutions, ensuring reliable access to enterprise data and supporting business intelligence initiatives.