Senior Data Engineer - Data Engineering
Plaid👥 10,000+ employees🏢 Software Development
In this high-impact role, you will enable business leaders to make informed decisions by building and managing critical datasets and data pipelines.
Senior Data Engineer (Healthcare domain)
🕒 15 days ago
Cloud ComputingData AnalyticsData ModelingReporting Tools
📜 Description
- Collaborate with the Product Owner and team leads to define and design efficient pipelines and data schemas
- Build and maintain infrastructure using Terraform for cloud platforms
- Design and implement large-scale cloud data infrastructure, self-service tooling, and microservices
- Work with large datasets to optimize performance and ensure seamless data integration
- Develop and maintain squad-specific data architectures and pipelines following ETL and Data Lake principles
- Discover, analyze, and organize disparate data sources into clean, understandable schemas
🛠️ Requirements
- Hands-on experience with cloud computing services in data and analytics
- Experience with data modeling, reporting tools, data governance, and data warehousing
- Proficiency in Python and PySpark for distributed data processing
- Experience with Azure, Snowflake, and Databricks
- Experience with Docker and Kubernetes
- Knowledge of infrastructure as code (Terraform)
- Advanced SQL skills and familiarity with big data databases such as Snowflake, Redshift, etc.
- Experience with stream processing technologies such as Kafka, Spark Structured Streaming
Similar jobs
Search more Data Engineer jobs
Sr. Staff Data Scientist - Ads Measurement, Signals, Privacy
Reddit👥 1001 - 5000 employees🏢 Online Community/social Media
Lead the scientific strategy for Reddit's ads measurement and signal systems, focusing on innovation in privacy-aware measurement and causal inference methodologies.
Sr. Staff Data Scientist - Ads Measurement, Signals, Privacy
Reddit👥 1001 - 5000 employees🏢 Online Community/social Media
Lead the scientific strategy for Reddit's ads measurement and signal systems, focusing on innovation in privacy-aware measurement and causal inference methodologies.
Staff Data Scientist - Ads Measurement, Signals, Privacy
Reddit👥 1001 - 5000 employees🏢 Online Community/social Media
As a Staff Data Scientist on Reddit's Ads Data Science team, you'll lead initiatives in measurement, identity, and signal quality to enhance the advertiser experience.
Staff Data Scientist - Ads Measurement, Signals, Privacy
Reddit👥 1001 - 5000 employees🏢 Online Community/social Media
Reddit’s Ads Data Science team is looking for a highly experienced Staff Data Scientist to advance the intelligence powering the advertiser experience on Reddit.