Remote Jobs RockRemote Jobs Rock

Staff Engineer, Big Data

πŸ“… Aug 30, 2023
Apache SparkAzure Data FactoryDatabricksAzure SQL Database
Apply Now

πŸ“œ Description

  • Lead and mentor a team of data engineers and operations specialists.
  • Collaborate with stakeholders to design scalable data architectures using Azure services.
  • Oversee the development of data pipelines, ETL/ELT processes, and data integrations.
  • Manage the day-to-day operation and maintenance of the Azure Data Platform.
  • Implement automation strategies and DevOps practices for efficient operations.

πŸ› οΈ Requirements

  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
  • Extensive experience in data engineering, data architecture, and cloud platform operations.
  • In-depth knowledge of Azure services such as Azure SQL Database and Azure Data Factory.
  • Proficiency in designing and optimizing data pipelines and ETL/ELT processes.
  • Strong understanding of data governance, security best practices, and compliance standards.
  • Hands-on experience with automation, infrastructure as code (IaC), and DevOps principles.
  • Excellent leadership and team management skills.
  • Azure certifications such as Microsoft Certified: Azure Solutions Architect Expert are desirable.
Full job description

Company Description

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale β€” across all devices and digital mediums, and our people exist everywhere in the world (15000+ experts across 26 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!

Job Description

Must have Skills : Apache Spark, Azure Data Factory, Databricks,

Job Description : Lead Consultant - Azure Data Platform Engineering & Ops
You will be responsible for architecting, implementing, and managing robust data solutions on the Microsoft Azure platform.

Responsibilities:

  • Technical Leadership: Lead and mentor a team of data engineers and operations specialists, providing technical guidance, fostering skill development, and promoting a culture of excellence.
  • Azure Data Architecture: Collaborate with stakeholders to design scalable and efficient data architectures using Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB.
  • Data Engineering: Oversee the development of data pipelines, ETL/ELT processes, and data integrations, ensuring data quality, optimal performance, and adherence to best practices.
  • Platform Operations: Manage the day-to-day operation and maintenance of the Azure Data Platform, including monitoring, troubleshooting, and performance optimization.
  • Automation and DevOps: Implement automation strategies and DevOps practices to streamline deployment, monitoring, and management of data solutions, ensuring efficient operations and rapid response to issues.
  • Data Security and Compliance, Capacity Planning and Scalability, Collaboration and Communication, Performance Monitoring and Optimization

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Extensive experience in data engineering, data architecture, and cloud platform operations, with a focus on the Microsoft Azure ecosystem.
  • In-depth knowledge of Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB.
  • Proficiency in designing and optimizing data pipelines, ETL/ELT processes, and data integrations.
  • Strong understanding of data governance, security best practices, and compliance standards in a cloud environment.
  • Hands-on experience with automation, infrastructure as code (IaC), and DevOps principles.
  • Excellent leadership and team management skills, with a proven ability to guide and inspire technical teams.
  • Azure certifications such as Microsoft Certified: Azure Solutions Architect Expert or equivalent are highly desirable.

Qualifications

Additional Information

Travoom

Principal AI translation architect 200 languages

πŸ•’ yesterday
TravoomπŸ‘₯ 1 - 10 employees🏒 Leisure, Travel & Tourism

Architect a conversational AI platform that understands user intent, orchestrates models and agents, retrieves and ranks live provider data, and guides users from discovery to transaction.

Large Language ModelsAI AgentsMulti-agent OrchestrationRetrieval-augmented Generation
Reddit

Lead Forward Deployed Engineer (AI Enablement)

πŸ•’ 3 days ago
RedditπŸ‘₯ 1001 - 5000 employees🏒 Online Community/social Media

Leads the strategy and hands-on delivery of applied AI workflows across business functions, turning ambiguous needs into reliable production capabilities while mentoring engineers and building reusable practices.

Applied AIAI AgentsLLMsMCP
1Password

Staff GTM Engineer

πŸ•’ 6 days ago
1PasswordπŸ‘₯ 10,000+ employees🏒 Computer And Network Security🀝 B2B

Design and scale AI-powered go-to-market workflows, integrations, and internal tools across sales, marketing, and Customer Success to improve efficiency, intelligence, customer experience, and cost to serve.

Go-to-market StrategyRevenue OperationsPythonSQL
Basis

Staff Software Engineer, AI

πŸ•’ 7 days ago
BasisπŸ‘₯ 11 - 50 employees🏒 Information Technology And Services

Leads the AI Core team’s technical direction and builds Compass, a production agent platform, owning multi-agent architecture, integrations, evaluation, reliability, and adoption of AI-assisted development across engineering.

PythonLLM-powered ApplicationsAgentic SystemsMulti-agent Architecture
Tiugotech

Staff / Senior Staff Software Engineer – AI Systems

πŸ•’ 9 days ago
TiugotechπŸ‘₯ 11 - 50 employees🏒 Computer Software

Drive the architecture and technical direction of backend AI systems, building reliable, scalable LLM-powered products from early experiments through production while shaping engineering practices.

TypeScriptNode.jsSoftware ArchitectureDistributed Systems

Trusted by Remote Workers