🕒 2 days ago
Lead client data engineering engagements by designing AI-ready data platforms, production pipelines, and semantic layers that enable analytics, natural-language querying, and AI-powered workflows.
Lead Data Engineer
🕒 2 days ago
Data EngineeringDatabricksETL/ELTPython
📜 Description
- Provide technical direction, prioritize tasks, review code, and mentor engineers.
- Translate government stakeholder requirements into technical specifications, interface designs, and scalable data models.
- Architect, develop, and optimize high-throughput ETL/ELT workflows in Databricks.
- Maintain and improve Python and SQL codebases for performance, stability, and security.
- Diagnose pipeline bottlenecks and implement solutions that improve reliability and data integrity.
- Collaborate with product owners, data scientists, analysts, and technical peers; document pipeline architecture and configurations.
🛠️ Requirements
- Security Clearance: Must be a U.S. Citizen with a current, active U.S. Government Secret clearance. (Applicants without an active Secret clearance cannot be considered).
- Experience Level: Minimum of 8+ years of professional experience in data engineering, building enterprise-scale data platforms and pipelines.
- Technical Guidance: Demonstrated experience providing technical mentorship, performing code reviews, and providing day-to-day technical task oversight to other engineers.
- Databricks: Proven, hands-on experience designing and optimizing data transformation workflows in Databricks.
- Python/PySpark & SQL: Advanced skills in modular, object-oriented Python/PySpark scripting and extensive experience writing, tuning, and optimizing complex SQL queries.
- Data Visualization: Proven experience building functional, user-centric reports and dashboards using modern data visualization tools.
- Hands-on experience with Apache Spark and distributed computing frameworks.
- Familiarity with modern agile and DevOps tools such as GitLab Jira.
- Experience working with DoD, defense, or intelligence community data environments and compliance standards.
- Knowledge of data governance, metadata management, and data cataloging frameworks.
✨ Benefits
- Eligible employees may participate in comprehensive benefits programs.
- Eligible employees may receive performance-based or other incentive compensation.
Full job description
About the Organization
Now is a great time to join Redhorse Corporation. We are a solution-driven company delivering data insights and technology solutions to customers with missions critical to U.S. national interests. We’re looking for thoughtful, skilled professionals who thrive as trusted partners building technology-agnostic solutions and want to apply their talents supporting customers with difficult and important mission sets.
About the Role
Redhorse transforms the way government uses data and technology. To support this mission, we are seeking a Senior Data Engineer / Lead to join our team supporting the US National Defense Strategy. In this role, you will play a vital role in translating complex defense requirements into scalable data pipelines and actionable insights, directly contributing to the modernization of critical defense systems.
Key Responsibilities
Required Experience/Clearance
Desired Experience
We encourage all candidates who meet the basic requirements to apply, even if you do not have any of the following experience:
Similar jobs
Search more Data Engineer jobs
🕒 8 days ago
Defines enterprise data-platform architecture and engineering standards, leads complex system design and technical decisions, and builds reliable data products while mentoring engineers across teams.
🕒 15 days ago
Leads hands-on data engineering on Azure Databricks, setting Lakehouse standards and guiding teams to deliver secure, scalable, reliable pipelines across Medallion architecture layers.
🕒 16 days ago
The ideal candidate will build and maintain scalable data solutions in Databricks, focusing on data governance, audience activation, and marketing analytics.
Data Engineering Lead
🕒 4 days ago
Qualysoft👥 201 - 500 employees🏢 Information Technology And Services
🕒 4 days ago
Leads data engineering delivery and technical teams, designing and operating scalable Databricks-based platforms while advising enterprise customers on architecture, modernization, and solution design.