🕒 5 days ago
Design and build scalable data pipelines using Python, Apache Spark, and Databricks, while modernizing legacy systems and ensuring data quality and reliability.
Databricks SME (R-00117)
📅 Jan 29
DatabricksApache SparkPythonPyspark
📜 Description
- Optimize data pipelines and clusters for cost and performance.
- Implement security protocols, including Unity Catalog, IAM, and data access controls.
- Advise engineering teams, mentor staff, and define technical roadmaps.
- Collaborate with data engineers and stakeholders to align solutions with business requirements.
- Design scalable data pipelines, data models, and Lakehouse architectures.
- Optimize Spark jobs, monitor system metrics, and troubleshoot Databricks environments.
🛠️ Requirements
- 3-5 years of experience in data engineering, data warehousing, or data architecture.
- Strong proficiency in Databricks, Apache Spark, Python/PySpark, and SQL.
- Experience with AWS (including S3 and Glue) or Azure; familiarity with AWS, Azure, or GCP data sources and services.
- Expertise in data modeling, data profiling, and ETL/ELT pipeline design.
- Experience implementing CI/CD pipelines, using Azure DevOps or Git, and automating routine tasks.
- US citizenship and ability to obtain and maintain a federal security clearance may be required.
- Bachelor's degree highly preferred.
Full job description
True Zero Technologies, a veteran-owned small business, was founded on the principle that the purposeful enablement of people and technology in an organization directly ties to the quality of its outcomes. True Zero recognizes that those outcomes begin and end with our people, and that is what we have built a community of like-minded, driven, and passionate individuals and innovators who are aligned in a common goal of delivering top-tier services to our customers. Our culture and commitment have been recognized through numerous accolades, including being named one of the Best Places to Work in 2023 in two categories (“Prosperous and Thriving” ($5MM–$50MM in gross revenue) and “Mid-Atlantic Region” (DC, DE, MD, NC, VA, WV)), and again in 2025 as a Best Places to Work honoree. In addition, True Zero earned coveted spots on the Inc. 5000 list of fastest-growing companies in America in 2022, 2023, and 2025, a testament to our sustained growth driven by our people-first approach and unwavering dedication to excellence.
Position Responsibilities
Position Qualifications
Similar jobs
Search more Data Engineer jobs
🕒 8 days ago
Build and optimize cloud-native data platforms and distributed pipelines for scientific research, analytics, and machine learning, with a focus on data quality, governance, reliability, and cost efficiency.
🕒 5 days ago
Build and maintain batch and streaming data pipelines, ETL workflows, and data warehouse solutions, improving data quality, reliability, and performance through Python, SQL, BigQuery, and Airflow.
🕒 7 days ago
Design and maintain scalable Azure Databricks data pipelines, strengthen data quality and monitoring, and use AI-assisted tools to automate code reviews, compliance checks, and routine engineering work.
Data Engineer (GCP, Snowflake, dbt)
🕒 yesterday
Addepto👥 51 - 200 employees🏢 Information Technology And Services
🕒 yesterday
Build and optimize cloud data pipelines, dbt models, and analytical datasets across data warehouse modernization, BI migrations, CRM integrations, and commercial analytics projects.