Build and maintain scalable data pipelines, ETL/ELT processes, and orchestration systems that deliver reliable, usable data for business needs and support machine learning workflows.
Data Engineer
📜 Description
- Design, implement, and maintain robust, efficient, compliant data pipeline architecture.
- Automate manual processes, optimize data delivery, and redesign infrastructure for scalability.
- Build and maintain service-based architecture for publishing consumable data and information objects.
- Partner with data architects, analysts, and business and IT stakeholders to evolve the data environment and address data needs.
- Define best practices and frameworks for accurate, compliant, and secure data structures and integrations.
- Monitor, troubleshoot, and resolve data integration alerts and failures in an on-call rotation.
🛠️ Requirements
- 5 or more years of Data Engineering experience in an oversight capacity, including extensive Financial Services industry experience.
- Experience with Microsoft cloud technologies in a hybrid architecture and Microsoft Fabric, including pipelines, notebooks, Lakehouse/Warehouse concepts, and Medallion architecture.
- Advanced T-SQL and SQL skills, relational databases (preferably MS SQL Server), stored procedures, and end-to-end pipeline development.
- Experience with SSIS, Azure Integration Services, ActiveBatch, web services, API integrations, Python, and PowerShell.
- Knowledge of conceptual, logical, relational, dimensional, and multidimensional data modeling, metadata management, lineage, and compliance.
- Experience with Agile, DevOps, and DataOps practices, including source control, versioning, test automation, continuous integration, and automated deployment.
- Strong analytical skills for complex data pipelines, operational analysis, and identifying process improvements.
- Clear, professional communication and ability to work with technical and non-technical users; commitment to client confidentiality and data security.
✨ Benefits
- Medical, Dental and Vision
- Company 401(k)and ESOP contribution
- Generous sick
- Vacation
- Maternity/parental leave
- Paid holidays
- Professional Development Opportunities
- Tuition Reimbursement ($15,000 lifetime cap)
- Discounted personal insurance including home, auto and recreational vehicles
- Charitable gift-matching program
Full job description
Summary:
Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as monitoring, troubleshooting and performance tuning data flows used in the collection, integration, and provisioning of data. This role requires experience building data pipelines and optimizing entire data systems as well as greenfield opportunities. This role works alongside other software development teams, database architects, data analysts and end users on complex data initiatives, and ensures our data delivery architecture is consistent with best practices.
Company Overview:
D.A. Davidson Companies is an independent, employee-owned company with a rich history spanning 90 years. We are dedicated to conducting our business in accordance with the highest standards of integrity and ethics, while delivering outstanding service to our clients and coworkers. We support a friendly, open and adaptive culture, and encourage candid communication and productive collaboration across throughout the firm. Just as we work to improve our clients and employees’ well-being, we also work to strengthen local communities—and giving back is one of our core values.
Qualifications:
• 5 or more years of Data Engineering experience in an oversight capacity
• Extensive domain-specific experience in the Financial Services industry
• Experience with Microsoft cloud-based technologies in a hybrid architecture
• Advanced working TSQL knowledge and experience working with relational databases, query authoring, stored procedure development, end-to-end data pipeline development
• Experience performing operational analysis on internal and external data and processes to uncover failure points and identify opportunities for improvement
• Strong analytic skills related to working with complex, multi-layered data pipelines and dependent datasets
• Experience facilitating calls to capture end-user requirements with technical and non-technical users
• Holistic awareness of processes supporting data preparation, metadata, dependencies, lineages, compliance and workload management
• Understanding of data modeling concepts like:
o Conceptual data modeling
o Logical data modeling
o Relational data modeling
o Dimensional and multi-dimensional data modeling
• Understanding of meta-model and metadata management requirements
• Specific skills include:
o Extensive experience with SQL syntax
o Experience designing and implementing data structures and interfaces for applications and business processes
o Experience with Microsoft Fabric: pipelines, notebooks, Lakehouse/Warehouse concepts, and Medalion architecture
o Experience with relational database platforms: preferably MS SQL Server
o Experience with data pipeline tools such as: SSIS and Azure Integration Services
o Experience using orchestration tools such as: ActiveBatch
o Experience with web services and API integrations
o Experience with scripting languages such as: Python and Powershell
o Experience with Agile, DevOps and DataOps methods and technologies: Source Code Control, Versioning, Test Automation, Continuous Integration, Automated Deployment, Recoverability, Telemetry, etc.
• Commitment to maintain client confidentiality and data security
• Communicate in a clear and service-oriented manner; use appropriate, professional language and grammar to effectively exchange ideas and information
• Ability to proactively work with both external and internal clients; relate with others in a professional manner to accomplish work responsibilities and objectives
• Ability to maintain regular, predictable attendance
Job Responsibilities:
• Design, implement and maintain a robust, efficient and compliant data pipeline architecture
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build and maintain a service-based architecture for the publication of consumable data and information objects
• Work with data architects and data analysts to enhance and evolve the data environment
• Work with Business and IT stakeholders to assist with data-related technical issues and support their data and information requirements
• Define and develop frameworks, guidelines, best practices and examples to ensure data structures and integration processes are accurate, compliant and secure
• Facilitate the development and implementation of data quality standards, data protection standards and adoption requirements across the enterprise
• Define indicators of performance and quality metrics and ensure compliance with data related policies, standards, roles and responsibilities, and adoption requirements
• Work in an on-call rotation to monitor, troubleshoot and resolve data integration alerts and failures
What we offer:
Competitive salary plus excellent benefits and perks including, but not limited to:
• Medical, Dental and Vision
• Company 401(k)and ESOP contribution
• Generous sick, vacation, and maternity/parental leave
• Paid holidays
• Professional Development Opportunities
• Tuition Reimbursement ($15,000 lifetime cap)
• Discounted personal insurance including home, auto and recreational vehicles
• Charitable gift-matching program
• Davidson Day of Giving – Our tradition of positively impacting communities in which we live and work.
The potential base pay hiring range for this role is $73,500 – $117,900 annually. The compensation offered will be determined on a case-by-case basis considering a variety of factors including, but not limited to, the skills, relevant work experience, and geographic location of each specific candidate.
Similar jobs
Search more Data Engineer jobsEngenheiro de Dados (GCP/Databricks) Pleno
Constrói e mantém pipelines de dados escaláveis em GCP e Databricks, projetando arquiteturas Lakehouse e garantindo qualidade, performance e governança para apoiar decisões estratégicas.
Data Engineer (Azure, Fabric, Databricks)
Design and deliver client-facing data platforms with Microsoft Fabric and Databricks, building scalable lakehouse architectures, optimized pipelines, and semantic models that enable trusted reporting and self-service analytics.
Build and optimize ETL/ELT pipelines, data models, and cloud-based data platforms that support analytics and reporting, using Python, SQL, Spark, Databricks, Snowflake, and AWS.
Design, build, and maintain scalable data warehouse and lake solutions, developing reliable data pipelines and improving data quality and performance to support analytics and business decisions.
