As a Data Scientist, you will develop data-driven insights and applications to support strategic decision-making, utilizing statistical and machine learning models in a fast-paced environment.
People Research Data Scientist, AI Fairness & Bias
🕒 4 days ago
Algorithmic FairnessBias MeasurementResponsible AIPsychometrics
📜 Description
- Define and lead fairness and bias-testing strategies for AI-assisted People processes, models, agents, and decision-support systems.
- Design rigorous algorithmic audits and validation studies, including adverse-impact analysis and error-rate analysis.
- Evaluate end-to-end human-AI decision systems, examining model outputs and user behavior.
- Develop evaluation approaches for generative and agentic AI, including counterfactual testing and behavioral evaluation.
- Investigate sources of observed disparities, including data representation and model design.
- Partner with various teams to recommend and evaluate mitigations for bias.
🛠️ Requirements
- Experience conducting fairness assessments, algorithmic audits, or validation studies in high-impact domains.
- Familiarity with fairness and model-evaluation tools such as Fairlearn and AI Fairness 360.
- Experience evaluating large language models or generative AI systems.
- Experience with employment selection, talent assessment, or psychometrics.
- Familiarity with responsible-AI frameworks and data privacy requirements.
- Experience creating model cards, dataset documentation, or audit reports.
- Advanced degree in Quantitative Psychology, Computer Science, Statistics, or a related field; PhD preferred.
Similar jobs
Search more Data Scientist jobs
As a Data Scientist at Asana, you’ll help us ask the right questions and answer them rigorously. You’ll work closely with our Pro duct and Business teams to understand their goals and proactively inform their direction with data.
Data Scientist, Decisions - Central Market Management
Lyft👥 10,000+ employees🏢 Transportation
As a Data Scientist on the Central Market Management team, you'll lead initiatives to enhance decision-making quality through data analysis and cross-functional collaboration.
Data Scientist, Decisions - Central Market Management
Lyft👥 10,000+ employees🏢 Transportation
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive.
Data Scientist - Algorithms, Mapping
Lyft👥 10,000+ employees🏢 Transportation
As a Data Scientist on the Mapping team, you will enhance route recommendations and travel time accuracy by leveraging geospatial and mobility data to build a top-tier mapping product.