🕒 7 days ago
As a Fraud Data Analyst, you will monitor threats, investigate alerts, and collaborate with teams to enhance security and customer satisfaction in payment processes.
MSR Project - Chinese Culture Expert
🕒 14 days ago
ResearchSource VerificationCritical ThinkingQuality Assurance
📜 Description
- Create and test search queries to identify realistic cases where AI responses are inadequate.
- Document failures involving local relevance, source quality, outdated information, language mismatches, incomplete answers, or regional inapplicability.
- Write instructions and evaluation criteria for correct answers.
- Test multiple queries when needed to find failures.
🛠️ Requirements
- Find and verify information across multiple sources, websites, databases, and documentation.
- Identify contradictions, outdated information, and information that does not apply to a specific locale or context.
- Notice language nuances, local variations, and edge cases.
- Be comfortable iterating and testing through trial and error.
- Experience in research, quality assurance, compliance, or similar precision-focused work is ideal.
- Write clear instructions and evaluation rubrics.
- Bring deep familiarity with local regulations, business practices, and cultural nuances.
Full job description
Overview
Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Chinese-speaking experts to join our team.
What you will do:
Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.
Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.
Project Details:
- Start Date: ASAP
- Duration: Ongoing Project.
- Commitment: 20 hours per week.
- Job Type: Freelance contract.
- Location: Remote, Australia
- Rate: $40 per hour.
Requirements:
- Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
- Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
- Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
- Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial- and-error
- Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
- Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures
Similar jobs
Search more Data Analyst jobs
🕒 yesterday
Build and maintain BigQuery data models, marketing and sales pipelines, and Looker Studio reporting while investigating discrepancies, improving data quality, and explaining metrics to business teams.
HB Coding Strategic Data Analyst (Remote - Must reside in IL, IN, IA, MO, or WI)
🕒 3 days ago
Northwestern Medicine👥 10,000+ employees🏢 Hospital & Health Care
🕒 3 days ago
Transforms hospital billing coding and revenue-cycle data into actionable insights, developing analytics and reporting that help coding leaders improve performance, compliance, workflows, and strategic decisions.
Analista de Dados e BI Pleno (Python/SQL - Remoto)
🕒 3 days ago
Looqbox👥 11 - 50 employees🏢 Computer Software
🕒 3 days ago
As a Data and BI Analyst, you will bridge data and client decisions by implementing dashboards, conducting analyses, and ensuring data-driven insights for business strategies.
🕒 4 days ago
Analyze marketing, product, payment, and subscription data to uncover growth opportunities, explain product metrics and user behavior, and deliver insights, reports, and dashboards that guide business decisions.