Remote | German Audio Generalist Evaluator Expert — $50/hr Job at 24-MAG, San Francisco, CA

L2hnTnprU2UyencyTWxMald0bzk2OGxVeXc9PQ==
  • 24-MAG
  • San Francisco, CA

Job Description

We are sharing a specialised part-time consulting opportunity for German language experts with strong transcription, evaluation, and analytical writing skills.

This role supports collaborations with a leading AI research laboratory working to improve advanced language models through audio transcription, annotation, benchmarking, and evaluation workflows in German.

Selected professionals will help transcribe and analyse audio and video content, develop evaluation rubrics, assess model outputs, and contribute to improving the overall quality and reliability of multilingual AI systems.

Key Responsibilities

Professionals in this role may contribute to:

Audio Transcription & Content Analysis
Listen to, analyse, and transcribe audio and video content in German following detailed constraints and instructions
Produce high-quality written outputs in German, with supporting work in English when required
Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines
Capture nuances such as tone, intent, and regional variations, including High German and dialectal influences, where relevant

Evaluation Standards & Documentation
Establish clear expectations for correct and high-quality responses in general consumer audio contexts
Develop detailed evaluation rubrics and grading guidelines in German and English
Document standards to ensure consistency across reviewers and model evaluations
Identify linguistic nuances, formal versus informal register distinctions, and edge cases specific to German

Model Testing & Grading
Run prompts through language models and assess generated outputs
Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity
Provide structured feedback to improve model performance in German audio tasks

Benchmarking & Quality Assurance
Participate in quality assurance and review cycles to ensure tasks, rubrics, and outputs meet project standards
Maintain consistency and reliability before datasets are integrated into official benchmarks
Collaborate with project leads to resolve ambiguities and improve task design

Ideal Profile

Strong candidates may have:
Native or near-native fluency in German, both spoken and written, and professional fluency in English
Strong writing, editing, and critical thinking skills
Ability to accurately transcribe and analyse German audio content across general consumer contexts
Ability to work independently, manage time effectively, and meet deadlines
Availability to commit 10–20 hours per week
Strong attention to detail and ability to produce precise, well-structured written outputs

Preferred qualifications

College student or recent graduate
Background in linguistics, humanities, social sciences, journalism, or technical disciplines
Prior experience with transcription, annotation, localisation, evaluation, or research workflows in German
Familiarity with regional dialects such as Austrian German or Swiss German and register distinctions
Interest in AI, language models, or applied research environments

Why This Opportunity

Contribute directly to a high-impact audio AI research project
Gain hands-on exposure to real-world AI research and evaluation workflows
Help benchmark and improve advanced multilingual language models
Flexible remote work with clear tooling, structured guidelines, and competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Compensation of $50/hr
Typical commitment of 10–20 hours per week
Weekly payments via Stripe or Wise
Projects may be extended, shortened, or concluded early depending on project needs and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Please note: We are unable to support H1-B or STEM OPT candidates at this time
Location requirements: United Kingdom, United States, or Singapore

About the Platform

This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.

Experts contribute to improving advanced AI systems by providing specialised expertise in transcription, annotation, evaluation, multilingual quality assurance, and applied language research.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy:

Job Tags

Remote job, Weekly pay, Contract work, Part time, For contractors, 10 hours per week, Flexible hours

Similar Jobs

JJ EPC Pvt Ltd

Safety Officer Job at JJ EPC Pvt Ltd

# Ensure implementation of safety protocols, PPE usage, and risk control measures on site/factory # Conduct safety training and toolbox talks for workers and staff # Identify workplace hazards and conduct risk assessments # Monitor safety compliance as per statutory... 

Swatch

Full-Time Keyholder Job at Swatch

Swatch is seeking a Full-Time Keyholder for its Las Vegas location. This role involves overseeing store operations, achieving sales targets...  ...will have retail supervisory experience and strong leadership skills. Swatch offers a creative work environment and competitive benefits.

Novo Nordisk Inc.

Pharma Field Sales - Rare Blood Therapy Manager - Southeast Job at Novo Nordisk Inc.

About the Department The Rare Disease organization leads all US Commercial efforts for Novo Nordisk's Rare Disease portfolio. The Rare Disease portfolio includes medical treatments, customer solutions, and devices across multiple Therapy Areas including Rare Bleeding Disorders...

SD Guthrie Berhad

Process Engineer Job at SD Guthrie Berhad

 ...people, cost, knowledge, information, equipment, energy, material and process to create better management, low production costs and improve the quality of products. To liaise with Process Engineering, Production, Quality and Logistic team to ensure the volume and... 

Optimal Dispatch Service LLC

Hiring Nationwide Owner Operator Truck Driver - CDL-A Independent Contract Position (Remote) Job at Optimal Dispatch Service LLC

 ...Position Overview This role is designed for independent owner-operators who are prepared to operate across national freight lanes while...  ...responsibility for their equipment and performance. The position supports drivers who are focused on consistency, reliability, and professional...