LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

YS9MR2NUUUQycnpacG9qalhwM3ZqN08zelE9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Neighborhood LTC Pharmacy Inc

Pharmacist [Full Time & Part-time] Job at Neighborhood LTC Pharmacy Inc

 ...Time | 100% Employee-Owned (ESOP) WHY THIS ISN'T JUST ANOTHER PHARMACY JOB At Neighborhood LTC Pharmacy, you won't be counting by 5...  ...multidose medication cards with full-color MARs using AI assisted technology Clinical consultations with prescribers, nurses,... 

Sonepar

Safety Manager Job at Sonepar

 ... apply today! Stay connected with us follow our journey, job openings, and latest news on LinkedIn and Facebook . Manager of Safety Location: Houston, TX Coverage: Central South USA (TX, OK, AR, LA, MS, AL, TN, FL) Job type: Full time What You... 

Dairy Queen

Cake Decorator Job at Dairy Queen

 .... Exhibit and use good manners, proper personal hygiene, positive attitude, and promptness. Requirements: Prepare and decorate cakes according to assigned specifications including cakes for special orders and walk-in customers. Operates cake production area... 

The Abeel Firm PLLC

Family Law Paralegal Job at The Abeel Firm PLLC

 ...day one. Someone organized, dependable, and steady under pressure who takes real pride in doing the work well. This is not an entry-level or "learn as you go" role. We need a seasoned professional who already knows family law inside and out and is ready to be a key... 

ColumbiaCare Services

Residential Care Associate I - 5778 Job at ColumbiaCare Services

 ...Vision plansFlexible Spending AccountGenerous Paid Time OffWhole Health & Wellness Reimbursement ProgramProfessional development and training opportunities100% Vested Retirement Plan w/ up to 6% MatchHoliday Pay (9)Paid Time Off for Mental HealthCompany Paid Life...