Note: The job is a remote job and is open to candidates in USA. Rex.zone is hiring remote, full-time Online Generalists to support AI/ML data operations across LLM training pipelines. The role involves performing data labeling, evaluation, and quality assurance to improve training data quality and reduce model errors.
Responsibilities
- Label and review text and image data to support LLM training pipelines
- Complete RLHF preference ranking and prompt-response evaluation using provided guidelines
- Perform QA evaluation for accuracy, consistency, and guideline adherence
- Apply content safety labeling and policy-based ratings for unsafe content detection
- Resolve edge cases, document decisions, and escalate issues through defined workflows
- Support NLP annotation (classification, summarization checks, named entity recognition)
- Support LLM evaluation (response ranking, prompt evaluation, RLHF evaluation)
- Support computer vision annotation (bounding boxes, segmentation, attribute tagging)
- Support QA operations (sampling plans, error taxonomies, reviewer calibration)
Skills
- Ability to follow detailed instructions and apply consistent judgment in a remote environment
- Strong written English and careful reading; able to explain labeling decisions clearly
- Comfort with web-based tools, spreadsheets, and task queues
- Experience with data labeling, RLHF, prompt evaluation, content moderation, or AI evaluation programs
- Familiarity with NLP, named entity recognition, or computer vision annotation
- Experience improving training data quality via error analysis, calibration, or guideline refinement
Company Overview
RemoExperts is a global platform where skilled professionals and tutors contribute to AI training across video, image, audio, text, code, math, and more. It was founded in 2025, and is headquartered in Palo Alto, California, US, with a workforce of 201-500 employees. Its website is https://www.remoexperts.com.