Remote Data Labeling Jobs in Ottawa
About Rex.zone
Rex.zone is hiring for remote data labeling jobs aligned to Ottawa job seekers supporting AI/ML training workflows. You will create and evaluate high-quality training data for large language models and computer vision systems, improving training data quality and model performance.
Rex.zone is hiring for remote data labeling jobs aligned to Ottawa job seekers supporting AI/ML training workflows. You will create and evaluate high-quality training data for large language models and computer vision systems, improving training data quality and model performance.
What You Will Do
- Label and review text, image, audio, or video data using project-specific annotation tools and taxonomies.
- Follow annotation guidelines compliance requirements and document edge cases for consistent decision-making.
- Complete RLHF tasks such as preference ranking, pairwise comparisons, and rubric-based scoring for LLM outputs.
- Perform prompt evaluation and response grading for helpfulness, correctness, and safety.
- Execute QA evaluation by auditing samples, measuring inter-annotator agreement, and escalating ambiguity.
- Apply named entity recognition (NER) labels and structured extraction schemas for NLP datasets.
- Support computer vision annotation (bounding boxes, segmentation masks, keypoints) when assigned.
- Contribute to content safety labeling for policy categories (hate, harassment, self-harm, sexual content) as required.
- Provide feedback to improve guidelines, reduce ambiguity, and increase throughput without sacrificing quality.
Required Qualifications
- Mid-Senior experience with data labeling or data annotation in AI/ML production settings.
- Experience with LLM evaluation workflows (RLHF, prompt evaluation, or QA evaluation).
- Strong written communication and structured reasoning for labeling rationale and dispute resolution.
- Comfort working remotely with asynchronous collaboration, quality targets, and audit-driven processes.
Compensation
Hourly base pay range: $30–$50/hr (USD).
