28 DEC 2025 – 17 JUN 2026
AI Quality Analyst
iMerit Technologies · San Jose, California, United States (Remote)
Evaluated AI model outputs, benchmarked automated pipeline inferences, and verified multimodal datasets to maintain rigorous standards for generative AI reasoning.
- Conducted qualitative and quantitative audits of AI model responses against rigorous accuracy, factual consistency, and safety rubrics.
- Identified edge-case hallucinations and anomalous outputs in large language model pipelines, documenting failure modes for engineering teams.
- Annotated and labeled 2D, 3D, and 4D data to client specifications for AI model training.
- Reviewed annotations from other team members and corrected errors to keep quality consistent with project guidelines.
- Followed detailed annotation guidelines and flagged unclear or conflicting instructions to project leads.
- Spotted edge cases and recurring error patterns, and shared them with the team so guidelines could be improved.
- Worked to deadlines in a production workflow with a focus on accuracy and consistency across large batches of data.
AI Model EvaluationLLM BenchmarkingDataset CurationQuality AssuranceError Taxonomy Analysis