Summary
About this role
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for a detail-oriented Business Analyst to support evaluation and annotation workflows focused on quality, accuracy, and structured reasoning. This role is ideal for someone who is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, well-supported justifications based on fact-checking.
- Perform side-by-side (SxS) evaluations on GHD, comparing outputs and assessing quality, accuracy, and relevance.
- Conduct fact-checking to validate information and identify inconsistencies or inaccuracies.
- Provide detailed, well-structured justifications to support evaluation decisions.
- Follow established evaluation guidelines and quality standards consistently.
- Use browser-based tools and extensions to support analysis and review tasks.
- Execute simple command-line instructions when required to support evaluation workflows.
- Document findings clearly and communicate insights to stakeholders when needed.
Commitments Required: 6-8 hours per day with an overlap of 3 hours with PST.
Employment type: Contractor assignment (no medical/paid leave)
Duration of contract: 2 months
Location: Argentina, Brazil, Peru, Colombia, Chile, Mexico
Selection process: 60 min technical test (comparing AI outputs)
- Solid comfort using a computer in a professional setting.
- Experience working with browser extensions and online tools.
- Ability to run basic command-line commands (no advanced programming required).
- Strong analytical and critical thinking skills.
- High attention to detail and ability to justify decisions clearly and objectively.
- Comfortable working with evaluation frameworks, comparisons, and structured analysis.
- Previous experience with evaluation, annotation, QA, or audit-type work.
- Familiarity with data quality, content evaluation, or model/output assessments.
- Good written communication skills in English.
- Work in a fully remote environment.
- Opportunity to work on cutting-edge AI projects with leading Tech companies.
Other facts
About Gramian Consulting Group
Gramian Consulting is your partner for accessing the engineering capabilities you need—delivered in the model that fits your business, from staff augmentation and talent recruiting to Build-Operate-Transfer (BOT). We combine the perspective of a software engineer, the rigor of a technical recruiter, and the vision of a business builder, so you get experts who understand your challenges and deliver results the right way. This blend is our signature advantage in providing top-quality services, fast and reliably.
What you'll do
- The Business Analyst will perform side-by-side evaluations on AI outputs, assessing their quality, accuracy, and relevance. They will also conduct fact-checking and provide detailed justifications for their evaluation decisions.
Join Clera's Talent Pool
Get matched with similar opportunities at top startups
This role is hosted on Gramian Consulting Group's careers site.
Join our talent pool first to get notified about similar roles that match your profile.