About the role
LLM -Business Analyst
Company: SourceBae
Job Location: India
Employment Type: Full-time
LLM -Business Analyst
Experience required: 3+
Location: Remote
Special requirements-
Previous experience with evaluation, annotation, QA, or audit-type work.
Familiarity with data quality, content evaluation, or model/output assessments.
Background in business analysis, operations, or process improvement.
Skill
Solid comfort using a computer in a professional setting
Experience working with browser extensions and online tools. Ability to run basic command-line commands (no advanced programming required)
About the Role
We are looking for a detail-oriented Business Analyst to support evaluation and annotation workflows focused on quality, accuracy, and structured reasoning. This role is ideal for someone who is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, well-supported justifications based on fact-checking.
Responsibilities
Perform side-by-side (SxS) evaluations on GHD, comparing outputs and assessing quality, accuracy, and relevance.
Conduct fact-checking to validate information and identify inconsistencies or inaccuracies.
Provide detailed, well-structured justifications to support evaluation decisions.
Follow established evaluation guidelines and quality standards consistently.
Use browser-based tools and extensions to support analysis and review tasks.
Execute simple command-line instructions when required to support evaluation workflows.
Document findings clearly and communicate insights to stakeholders when needed.
Requirements
Solid comfort using a computer in a professional setting.
Experience working with browser extensions and online tools.
Ability to run basic command-line commands (no advanced programming required).
Strong analytical and critical thinking skills.
High attention to detail and ability to justify decisions clearly and objectively.
Comfortable working with evaluation frameworks, comparisons, and structured analysis.
Good written communication skills in English.
Nice to Have
Previous experience with evaluation, annotation, QA, or audit-typework.
Familiarity with data quality, content evaluation, or model/output assessments.
Background in business analysis, operations, or process improvement. .