AI Innovation Quality Assurance - Prompt Team - Remote US in US - Remote (JR02778)

SitusAMC is where the best and most passionate people come to transform our client’s businesses and their own careers. Whether you’re a real estate veteran, a passionate technologist, or looking to get your start, join us as we work together to realize opportunities for everyone, we proudly serve.

At SitusAMC, we are looking to match your unique experience with one of our amazing careers, so that we can help you realize your potential and career growth within the Real Estate Industry. If you are someone who can be yourself, advocate for others, stay nimble, dream big, own every outcome, and think global but act local – come join our team!

This role is responsible for defining, executing, and continuously improving quality assurance standards for AI-driven solutions across the Artificial Intelligence Innovation department. This role ensures that AI-generated outputs meet clearly defined expectations for accuracy, consistency, completeness, and explain-ability prior to and following deployment. This role serves as a Subject Matter Expert (SME) for AI output quality, partnering closely with prompt design, delivery, product, and business teams to embed output-level quality evaluation throughout the AI lifecycle. They will oversee QA Analysts and coordinate with lead-ers across the Artificial Intelligence Innovation department and business to forecast timelines and ensure timelines are met.

Essential Job Functions:

• Define, execute, and continuously improve quality assurance standards for AI agent and prompt outputs, ensuring generated responses meet expectations for accuracy, consistency, completeness, and explainability.
• Oversee QA activities throughout the AI lifecycle, including pre‑deployment validation and post‑deployment output monitoring (regression testing).
• Ensure AI outputs support informed decision-making by validating clarity, applicability, and alignment with intended business value.
• Serve as an advocate for high-quality AI outputs, promoting shared understanding of output standards and expectations across the organization.
• Lead and oversee QA Analysts responsible for reviewing and evaluating AI agent and prompt outputs.
• Provide direction, coaching, and prioritization to ensure consistent application of output QA standards and timely completion of QA activities.
• Forecast QA timelines and capacity in coordination with AI leadership to support delivery commitments and ensure deadlines are met.
• Coordinate cross team to align QA activities with delivery timelines and ensure prompt and agent readiness.
• Assist with the development of repeatable AI output evaluation approaches that can be applied across use cases to drive efficiency and consistency.
• Document QA findings, trends, and recurring issues related to AI agent and prompt outputs.
• Prepare reports, summaries, and presentations for management outlining QA results, risks, and improvement opportunities.
• Identify opportunities to improve QA processes, tools, and standards based on observed output behavior and delivery feedback.
• Other activities as may be assigned by your manager.

Qualifications/ Requirements:

• Bachelor’s degree in a relevant field (such as Business, Computer Science, Data Science, Engineering, or related discipline), or equivalent combination of education and experience.
• Minimum of 6+ years of industry and/or relevant experience, typically with 1+ years in a Senior Associate level role or external equivalent.
• 8+ years of relevant professional experience, with demonstrated involvement in AI, analytics, content evaluation, automation, or quality assurance disciplines.
• Prior QA management experience preferred, including oversight of analysts or reviewers responsible for evaluating outputs or deliverables.
• Prior leadership experience preferred, with the ability to coordinate work, forecast timelines, and drive accountability across teams.
• Demonstrated experience evaluating AI-generated outputs, including prompts, agent responses, or decision-support content.
• Strong understanding of how prompt design, instructions, and context influence AI agent behavior and output quality.
• Excellent written and verbal communication skills, with the ability to explain quality findings and recommendations to both technical and non-technical stakeholders.
• Strong analytical and critical thinking skills, with attention to patterns, edge cases, and systemic quality issues.
• Experience working in Agile or delivery-oriented environments, coordinating priorities across multiple stakeholders.
• Real estate, mortgage, or financial services experience preferred, but not required.
• A strong commitment to integrity, professionalism, and the organization’s guiding principles.

#LI-REMOTE #LI-AS1

Note: This job description is not intended to be all inclusive or exclusive. At any time, employees may perform other related duties as required to meet the ongoing needs of the organization and participate in additional trainings. SitusAMC does not accept unsolicited resumes from staffing agencies, search firms or any third parties. Any unsolicited resume submitted to SitusAMC in any manner will be considered SitusAMC property, and SitusAMC will not pay a fee for any placement resulting from the receipt of an unsolicited resume.

The annual full time base salary range for this role is

$110,000.00 - $130,000.00

Specific compensation is determined through interviews and a review of relevant education, experience, training, skills, geographic location and alignment with market data. Additionally, certain positions may be eligible to receive a discretionary bonus as determined by bonus program guidelines, position eligibility and SitusAMC Senior Management approval. SitusAMC offers PTO and paid holidays, the terms of which are set forth in the program policies. All full time employees also are eligible to participate in various benefit plans, including medical, dental, vision, life, disability insurance and 401K; in each case in accordance with the terms of the applicable plans.

Pay Transparency Nondiscrimination Provision

SitusAMC is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Know Your Rights, Workplace Discrimination is Illegal