RSM

AI Risk & Controls Testing Specialist

Toronto Full time

We are the leading provider of professional services to the middle market globally, our purpose is to instill confidence in a world of change, empowering our clients and people to realize their full potential. Our exceptional people are the key to our unrivaled, inclusive culture and talent experience and our ability to be compelling to our clients. You’ll find an environment that inspires and empowers you to thrive both personally and professionally. There’s no one like you and that’s why there’s nowhere like RSM.

AI Risk & Controls Testing Specialist

Location: Toronto, ON (On-Site at Client Office)

About the Opportunity

RSM is seeking a detail-oriented, analytically strong Temporary AI Risk & Controls Testing Specialist to support a client engagement in a regulated financial services environment.

This role combines traditional internal audit and risk-testing expertise with the structured evaluation of AI-generated outputs. You will play a key role in assessing the reliability, accuracy, and control alignment of AI-supported testing activities, ensuring outputs meet professional and regulatory standards.

This position requires on-site presence in Toronto in accordance with client requirements.

Responsibilities

Risk & Control Testing Execution

  • Perform structured testing of IT General Controls (ITGCs), business process controls, and regulatory compliance controls
  • Evaluate control design and operating effectiveness
  • Assess whether testing procedures appropriately address stated control objectives and underlying risks
  • Identify gaps, inconsistencies, or unsupported conclusions

AI Output Evaluation & Validation

  • Use AI tools to execute control testing activities within defined protocols
  • Draft, refine, and vary prompts to assess consistency and robustness of AI responses
  • Critically evaluate AI-generated:
    • Testing procedures
    • Evidence requests
    • Testing conclusions
  • Independently assess outputs for accuracy, completeness, and alignment with control intent
  • Classify AI performance (accurate, partially accurate, inaccurate, incomplete)
  • Escalate ambiguities, limitations, or systemic issues to engagement leadership

Documentation & Reporting

  • Prepare clear, defensible workpapers documenting:
    • Testing performed
    • Evidence reviewed
    • Results and exceptions
    • Evaluation of AI performance
  • Assess audit evidence for relevance, sufficiency, and appropriateness
  • Summarize testing outcomes objectively and in accordance with quality standards

Required Qualifications

  • Experience performing or supporting control testing (SOX, internal audit, operational risk, compliance, or similar)
  • Foundational understanding of risk management and internal control frameworks
  • Familiarity with:
    • IT General Controls
    • Business process controls
    • Regulatory compliance environments
  • Strong professional judgment and critical thinking skills
  • Ability to independently evaluate automated or AI-generated outputs
  • Strong written documentation skills suitable for audit workpapers
  • Proficiency in Excel, Word, and structured tracking tools
  • Ability to work on-site in Toronto
  • Experience within financial services or other regulated industries
  • Exposure to model risk management or validation frameworks
  • Experience working with AI-enabled tools in a professional environment
  • Ability to operate effectively in protocol-driven and quality-controlled environments
  • Adhere strictly to confidentiality, data privacy, and information security requirements
  • Follow defined testing protocols and engagement quality standards
  • Collaborate effectively with RSM engagement teams, client stakeholders, and model risk functions

At RSM, we offer a competitive benefits and compensation package for all our people. We offer flexibility in your schedule, empowering you to balance life’s demands, while also maintaining your ability to serve clients. Learn more about our total rewards at https://rsmcanada.com/careers/life-at-rsm/rewards-and-benefits.html.

RSM does not tolerate discrimination and/or harassment based on race; colour; creed; sincerely held religious beliefs, practices or observances; sex (including pregnancy or disabilities related to nursing); gender (including gender identity and/or gender expression); sexual orientation; national origin; ancestry; familial or marital status; age; physical or mental disability; citizenship; political affiliation; medical condition (including family and medical leave); domestic violence victim status; past, current or prospective service in the Canadian uniformed service; Canadian Military/Veteran status; pre-disposing genetic characteristics or any other characteristic protected under applicable provincial employment legislation.   

Accommodation for applicants with disabilities is available upon request in connection with the recruitment process and/or employment/partnership. RSM is committed to providing equal opportunity and reasonable accommodation for people with disabilities. If you require a reasonable accommodation to complete an application, interview, or otherwise participate in the recruiting process, please call us at 800-274-3978 or send us an email at careers@rsmus.com.

At RSM, an employee’s pay at any point in their career is intended to reflect their experiences, performance, and skills for their current role. The salary range (or starting rate for interns and associates) for this role represents numerous factors considered in the hiring decisions including, but not limited to, education, skills, work experience, certifications, location, etc. As such, pay for the successful candidate(s) could fall anywhere within the stated range.

Compensation Range: $59 - $89 per hour