User Group Meetup 2026-Session 4

Video Transcription

Video Summary

The presentation introduces Ali, a paid Tier 2 AI agent in OASIS designed to help organizations create and review assessment questions. The speaker argues that Ali’s advantage over asking a general chatbot for questions comes from its integration with OASIS’s review workflow, carefully developed prompts, and ability to select relevant course materials as context.<br /><br />Ali first generates teaching points, then drafts questions tied to them. Administrators can generate questions in batches, while subject-matter experts review and refine them through the existing human approval process. Reviewers can request alternative teaching points, edit questions with a built-in AI assistant, regenerate distractors, and generate commentary. A higher-effort mode uses multiple AI review-and-revision rounds, which can take about 20 minutes. AI can also modify images, though human validation remains essential.<br /><br />The speaker emphasizes that Ali is meant to reduce writer’s block and workload—not replace experts. The team is also developing support for generating questions from uploaded articles and exploring ways to identify relevant PubMed references. For now, AI-selected course content is not automatically treated as a question’s cited source.

Keywords

AI agent

OASIS

assessment questions

question generation

review workflow

subject-matter experts

human approval

PubMed references