User Group Meetup 2026-Session 5: Agent Ally

Video Transcription

Video Summary

The presentation introduces Ali, a tier-two AI agent in OASIS designed to help organizations create and review assessment questions. Unlike a general chatbot, Ali is integrated into OASIS’s question-writing workflow, uses carefully developed prompts and organization-specific style guides, and selects relevant course content to ground questions in uploaded materials.<br /><br />Ali first generates a teaching point, then drafts a question around it. Administrators can generate questions in batches, while subject-matter experts review, edit, or discard drafts. Faculty can ask Ali for alternative teaching points, revise questions through an embedded chat, regenerate distractors, and draft commentary. A higher-effort mode sends questions through multiple rounds of AI critique and revision, but can take about 20 minutes. AI can also help modify images for questions.<br /><br />The central principle is that Ali supports, rather than replaces, human writers: AI reduces blank-page friction and makes it easier to produce drafts, while people make final decisions. The presenter also noted that generating references from PubMed is a future development; planned tools would suggest relevant articles for experts to evaluate.

Keywords

Ali

OASIS

assessment questions

question-writing workflow

subject-matter expert review

teaching points

AI critique and revision

PubMed references