Module 4 joins vision (4.1) with agents (4.2). A multimodal agent might: read a screenshot → extract an error code → call a runbook API → propose a fix — with a human approval step.
Building blocks
VLM or vision tool for “what’s on screen.”
Text/tools for search, tickets, code.
Policies: what the agent may do without asking.
One-line summary
Multimodal agents use eyes (vision) plus hands (tools) to complete goals, not only chat.
Key terms
Multimodal agent — agent that consumes non-text inputs.
Grounding — tying actions to observed evidence (image, doc, API).