Eduard van Valkenburg
d08200d00e
* Bump Python package versions for 1.12.0 release Bump packages represented in the 1.12.0 changelog, promote Foundry Hosting, Azure Content Understanding, Gemini, Mistral, Monty, and Tools to beta, and apply the requested beta cohort date stamp. Root and core move to 1.12.0, released and RC packages use their selected increments, alpha packages including Hosting MCP use the 260721 stamp, and core floors are raised only for proven consumers. Copilot-Session: 2dd9980a-b869-4c16-8642-75b7a6d6ebdf * fix version in readme * Add Responses conversation ID changes to release notes Include the breaking Hosting Responses conversation ID helper changes from #7234 in the Python 1.12.0 changelog. Copilot-Session: 2dd9980a-b869-4c16-8642-75b7a6d6ebdf
1.2 KiB
1.2 KiB
DevUI Multi-Modal Agent
Interactive web UI for uploading and chatting with documents, images, audio, and video using Azure Content Understanding.
Setup
-
Set environment variables (or create a
.envfile inpython/):FOUNDRY_PROJECT_ENDPOINT=https://your-project.api.azureml.ms AZURE_OPENAI_RESPONSES_DEPLOYMENT_NAME=gpt-4.1 AZURE_CONTENTUNDERSTANDING_ENDPOINT=https://your-cu-resource.cognitiveservices.azure.com/ -
Log in with Azure CLI:
az login -
Run with DevUI:
devui samples/02-agents/devui/agent_content_understanding -
Open the DevUI URL in your browser and start uploading files.
What You Can Do
- Upload PDFs — including scanned/image-based PDFs that LLM vision struggles with
- Upload images — handwritten notes, infographics, charts
- Upload audio — meeting recordings, call center calls (transcription with speaker ID)
- Upload video — product demos, training videos (frame extraction + transcription)
- Ask questions across all uploaded documents
- Check status — "which documents are ready?" uses the auto-registered
list_documents()tool