Skip to main content
Microsoft Foundry

Real Time Video Analysis Agent

Deploy AI-powered video analysis at the edge using Azure Video Indexer on Arc-enabled AKS clusters with GPU support, combined with AI agents built on Azure OpenAI for automated video analysis workflows.

Template details

The Real Time Video Analysis Agent helps businesses use AI agents to automate complex video analysis tasks. It deploys the Azure Video Indexer Arc extension on an Arc-enabled AKS cluster with NVIDIA GPU support, enabling real-time video processing close to the data source with low latency and full data sovereignty. AI agents built on Azure OpenAI orchestrate the video analysis pipeline, with multiple specialized agents collaborating on domain-specific tasks such as speech analysis, visual recognition, and compliance checking. The solution supports both live video pipeline ingestion via RTSP streams and batch processing of recorded video files, extracting insights including face detection, object tracking, scene detection, and action recognition. It optionally creates a Microsoft Foundry project and deploys resources including AKS, Azure Video Indexer, Azure OpenAI (gpt-5.2), and Storage, all managed centrally through Azure Arc.

Key features

  • Edge-Deployed Video Analysis — Run Azure Video Indexer on Arc-enabled Kubernetes clusters at the edge, bringing AI-powered video analysis closer to data sources for low-latency processing.
  • Real-Time & Batch Video Processing — Support for both live video pipeline ingestion (RTSP streams) and batch processing of recorded video files.
  • AI Agent–Based Automation — Leverage intelligent agents powered by Azure OpenAI to automate complex video analysis workflows, enabling automated decision-making and action triggering.
  • Cloud-Managed Edge Deployments — Manage and monitor edge deployments centrally through Azure Arc while processing video data locally.

Disclaimer

IMPORTANT! Solution templates are to assist your development of AI solutions for specific scenarios. Review all provided resources and carefully test all AI solution behavior in the context of your use case. Learn more in the transparency documents for Agent Service and Agent Framework . AI solutions you create may be subject to legal and regulatory requirements, may require licenses, or may not be suitable for all industries, scenarios, or use cases. By using any solution template, you are acknowledging that AI solutions or other output created using that template are solely your responsibility, and that you will comply with all applicable laws, regulations, and relevant safety standards, terms of service, and codes of conduct.

Skip the setup and get running in code with one command. Docs

winget install Microsoft.FoundryDevPack