Skip to main content
Microsoft Foundry

Internal App Test Runner

Description

What this agent manifest does

Browser-based smoke testing — executes confirmed test cases against your internal app, logs failures to GitHub.

Build an agent that navigates your internal web application via browser automation, executes test scenarios step by step, compares actual results to expected outcomes, and creates GitHub issues for any failures with full reproduction steps. It reviews the test plan with you before executing — confirming which cases to run, the target URL, and any known issues to skip — and never modifies the application or its data. The output is a clear pass/fail/blocked summary plus auto-filed GitHub issues for each failure. Upload test cases or describe key scenarios and the agent structures them into testable steps.

This is a human-confirmed plan → automated execution → result tracking pattern using markdown-header prompt structure. The agent doesn't just run tests — it first parses and presents the test plan for confirmation, creating shared understanding before anything executes. The browser-automation instructions are deliberately explicit about navigation: wait for page load, verify an element exists before interacting, retry up to three times before marking blocked. It pairs browser actions with GitHub issue creation for a closed loop. Because it drives a live app and files real issues, the plan-confirmation gate and credential safety are built in, and a person owns the results.

This pattern applies anywhere an agent executes a structured plan against a live system and tracks outcomes. Common scenarios for this pattern:

  • Regression testing after deployments
  • Acceptance-criteria verification for new features
  • Periodic health checks on internal tools
  • Onboarding-flow validation across environments
  • Form and workflow testing for business applications

The tools it uses

This manifest uses: browser automation, GitHub

Use this agent manifest to understand

How to build multi-turn agents using markdown headers prompt structure for pass/fail report + logged issues output.

License

This agent manifest is sample code subject to Azure's licensing terms for Distributable Code under the Universal License Terms for Online Services .

Disclaimer

IMPORTANT! This manifest is for educational and experimentation purposes. Resulting agents are not production ready. Review all provided resources and carefully test agent behavior in the context of your use case. Agents you create may be subject to legal and regulatory requirements, may require licenses, or may not be suitable for all industries, scenarios, or use cases. By using any manifest, you are acknowledging that resulting agents and other output are solely your responsibility, and that you will comply with all applicable laws, regulations, and relevant safety standards, terms of service, and codes of conduct. Learn more .