FlytBase “The Tireless Hand” · agentic UI testing

Argus Live

A tester that drives the real drone‑ops cockpit like an operator and checks every claim on screen against the drone simulator's actual state — catching wrong, stale or unreachable UI by meaning, not by matching pixels or selectors, with near‑zero false positives.

Playwright + Chrome DevTools Ground‑truth oracles Cesium map · real lat/lon Narrated video evidence
12
scenarios, each recorded
7
genuine issues found
5
precision passes
L1–L3
levels covered
The submission

Three levels of testing

LEVEL 1submitted

Static UI & basic security

Does each screen show what it should — and stay secure? Signed‑out drone commands, off‑screen actions, overlapping map labels, a drone shown active while offline.

4 bugs1 passsecurityresponsive
View Level 1 →
LEVEL 2submitted

Live data, map, video & performance

Is what the screen shows actually true, over a workflow? The map showing a position 110 m stale, frozen video labelled live, movement‑trail accuracy, 16‑drone performance.

2 bugs3 passesmapbonus
View Level 2 →
LEVEL 3in progress

Multi‑user, network & long‑running

The hardest category: two operators seeing the same event, clean recovery after a connection drop, and correctness sustained over a long incident.

real‑timerecoveryperformance
How it works

The LLM compiles, the runtime replays

Argus drives real Chrome (desktop, tablet, phone; several operators at once), injects changing conditions through the cockpit's own control API, and reads what the user sees — UI text by meaning, the video's decoded frame rate, the live Cesium map's real coordinates, layout geometry.

It then compares against independent ground truth from the simulator and backend. When the two disagree in a way that harms the user, that's a bug — proven, grouped by root cause, and recorded in a video whose HUD narrates the UI's claim next to the truth.

Read the full architecture →

perception

Reads by meaning

Role, accessible name, context — small markup changes don't break the probes.

map

Real lat/lon

Reaches the live Cesium viewer and reads exact coordinates.

truth

Simulator + API

Ground truth from the control API and a socket feed, never the UI.

precision

Groups & guards

One root cause, one issue; correct behaviour passes cleanly.