Present
Mass Identity, Inc./ Hyperscale AI AI Engineer 2024 — Present
Research and prototyping of agentic AI systems; evaluation of frameworks and approaches.
- Designed a Production-Informed Accelerated Multi-Agentic Simulation System: production-derived failure distributions, probabilistic environment and dependency simulation, agent-trajectory and multi-stage workflow evaluation, harness validation and recovery testing, low-cost accelerated execution using smaller models and cached dependencies, anomaly discovery for behaviours absent from historical datasets, and release gates with automated rollback policies.
- Established the feedback loop that makes the above self-correcting: production execution → telemetry and trajectories → streaming analysis → learned failure distributions → stochastic simulation experiments → evaluation gates → safer release → new production evidence.
- Designed and built an LLM observability and reliability harness to make non-deterministic systems safe in production. Improved structured-output success from ~71% to near-100% through prompt hardening, validation layers, normalisation and controlled recovery — a deterministic contract enforced over a non-deterministic model.
- Explored end-to-end observability across LLM pipelines (logs, metrics, traces) to detect schema drift, malformed output, latency variance and downstream failure, and investigated control-loop patterns — observe, detect, intervene, stabilise, measure — with failure-aware recovery: classification-based retries, bounded recovery, and cost/latency trade-off management.