An online events platform featuring free, paid, and fundraising events. Share your expertise with the world, or enjoy new experiences from the comfort of wherever you are.
https://events.zoom.us/ejl/AuDMyLoZLc_iSwTV2QDiIEg-lUdnH9KP9yr1yNWO1wixNJXasto8~A3pqUR5GQvNbD6Vo-ZLQGfpjoPrgRwJP3-MvG-TBNU_1ocil23-8xZ6Q1-wRlT8iGoY-fHpERyltWrtfSltP-xOprKkX104qF3MD1-XV0/D0q87kZFSJ2h8TtRvwVXiQ/video/2aCW5HuzQx-D2QiT2N2pew?_dlaccessid=ceX2D7JVRt-k4adb3NjnrQ&directLinkOpen=1Reader - page text saved at the timeSkip to main content
TR
Back
00:00:04
/
01:01:33
Speed
Only play highlights
Summary
The meeting focused on the concept of harness engineering for AI agents, presented by Nicole. Nicole explained that a capable model is not a reliable agent and that a harness is necessary to determine what the model sees, what it can execute, and how results are verified. She described the harness as a governor that enforces control through identity, skills, runtime, observability, and verification. Nicole used a demo of a shop application to show how removing harness controls could lead to unapproved payouts, duplicate refunds, and security leaks. She empha...
Show more
Smart chapters
Playing...
From 00:00
ACM Tech Talk Presentation
From 04:57
Harness Engineering for Reliable Agents
From 20:00
Model Interaction System Demonstration
From 39:53
Workflow Management and Agent Systems
From 47:42
AI Agent Verification Strategies
ACM Tech Talk Presentation
Andrew Stellman introduced the ACM Tech Talk webcast and provided background on ACM's educational and professional development resources. Nicole Krenstein then took the stage to present "Harness Engineering, Moving from Hopeful Instructions to Enforced Control," mentioning that her presentation would include a demo and interactive components, with code and resources available in the GitHub repository.
Harness Engineering: Moving From Hopeful Instructions to Enforced Control
Nicole Koenigstein
AI Researcher and Practitioner
Speaker
Andrew Stellman
Senior Vice President and Principal Engineer, Bank of America
Moderator
Report recording