Report: Meta will train AI agents by tracking employees’ mouse, keyboard use

Meta will begin tracking the mouse movements, clicks, and keystrokes of its US employees to generate high-quality training data for future AI agents, Reuters reports.

The news organization cites internal memos posted by the Meta Superintelligence Labs team in reporting on the new Model Capability Initiative employee-tracking software. That software will operate on specific work-related apps and websites and also make use of periodic screenshots to provide context for the AI training, according to the memo.

“This is where all Meta employees can help our models get better simply by doing their daily work,” the memo reads, in part, Reuters reports.

Meta spokesperson Andy Stone told Reuters that the collected training data will help Meta’s AI agents with tasks that it sometimes struggles with, including “things like mouse movements, clicking buttons, and navigating dropdown menus.”

“If we’re building agents to help people complete everyday tasks using computers, our ...