The leak is in the corrections, not the data export
The subtle part of Nadella's argument is where he locates the leak. It is not the obvious data-export risk that governance teams already police. Instead, models learn from what he calls enterprise 'intelligence exhaust' - the prompts people write, the tools agents invoke, and especially the corrections and evals people make when the output is wrong [2]. Every time an employee tells the system 'no, in our business it works like this,' they are teaching the provider's learning infrastructure something proprietary. Nadella says this happens gradually and almost imperceptibly, 'trace by trace, correction by correction, eval by eval' [2].
That framing matters because it reroutes the risk around the contracts most enterprises think protect them. A clause that forbids training on your raw documents does nothing about the accumulated judgment encoded in how your team steers, rejects, and re-scores model output. Nadella pushes the point further: 'the better you want the model to perform, the more of that knowledge you have to feed it' [3]. The incentive to reveal IP is therefore structural, not accidental - performance and disclosure move together, so the most valuable customers leak the most.


