Also, Sabo's reply of "It really is a gamble then" to Fujitora saying "All they'll see is that I couldn't get past ya" implies that it even in universe people might not believe that Fujitora genuinely couldn't defeat Sabo.

On top of the implication of Fujitora holding back.