Exactly! If the Bishop simply agreed that he had given the silver to Valjean, it would have the feeling of being unwilling to be part of his punishment, but not of actually being generous. And yet he goes beyond that, turning the other cheek, by one-upping what Valjean had taken.

FWIW, I do sometimes sing "Do You Hear the People Sing?" as well. Just not as often. :)