Cavs are going to get s rep of being ridiculous to work with. Bush league
The following is speculation. So take it for what it's worth; nothing.
But my theory is that this is exactly what's happening, and it's why the Cavs seem to be waffling in every direction now. I believe that Cleveland has more leverage in this trade, and that they could put Ainge in a very difficult spot if they choose to play hardball. They could make Ainge choose between adding an asset to the package or taking back a resentful IT, whose value has been diminished in a very public manner.
So Altman has Ainge by the balls, BUT he can't afford to be perceived amongst his peers as a snake. He could hurt his future if he makes the wrong move. GM relationships are important, and Cleveland is put at a severe disadvantage if Altman establishes himself as untrustworthy.
So I think he's fishing. He's looking for a way to spin this so that he can pinch another asset while looking like the good guy. But I'm not sure that he can do that.
Or he just doesn't like what he saw from IT's physical and he's balking. Who knows at this point?