Barton's main problem isn't height, it is his lack of heft, lack of muscle. He gets pushed around so easily out there. That is why he has always been a dodgy defender.
And that is why he was unable to be the wing player Denver sorely needed despite having good skills and why they moved on from him. They have been much better with physical defenders like KCP and Bruce Brown.