The NBA just released their full award ballots, so for anyone else wondering who the one voter that left Smart completely off of their all defensive team ballot, it was Mark Medina. He put Bridges, Jrue, Thybulle, and CP3 all ahead of Smart while every other voter had Smart 1st team all defense.
Edit: He also excluded Time Lord, so it isn't like he just credited Rob with our defensive success