This team just struggles to score with IT out. The fact is it doesn't really matter when he sits and when he plays, but in the NBA, you start your best player. No reason to make IT unhappy by benching him when he's playing so well as a starter.
If you really need to start Smart, play a 3 guard set with Crowder at the 4.