Isaiah has done a decent job defensively in some of the games I've watched, but against bigger, veteran guards, he's gotten worked. Guys who have been around the block in this league, with good size and scoring ability for the point guard position, know how to take advantage of a tiny guy guarding them.
Jack and Monta Ellis are the two that were most noticeable to me.