How about this. Logic might be faulty here but just my perspective
An extreme best case for the pick would be that there's a surefire superstar you can't pass on (Anthony Davis, Lebron, Zion, maybe KAT). But that might come once every 5 or so years, and even Zion is looking a bit iffy now.
A more realistic optimistic case scenario, is a toss up between a Jayson Tatum level player; a Jaylen Brown/Brad Beal/Don Mitchell level player; or a Lonzo Ball/Dante Exum/Markelle Fultz.
The odds of the pick becoming Tatum, of course, is far lower than the two other possible outcomes. Realistically cant you basically sign someone with similar upside to the pick swap, like the Knicks did with Julius Randle?
By doing a pick swap several years down the line (aside from the Spurs having no incentive to do one in the short run due to them being worse than us), you maintain maximum flexibility in the short run. You could trade all your picks for a disgruntled Don Mitchell, but not if you hamstring yourself by trading/swapping picks in the short run.