I agree with everything you said. I like Poeltl, and I think you can get him at 5 or 6. I like Murray and I'd happily take him 3rd, but it's possible you could get him 5th.
The thing is, when we look back at drafts they're always more binary -- that you should either take Poeltl or not. If he's worth taking at 5, he's probably worth taking at 3. In our minds, the value of #3 is conflated. In reality, picking the right guy is WAY more important than fretting over a couple slots.
e.g. in 2009, should I take Steph Curry 4th? Prevailing wisdom was that 4th was "too high". Too many question marks. 7 years later, what does "too high" even mean? Derozan went 9th and Teague went 19th. You don't bother assigning draft slots or fair value. Like Danny taking Rozier. If you like Poeltl, take him 3rd.
Sabonis is basically a can't-miss bruising, rebounding role player. Very smart and tough. Would happily take him with our 2nd pick.