Perhaps Memphis presents an outside chance of making a deal centered around Rozier. Memphis wants to still try to contend/not quite rebuild yet. So giving them Sacramento's pick next year might work for them (as opposed to other teams that would require substantially more value to defer their [projected] lottery pick).
Rozier also helps Memphis next year, both off-ball next to Conley, as a backup to Conley, and as Conley's replacement during [inevitable] injury/rest.
The guys available at #4 also might be pass-able for Memphis, given that they are either big men (Gasol-redundant), point guards (Conley-redundant), or wings that are not franchise-level. Memphis could hope for a better fit (better quality wings) or better talent (Gasol or Conley replacement) in the next draft.
It's still a reach, but maybe Rozier, Sacramento pick, give Memphis their own pick back or Celtics 2018 #27.
No way would I give up Brown.