I find the suspension and criticism absurd. It is not meant as a slight to anyone, black or white, whoever picked cotton.
Plenty of white people picked cotton both before and after slavery.
If you are not familiar with the usage of the expression, and have to look up its origin on Wikipedia to determine its intent, wow, you may too much free time on your hands.