Slavery was on the decline, even in the south, I think they'd eventually stop. I don't think the south liked being told what to do. Besides most civilized countries stopped slavery by then, so it probably made America look bad.