What was the biggest drawback about the union?

The biggest drawback for those who'd become members would have been that both black and white farmers would have to unite and work together, something that for the most part had been impossible.