What does grampa mean by “doing a little business”?

Grandpa's "business" generally meant visiting someone in their office for a visit. Whatever Grandpa didn;t want Hiram to hear was avoided when he'd give him a nickel to shop around in the lobby. We can infer that Grandpa's business had something to do with the African Americans workers employed on the farms.