What does Tom accuse Gatsby of?

In Chapter Six, the only thing I see Tom accuse Gatsby of is accepting an invitation that wasn't genuine..... merely congenial.

“My God, I believe the man’s coming,” said Tom. “Doesn’t he know she doesn’t want him?”