What did Charlie see at the party at his house? What bothers him the most about recounting the experience?

He saw Patrick and Brad having sex in the bedroom. I believe what bothered him about recounting the experience was how sad it was, how sad Brad was afterwards.

Charlie saw that Dave rape the girl in his room. What bothered him was that he didn't do any thing.