What did Atticus tell him? What did jem say they weren't doing?

Basically Atticus tells them that they are infringing on the rights of Boo to have his own privacy. Jem insisted they were not doing anything wrong to Boo; they were just trying to be neighbourly. Atticus sees through Jem's argument and logically refutes it.