What does Bruno find odd regarding the people on the other side of the fence?

Before he leaves, Bruno asks Father who the people are outside his window. His father thinks he is talking about the staff and the soldiers. But Bruno clarifies that he is referring to the people dressed the same, on the other side of the fence. He thinks they look sad and are all wearing the same pajamas.