why is he so angry when his neighbours are less strict?

Are you referring to Joseph Strorm? Joseph's identity and reason for living is wrapped up in finding and opressing "deviations". He feels stress and anger when his neighbours are not as strict as him. His anger and prejudice are couched in very literal and twisted interpretations of the Bible.