The gilded star (symbol)
The gilded star symbolizes the complex, ambiguous nature of the town, and of the poem as a whole. On the one hand the star "stands for hope"; a humble symbol, welcoming "waifs, children, animals, and prisoners," figures of Christian charity. On the other hand, the star is gilded; its seductive gleam is painted on. This symbol of hope is, perhaps, merely a symbol, an empty sign; like the church, and the town itself, its welcoming facade may conceal a murkier, troubled reality.
the scarlet clothes (symbol)
The scarlet garb of the steeple-jack suggests that there is something sinister and devilish about him. Combined with his spidery movements and novelistic persona, he becomes disconcerting, strange.
the stranded whales (symbol)
The stranded whales symbolize death, for while they are written about as if they were a mere curiosity, they will soon decay and their smell will permeate the "sweet sea air." The town thus seems lovely on the surface, but elements like this make readers think twice about just how idyllic it is.