what is the importance of prime numbers in the book

In Chapter Nineteen, Christopher explains why he has numbered his chapters in prime numbers: it is significant that he has chosen a pattern for his story which, as he explains, is the pattern left when all other patterns are taken away. It is almost as though this highly mathematically able child has actively sought to release himself from the confines of mathematical patterns to create something unique for his story.