Why didn't Johnny want to see Cilla and Isannah?

Now that Johnny has new friends at the print shop and the Observer, he is not as interested in Cilla. He notices that Cilla’s clothes are shabbier than the last time he saw her, and thinks to himself that he is more attracted to Lavinia Lyte. He leaves abruptly when Isannah starts to annoy him.