Answer
An initial vertical orientation uses the rocket's thrust most effectively to counteract the weight and get the rocket moving upward. A vertical path also reaches the greatest height in the least amount of time.
However, to achieve a stable, unpowered orbit, the rocket must be given a tangential velocity, so it gradually tilts into a horizontal orientation.
This is discussed on page 193.
