With vertical thinking one may look for different approaches until one finds a promising one. With lateral thinking one goes on generating as many approaches as one can even after one has found a promising one. With vertical thinking one is trying to select the best approach but with lateral thinking one is generating different approaches for the sake of generating them.
"Lateral Thinking : Creativity Step by Step". Book by Edward de Bono, 1970.