Unlike greedy decoder, Beam Search Decoder doesn’t just consider the most probable token at each prediction, it considers top-k tokens having higher probabilities (where k is called the beam-width or beam-size).