Have you inspected the belt itself? Are the teeth all there and in good shape? Does it have a snug fit? It should not be flimsy when on the pulleys and the pinion.
I think that somehow the two belt sprockets are
not aligned properly. There may be a worn out
bearing or bushing on the drive wheel shaft,
causing it to be out of alignment.