Originally, Pascal didn't have break statement either.
The procedural purists will avoid not only goto, but also break, continue and exit statements.
The idea was that each routine (and each loop as well) should have one entry point and one leaving point. Therefore leave condition should be checked only on starting or ending side of the loop (so, Pascal has while and repeat loops).
Leaving from the middle of a routine (or of a loop) was considered bad procedural code.
I think that a real abuse of goto is jumping backwards. Jumping forward is much less bad (apart from jumping from outside of a loop into loop's body, which is really the worst abuse).
Even now, when we have break, we still cannot break more than one loop level, for that you still need goto.
I don't use goto, as I was taught to avoid it, but I no more think that it is always so bad.
I also think that using continue statement makes code hard to follow, it's in my opinion definitely worse than jumping forward with goto.
I never use continue.