Exactly. In most cases it isn't.
And to my experience, pointer arithmetics is really only a benefit with multi-dimensional arrays, where the compiler is not yet smart enough to optimise unnecessary address calculations. In the matter at hand, my machine is 5% faster with normal array access than when using pointers.