It sounds like it could be a number of different things. Do you have high arches? Flat feet?
You might just benefit from getting some custom insoles. If you go to your local shop, they should probably be able to steer you in the right direction of which insole would be best for your feet.