Boots. Start with good boots. If you're working with a budget, find the boots that fit you best, buy them and then you'll know what you're working with for board and bindings. I'd rather ride a rental board and bindings with good boots that fit me well than ride the board/bindings of my choice with shit boots.
"People say that marijuana smoking is going to get in the way of my career. I say to them that on the contrary, my fighting career is getting in the way of my marijuana smoking." -Nick Diaz