When do Base Scratches/Gouges affect performance?

I have a couple boards that I love and ride them everywhere - steeps, chutes, trees and everything in between. Problem is I have accumulated tons of scratches and some deeper cuts from rocks on the base of both my "free ride" decks.

One deck (Rossignol XV) has a decent amount of ptex poured in already and had a base grind earlier this year. My other (K2 instrument) is also starting to accumulate rock damage (both vertical streaks and deeper horizontal gouges near the edges) but no core shots yet.

At what point do you retire a board based on accumulated scratches and gouges? Or do you put it away only once there is a core shot or edge blow out that is too significant or costly to repair?

It's hard to say if or how damage affects performance since we ride in different snow conditions, temps, mountains, fresh wax vs not so fresh wax etc on any given day so it's not obvious that "hey this board is not ripping like it used to".

Thanks for the pointers.