Yes, there's a chance it'll get ruined (e.g., a tree could fall on top of it and snap it in two). It's not likely though. If you guys will be at the bottom then you probably won't be going too fast anyway.
The base could get scratched on bare dirt, but a little bit won't ruin it. It will get banged up eventually. Bigger gouges can be repaired.
Try not to run directly into anything solid. If you're really concerned then don't take it with you.