Most of the backcountry there is on Big Jay from what I understand. Which you can access from the top of the ski area. I know there isn't a lot of avalanche danger. I think most east coasters don't even carry basic avalanche gear, which sounds crazy to me. I would at least carry a beacon, shovel, probe. Lots of other scenarios where that stuff can be handy. Anyway, you do want to go out there with at least a partner. Being all forest and that sort of thing. If there is an injury, you may need help getting down, or even a S&R group to come get you. It usually doesn't happen, but anytime you are out there it can.
Mysticfalcon is the Jay Peak local on the forum here. He hasn't been coming around much as of late, so you might want to PM him to ask about the scene there. He does do backcounty and slackcountry around the ski area.