My view is that if you don't get the liners dry you're off to a stinky hell indeed, and that removing them to dry them out will achieve this. I don't have a dedicated boot dryer that blows air into the boot but I think that blowing air in there only works so well versus disassembling the boot/liner combo.
I also think that a day of riding flexes the boot and liner a zillion different ways while removing and putting the liner back in happens only once per day of riding. I'd think that the in and out of boot liner removal for drying would hardly affect the life of boots/liners given the stresses through a day of riding.
Not to hijack this thread but how long do folks think boots should last, if taking your liners out each day shortened the life of the boot by 10% then what is the cost. In my case I'm riding about 40 days per year, rolling over my boots about every 1.5 seasons. I just bought a new pair at year end sale prices that I'll switch to next January, and on a test run they were way stiffer and not packed out compared to my current boots, which have about 50 days on them so I'm pretty sure it's almost time to switch. Same boot and model each time.
If I didn't remove my liners they'd be so toxic I'd replace the boots more often, that's my tradeoff. If I can keep my boots from toxic stink they go a season and a half.