You do not need to remove thermal underwear immediately if the room is cool and you still feel comfortable. If you become too warm, remove the outer insulating layers first. If the thermal underwear is damp after an active walk, it is better to change into dry clothing. Use the indoor temperature, the condition of the fabric and your own comfort as a guide.