If your clothing items are small and slightly damp, they will dry out fairly well by sleeping on your back, putting them directly on your warm chest, and let the moisture go where it will. I've never found much moisture hanging in a down bag that way. For some small items like gloves or socks, I put them underneath the t-shirt that I wear to sleep in.
On the other hand, if your clothing items are large and dripping wet, they will create a problem. It is best to let them drip dry outside the bag until they get to the slightly damp stage, and then follow as above.