Based on this conversation, I'd love to see a spreadsheet with a side-by-side weight comparison between (a) carrying your 32-degree bag and extra clothing vs. (b) carrying your warmer bag.
For example, my 20-degree bag weighs 11oz more than my 35-degree summer bag. In my mind, if the weight of the "additional" or "upgraded" clothing is more than that amount of weight, than I'm better switching over to the 20-degree bag. For me, the upgraded clothing doesn't seem to be worth the weight, since I don't need those upgraded items while hiking or in camp.
That's the way I've calculated things for myself. I'm sure other people's ways of thinking here will vary.