A couple of ideas here:
1) You said nothing was wet, but were your top, bottom and socks the same ones you hiked in? If they were, they almost certainly contained some residual moisture. If your sleep system is warm enough, you *can* dry your hiking clothing in your bag. But, don't try to dry damp socks on your feet -- the heat of vaporization needed to dry the socks will surely make your feet cold. Wear dry, spare socks instead. And, if you are trying to dry damp socks, remove them and stuff them in your torso layers somewhere.
2) I believe the x-lite thermo has a thin layer of insulation on the top only. If you also use a blue pad for additional warmth, it should go on top of the x-lite pad. Otherwise convection currents in the x-lite (especially at the pad edges) will greatly reduce the benefit of the blue pad.
3) Eat Well -- you need fuel in your body to generate the heat you need at night.
4) If you have the fuel, and get really cold, boil some water, put it in your water bottle/bladder/whatever, and place it between your thighs to warm the blood through your femoral artery. (Make sure to have enough insulation between a really hot bottle and your bare skin though.)
5) If you still need more leg insulation, try putting your pack under your legs in addition to the pad(s).
Hope this helps.