well, OK, I have nothing else to do , so here we go...
What about your arms and your legs ?
Forgetting that, you will probably find that you will sweat against that foam
another possible problem is that given the right situation you can get condensation on the floor (often mistaken as water penetration) so that would directly wet out your sleeping bag.
Besides , do you really sleep all night on your back ?