Yup, still own both, but if I'm solo and there will be trees, well only a barbarian would sleep in the dirt :)
If you like to tarp camp anyway, you could work your way towards a tarp that would work for both. I want something like a 12'x'10' Cuben tarp. Many of the hammock spcifiec tarps are more of a hex cut with cat curves, so the low side ends up a little short for optimal ground camping, while the ridge line is 11'-12', which is a bit long compared to most ground tarps.
A CCF pad is the best way to get really UL with a hammock (although it isn't my favorite), the point being that is another item you can share between the two systems. ENO has come out with the Hot Spot pad holder that will use your 20" pad and has additional CCF padded wings to cover your hips and shoulders.
Also, I have yet to buy a quilt and use my sleeping bag in my hammock. Your top quilt or sleeping bag can be used in either system as well.
If you do the CCF pad option, get a tarp sized for ground and hammock, and a typical quilt or sleeping bag, all you would need to add is a polycryo ground sheet and you could do it all.