UL hunting is easily doable, the biggest question is "how to pack it out." Only thing you need to change out, really, is the pack.
If your terrain supports it, you could also leave the skin on and line-drag it, or use drag-poles.
Don't forget that if you're humping out 100 lbs of meat, you'll want a pack that can also handle your bow/rifle. That leaves your hands free for trekking poles or for scrambling.
The extra gear you'll carry (binos, possibly a spotter, game care gear, bags, etc all add up, but there's no reason your base-UL gear won't work.
After all, until you shoot something you're really just hiking/camping anyways. :)