I've kayaked most of the northern end out of Pond Inlet, Bylot Island and Frobisher Bay on Baffin. It is an amazing place. Lots of polar bears, especially in the south along the Meta Incognita Peninsula -- that name, which means value uncertain, is worth spending the time and money to travel.
We always ran into folk walking along the coast on these trips, which are now 12 - 17 years in the past. The terrain is great for hiking,but you might want to bring a pacraft for crossing the inlets. You can see forever and walk around the majority of the small lakes and ponds. I would suggest you fly into Pond Inlet and walk the coast, or get someone to take you Bylot Island. There are still remnants of 19th c. whaling and exploratory caches along that coast.