I don't fish, but the Battenkill in and near Arlington, Vermont is supposed to be good. I've canoed there and it's a very pleasant weekend of canoeing with a campground in the middle. For hiking, it's not far from the Appalachian Trail, though roads there can be slow.
Battenkill Canoe is the place for info:
(kill is dutch for creek).