My advice would be to wear your shoes for stream crossings and save your camp shoes for camp/town. This is more a safety issue than a wetness issue, IMO. If your shoes won't dry fast enough after a stream crossing then you might want to reevaluate your shoe choice.
Of course, this is just my opinion. You might not agree.
As for camp shoes, I'd go with cheap flip flops (as mentioned previously), or some lightweight sliders (useful with socks).
By the way, has anyone found the lightest weight slider shoes out there? I'm on the hunt for a pair...