How to consider remote hands

[DickieBets]

Last night at 25NL, I raised preflop and was called by a guy OOP. On the flop, the guy donk bet- and since I had flopped top two pair - I reraised to more than pot size - which he called. The pot was now large and on the turn, a card came up giving him a possible straight. I considered it but thought that since he would have had to had a gut shot draw - it was unlikely - and proceeded to get stacked due to him, indeed, hitting his gutshot draw.

So my question is how much credit do you give for these remote donkey draws ? If I was to worry about it everytime, I would surely lose alot of value. Or is it something you just to come to terms with like being outdrawn after getting it all in with Aces or losing to a set over set ?

I have the hand at home, but didn't think an example is necessary. The thing that worries me is I'm getting my money in bad - which is different than being outdrawn. Even though he is playing terrible, not even coming close to his implied odds, I'm still "making a mistake" by getting my chips in without the best hand.