Running Away from Bad Players

[The Bryce]

So I'm playing a Prima 20/40 table and getting my poop-hole resized. It's not the greatest table, I'm picking on a 40/15/1.7 two to my right who doesn't play so bad post-flop. Rest of the table is semi-solid. Dude to my immediate left leaves and a player I know, who's usually a great fish, sits down in his seat. He's 60/20/1.0, will cold-call with about the top 25% of his hands pre-flop, re-raise the top 10% or so against a late raise. He's not all that aggressive, he just kind of floats there and wakes up at some point if he decides he likes his hand (he'll bluff with draws, but probably not less). He'll never fold his blind. I play for a few orbits, decide that this guy puts me at a huge disadvantage, and leave the table. Make sense, or am I just being silly?