WSOP Qualifier hand - flopped bottom set - how fast do you play it

[TripDaddy]

Well, I chickened out on the slow play and just pushed. The flush draw scared me and I figured calling or raising and then pushing to a non-diamond board would given me very little FE on the turn. I really struggle with hands like this. Meaning, sets on scarey boards. I am always scared to give cards, but at the same token, I feel like by playing them so fast, I push out all action. I am sure there is a happy medium. Just gotta find it.

Results - I pushed, they fold.