I propose a new poker rule

[MicroBob]

if your hands are on the table it can very much look like you are holding cards.
I could let my cards always be in plain view every time I have them but I could very easily hold my hands in such a way that made it look to the whole table like I possibly had cards.

You likely are unintentionally holding your hands in such a way. If many players often ask you this question then I'm guessing you are the problem, not them.
They don't ask other players this question as much, right? Only you. So that should probably tell you something.