Computer making a "whining" electrical noise

[LocustHorde]

I always leave my computer on, but I had to turn it off briefly. When I turned it back on, it had trouble starting up, but eventually it started back up, but now there's a faint intermittant electrical whining noise. The sound is not too loud, but quite annoying.

My guess is the power supply is on its last leg??