After tracing from the wall to the PSU (just plug the damn thing into a different outlet, with no APC UPS, and no surge gizmos), the next step is to open it up and unplug all PCI/AGP cards.

Try it like that, then add back only the most absolutely essential cards -- likely just the video card. If the mainboard has built-in video, then USE THAT instead.

Cheers