When opposing counsel perceives it to be his job to demonize you, he'll often imply that a powerful gun should be seen as an indication of malice or out of control machismo. Search GT for discussion of the Fish case, where the prosecutor did just that to a man who used a 10mm auto in self defense. It's easy enough for a good lawyer and the right witnesses to shoot down in court (no pun intended). None of my cases, personally, have involved a .44 Magnum used by the defendant, IIRC.
.44 Special should be fine for a home defense revolver. I'd go with a good hollow point like the Winchester Silvertip. The .44 Special cartridge can be very accurate.