I've also noticed that shadowing your game resolution with the desktop improves performance. Maybe that should be that your game resolution should not be higher than your desktop resolution.
Anybody want to try SH4 in 640 x 480 16 colors? Bet it flies!