I'm using Nvidia Inspector with some success for SH5 (as well for SH4 BTW) but you have to set override any application setting for it to work.
Enhance application doesn't make changes...
AA set X32 and AF set X16 satisfied me.
I deactivated any AA transparency (i had X2 SSGSA) because it kind of blurred horizon.
But all depending on your PC performance, of course
