It's kind of normal.
256 compression in extremely crowded areas and even close to land cause a lot of stutter due to the amount of elements the game has to process.
I have noticed this happening both in SH3 and SH4, keeping around x64 compression seems to prevent this issue though.