Nope, my idle is just over 512mb as I have cut some of the pretty crap that I don't use. It runs perfectly for me. I initially had some problems with it only using 3gb but I fixed it with a simple bios fix so now it runs all 4gb with no problems.
On my 64bit Vista machine though I have nothing but problems with games, same spec just different OS, yet nothing wants to run properly - as such that is the "work" machine now and my 32bit is my games baby!