Well, from what I understand MS wanted to go fullfill their vision of the MinWin OS.
Windows 7 should be close to it and Vista has been a steppingstone towards that vision. The core of XP is based on 2000, which is based on NT4 which is based on NT3.
We are basicly talking about an architecture thats 10 years old. Its time to change, but change is costly and painfull.
Thats what we are going through now. I have skipped on using Vista, but will give 7 a try