Webster, I feel the same way you do. It's not all that hard to do and you save yourself from headaches not having all the crud that's in a store bought pc.
Besides..... If I can build a computer and it runs afterwards..... anyone can do it.
LOL I bought all my parts fromCompUSA just down the road fom me, and the guys there were more than happy to give suggestions based on what I could afford.