Can you delete a mod?

[GlobalExplorer]

Wise people always make a copy of the game folder before they install the first mods. That way you can always go back to scratch if you get tired of a certain mod. I will never understand how people actually start modding their games if they dont use some very simple insurance policies like this one.