Are you using JSGME?
I have caught myself doing one of two things with different files.
Editing a file and then
not enabling it with JSGME.
The other is editing a file in the JSGME mods folder after it has already been enabled. Thus I'm editing a file that won't actually be enabled until I disable it and then enable it again.
Other than that I have no idea what could be happening.