Well, it seems to be an Diplomacy feature and fortunately for me I found out that breaking your oath to the family won't cause bad reputation. So, I went and married another gal (and got 19k poorer while doing so

).
But of course this was all in vain as I realised I had installed just the basic Diplomacy mod, not the Diplomacy + OSP items mod I had intended to, so back to square one.
Oh well, atleast I know what I'm doing now: Get ridiculous amounts of Sarranid Mamlukes and ride to victory after victory without losses.