Looks like key to fix the broblem is in data\cfg\Sensors.cfg:
No i use:
;Visual.
Visual range factor=1.0 ;[>=0] this was 0.6, they can spot single ship from 18km 
Visual fog factor=1.0 ;[>=0] this was 0.5 so ai could see in heavy fog 
Visual light factor=1.0 ;[>=0]
Visual waves factor=0.6 ;[>=0]
Visual speed factor=0 ;[>=0]
Visual aspect=0.9 ;[>=0]
Visual enemy speed=0.2 ;[>=0]
Visual noise factor=0 ;[>=0]
Visual sensor height factor=0.5 ;[>=0]
Visual already tracking modifier=600 ;[detection probability modifier], most accurate, once a contact is detected it will lose it very hard
Visual decay time=250 ;[>0] already tracking bonus decay, in seconds
Visual uses crew efficiency=false ;[true or false]
Now i will spot small ship form 10000-11000meters in clear wheater and daytime
And i can see it too (if i use binos)
My res 1920x1080 (looks like it has somekind effect to numbers)
Must test more to be sure that ai wont see too well, but this looks way to go.
Any one know if draw distance for ship and/or ship SMOKE can be adjusted somewhere ? render distance is way too short now, about 11000meters, it should be least 20000meters like in real life