Ovulation ?? for Dr Q

Am I right i thinking that I have been told, read, whatever that it is harder to get/keep a pregnancy when you are O'ing late in your cycle? I know your CM can be hostile for sperm later in your cycle, right? Is there anything that we can do to increase our chances since I O very late in my cycle while not on meds-currently taking a break from clomid & infertilty treatments while lossing alittle weight. I do O on my own, however, & do not see a reason why we should not TTC without the meds in the meantime...Any advice is much appreciated, & thanks in advance!!