Among these, by far the principal was the incomparable friend of whom I have already spoken. At this period she lived mostly with one young daughter, in a quiet part of the country, and only occasionally in town, with her first husband, Mr. Taylor. I visited her equally in both places; and was greatly indebted to the strength of character which enabled her to disregard the false interpretations liable to be put on the frequency of my visits to her while living generally apart from Mr. Taylor, and on our occasionally travelling together, though in all other respects our conduct during those years gave not the slightest ground for any other supposition than the true one, that our relation to each other at that time was one of strong affection and confidential intimacy only. For though we did not consider the ordinances of society binding on a subject so entirely personal, we did feel bound that our conduct should be such as in no degree to bring discredit on her husband, nor therefore on herself.
Note from KBJ: Mill was associating with a married woman (Harriet Taylor) and was concerned with appearances. This was Victorian England.