Should I tell my boyfriend I lost my virginity too him after more than 1 year of relationship?

When we first started dating I told him that I had gone out with other guys but nothing serious. He thought that this meant that I had slept with them, so he deferred I was not a virgin. After about 6 months of relationship we had sex. He always struggles thinking about the "past guys" I dated and we have fights because he doesn't want to go out with me thinking that he will see one of my "ex". I have told him that none of them meant anything and that I have "never been with anyone like I have been with you". So I have send him indirect messages about it but he does not get it. So should I tell him? will that make me a liar?