What should I do if a girl(my sister's nanny) told somebody that husband tried to kiss her?

I left my husband for like 45 minutes in our house with my sister's nanny's because we have to pick-up somethign from the store. A week later, I found out that the Nanny was telling the other maids that my husband tried to kiss her in the lips but she didn't want to, but later on my husband got hold of her and kissed her on the neck. I've been married 2 years and we have a son. My husband is not the kissing type and not very sexual. My husband denied the allegations and sweared that he never did anything and that nothing happened and we even confronted the girl together. My husband is good looking and the nanny is like a gil from the outskirts of the mountain, but she has a nice body.I've seen this nanny looked at him several times before so I'm really confused if this girl has this illussions and just sticking to her story. It's now affecting our marriage...and no day will passed without the story keep repeating in my mind how my husband approached her and kissed her...in our own house... and I don't know what to do??? If I looked at my husband's character and what I know... I don't think he can do such a thing... but he's a man... I don't know what really happened. I tried to asked me to just confess that he had a moment of weakness... but he won't do it and he actually gets mad and thinking of leaving me for not trusting him and believing an allegations from a nanny. Ps... when we confronted the nanny... she was smiling and moving around... the Aunt said that her growth was delayed that she moves like that.... AM I crazy to be effected by this or should I believe my husband.. I love him but I cannot live with somebody who can do this specially growing up with a Dad who is a womanizer...