Hi Zaheer,
This would happen if you sent a ClickDimensions email to Contact A and they replied and you may have scrolled down and clicked on one of the links so now you are associated to that contact. What you can do is clear the cookies in your browser and you will not be associated to that person any more.