IF you do think so, just do it! I mean, life is so long, sometimes, you have to make some tough decisions to make a change you really want to, doesn't have to related with RIGHT or WRONG or REASONABLE.
But i do know a real story of one of my friend. He loved a married woman who was his English teacher in university 10 yrs ago. when he was around 22. They falled in love and, run away for love from Chong Qin to Zhu Hai, now they seperated 3 yrs already. he is alone in shenzhen. they treated each other like best friends, but they both don't wanna live together anymore, coz his wife always complain his unmature. (She is older than him. )