Is it time to let go or keep holding on?

well me an my current boyfriend have been dating about six months. about a month ago he wanted to start fresh and make things better because he got caught talking to other girls and trying to get with them. i accepted his offer an accepted his apoligy because i really think i love him and i want it to work out. i've been puttin up with his ex girlfriend of two years. she constantly trying to get back with him. i doont worry about it because i know who he's with. a couple weeks ago things starting going bad. he started accusing me of missing my ex boyfriend, talking to other guys, an a lot of other stuff. i really want to make it work, but i feel i've done all i can. i cant seem to let him go. but is it time?