Clunk when turning left

Ever since I got the Jeep there has been a clunk when turning left. It always seemed to be coming from the middle to rear on the passenger side. I'm still not positive, but I think my exhaust is flexing enough to knock against the from when I turn. Here are some pics of the mark on the exhaust where it looks like it's hitting the frame.