Court ordered visitation?

My ex-husband and i have a court order stating that he is to have an every other weekend rotation. I have agreed in email to extra visitation. The problem is that my ex-husband is a fire fighter and never has a consistent schedule. The schedule that we have agreed to has proven to be very chaotic. I want my ex-husband to see his son more, but on a consistent, structured, basis...needless to say he does not agree with me..I am tired of fighting over it..am i within my rights to return to the court order? Thanks