Question for non-custodial parents?

If you only saw your son every other weekend and you decided to take your new girl/boyfriend home to meet your parents and spend two weeks with family AND you were given the opportunity to take your son with you...is there any excuse for saying no and only taking him for 3 days?