So much depends upon individual circumstances that a general answer is not really possible. The first thing you need to do is make sure that you and your wife are on the same page regarding travel. This is a family matter and since your work and family life are by no means separate, this sort of decision needs to start there. Major restrictions can include things like kids in school or your wife's job. There are times when you may need to go to customer sites and having basic groundrules in place first are important.
Secondly you need to be willing to play things by ear. Before my kids were in school (my wife also works from home), the following things we did come to mind:
I accepted a 10 month contract a 6 hr drive away. We'd drive the whole family back and forth. First big contract of my business. My oldest was about 2 years old at the time.
A week after my second kid was born, my largest customer called me up and noted their technical contact on the project was quitting and they needed some on-site time to help everyone get up to speed. So after talking with my wife, we drove, the next week, the entire family 2000 miles over the weekend to my customer's site, and yes the entire family included a 2-week-old. It wasn't that bad. we'd just stop, feed the baby, change drivers every 3 hours of driving. A little planning and the trip worked wonderfully.
Now, both of these were positive experiences that probably can't be done as well now that the kids are in school. Many parents think that's crazy. But it worked.
I try to target 1-2 weeks of travel time a year. Most years it is lower than that. A few years it is higher.
So first you want to start by looking at it from the household/family level. You also want to look at it on the business level. The big thing is that there are many times when personal face time is important with customers, but it may not require being there all the time.
Typically if there is a big project the most valuable times are at the beginning and at the end, so instead of spending a year on site, you can probably get by with a week or two at the beginning and a week or two at the end. This can become important when it comes to getting to know how your client does business (and so what they want and need out of the project) and being able to wrap things up, solve any last minute issues, get final feedback, and so forth.
Where this does not work so well is in contract to hire gigs. There the company ultimately wants an employee and the contract is sort of like dating before getting married. They would want you on site. If you can't travel, or you don't want to give up freelancing, don't pursue these.
So despite the fact that no definite answer is possible because so much depends on circumstance, this should give you at least a starting point to think about what is possible, what you can do, and how you can make things work for your customer, yourself, and your family.