Becareful when taking you wife fishing... First it's minnow/worms under a bobber then next thing you know you're at gander mountain with a half dozen $15 Tuff Shads or $20 Top Raiders in the buggy.

I take mine too, we both love fishing. She liked fishing long before I met her, but she's taken it to a new level now that she has someone to go with her that loves it too. She started out with the minnow and worms under bobbers, but now she's standing toe to toe with me searching out big cats and now musky hunting. And she's not afraid to let me know when she kicks my butt at the end of the day.
The time we get to spend together on the bank or boat it nice, but sometimes quiet time fishing alone is good too. We just try to be careful and not over do it. Everyone is different. Personally I think it's a great idea in that we get to spend more time together as a family (something that doesn't always happen in this day and age) which in turn I hope makes our relationship between each other and our kids that much stronger.
If you both love it, I say do it. Just remember to keep it fun and enjoy the time you get together because it is finite.
Barry