Maryland is in College Park, an inside-the-beltway suburb of DC. My wife got her doctorate there. MD is very expensive to live (though an income in the millions takes the edge off that), and the area is crowded. On the other hand, well, there's so much to see and do in DC that you could "do something" every day and never run out of attractions, etc. I know people who love the DC metro area, even like living in the District. If you have money. You don't think those Washington lobbyists are living poor, do you?
Rutgers is in Piscataway. New Jersey is expensive for nice places, and there are very nice places in New Jersey. It's expensive for less nice places. Again, if you like city stuff, Piss Cat Away is a suburb of the Big Apple. Like that? You'll love Rutgers, especially for three or four mil. A lot of people love living in New Jersey. It's not all tank farms. Not at all. But too many people for me, even in the nicer towns, even if I could afford the real estate. (And if you're from Illinois, New Jerseyites think of you as a hick. Actually, anywhere west of the Delaware River qualifies you as a hick. And this from people who think wearing sweatpants as daywear is a major fashion statement.)
Lovie seems, by all accounts, to love the CU area, and with his income, he can live like King of the Prairie if he wanted. CU doesn't have a lot of attractions--though being a college town, attractions often come to town--but Chicago is only a couple hours away, and there's a lot to do there. CU is a great place to live, not a lot to visit for.
Yes, Madison is very nice. Summer there is nice too, especially if it comes on a weekend when you can enjoy it.