Southport is located along Long Island Sound between the Mill River and Sasco Brook (the Westport town line).
The historic significance of Southport is because of its churches, harbor, homesteads of some of the first families in southwestern Connecticut and public buildings. Today, much of the old village area is part of a town historic district, where buildings from three centuries are protected for the future. The boundaries of the town historic district are the railroad; the Mill River and Southport Harbor; Church Street; and Old South Road and Rose Hill Road. Strict historic zoning regulations are in effect in the district. Listed on the National Register of Historic Places is The Southport Historic District.
Southport has a private day school for children with learning disabilities called the Eagle Hill School. Southport is also served by the Fairfield Public Schools. Mill Hill Elementary School is located in Southport although children in some areas considered part of Southport but outside the census tract attend Timothy Dwight Elementary School. Both Mill Hill and Dwight Schools. These schools feed the Tomlinson Middle School and Fairfield Ludlowe High School.