This is common mullein which I think is an uncommonly attractive weed. This link from Virginia Tech has pictures of various stages of its development. http://www.ppws.vt.edu/scott/weed_id/vesth.htm You may be interested in knowing that a common name for it is Cowboy toilet paper. Just thinking that may explain why our four score or more ancestors were glad to have it around!

This is a Common mullein (Verbascum thapsus). It has a two year life cycle with a tall spike of yellow flowers in its second year. The plant has medicinal properties which may account for your seeing it around old house sites.

It is mullein (Verbascum thapsus L.) Pretty plant for a native garden – tall stem with yellow flowers. Buck

Mullien (Verbascum thapsus) introduced from Europe. While there are a number of verbascums that have been developed by the hybridizers for the flower garden, common mullien is generally not cultivated. Some people use it as toilet paper. herbalists use it for asthma and other ailments. I like it in the flower garden, I think it’s pretty.

Common mullien Its a fun plant that will have tall stalks of small yellow flowers. There are a lot of folk remedies associated with this plant.