According to the Wisconsin Historical Society, Edward C. Young built the Idlewild Resort in the 1920s, establishing what would become one of the early landmarks on Birch Lake. The oldest known photographs of the original lodge date back to around 1929. Around that same time, the distinctive chimney was added to the building, becoming a defining feature of the structure.

Prior to those photographs being taken, a devastating forest fire swept through the area, completely destroying the surrounding woodland. The images from 1929 reflect a landscape still recovering from that destruction, marking an important chapter in the early history of Birch Lake and the resort itself.