In 1908, Andrew Carnegie donated $20 000 for the construction of a library in the Junction. Part of this grant required the establishment of the West Toronto Public Library Board. The land for the library was purchased in June 1908, with a neighbourhing site being purchased in October of that year. The firm (Ellis & Connery) of Junction resident James A. Ellis was hired for the project. 

In 1909, while the library was under construction, the City of West Toronto, which incldued the Junction, was annexed to the City of Toronto. The West Toronto Public Library Board and its assets were transfered to the Toronto Public Library Board. The library opened in September 1909.

The library underwent renovations in 1962 and was renamed the Annette Street Branch. 

In 1979, the library closed for renovations and the construction of a west-side addition by Sillaste & Nakashima Architects. The renovated library re-opened in June 1980. The museum underwent a minor retrofit in August 1990. Further retrofits and renovations occured in 2009, 2013-14.

The library was listed on the Toronto Heritage Register in 1998.

• Architect - Sillaste & Nakashima Architects  <-- More buildings by this architect.
• Architect - Ellis & Connery - This was a partnership between James August Ellis and William Connery.   <-- More buildings by this architect.
• General contractor - Eagle and Son