This building constructed in 1906 as an addition to a previously existing building. The main portion of the original building burned in 1913.

The building was home to a number of clubs, including the Granite Club, the German Harmony Club, and the Ulster Athletic Club. Between 1945 and 1975, it was the headquarters of the 48th Highlanders. The building was condemned in the early 1970s, but demolition was blocked by the North Jarvis Community Association and the property was eventually sold to the City of Toronto in 1975 for the creation of The 519 Church Street Community Centre (now known as "The 519"). The site was home to the original Yuk Yuk's location, which opened in the basement in 1976. In 1987 the City agreed to provide funding to make the building wheelchair accessible.

The building underwent major renovations between 2000 and 2009, and had a grand re-opening 2010. The Salah J. Bachir Wing, added to the south elevation of the original building, increased event space by 45%.

The 519 serves both its local neighbourhood and the broader LGBTQ2S communities in the Toronto area. The original building is designated under Part IV of the Ontario Heritage Act, and is a landmark in the neighbourhood.

• Architect - Curry & Sparling  <-- More buildings by this architect.
• Architect - Edwin R. Babington  <-- More buildings by this architect.
• Architect - Kohn Shnier Architects  <-- More buildings by this architect.