Back Lane connects Albion Road to Brook Street, but before the Victorian period it was a small lane going behind a group of buildings, some backing onto Brook Street and some onto Back Lane itself. The land enclosed by this lane includes a number of interesting sites, including the Fountain Inn and the Quaker meeting house.

During the 1830s some buildings were demolished to make way for the route of the new railway, which split the lane into two. Later in the Victorian period the road became the main access point up to the Albion brickyard. And, at the turn of the twentieth century Back Lane became known as Queen Street for a decade or two.