In the museum garden you'll find the old Garden House. The Garden House (Havehuset) is one of Skagen’s oldest houses and has been used for many different purposes - eg. as Michael and Anna Anchers residence, and in the end of the house, you'll find Michael Anchers old studio. In 1880 the newly wed couple Anna and Michael Ancher moved into the Garden House. The eastern end that had formerly been the merchant’s shop was refurbished as a studio, and it was at this time that the large gable window was put in. Helga Ancher was born in the Garden House in 1883. The following year the Ancher family moved into the house on Markvej, but Michael Ancher continued to use the studio. The Garden House was then used as a summer residence for visiting artists.
The Garden House has been restored several times, and in 1971 it became a listed protected building.

In 2009 the Garden House was refurbished as a café. The café is open during the summer season.