The blaze broke out at about 1.30pm on Saturday, May 30, in a shed in the front garden of a property on Howlett Close in North Walsham.
Flames spread rapidly along fencing into the main house before damaging two neighbouring homes.
The shed was destroyed and the house, operated by Broadland Housing, suffered extensive damage.
It is understood the family living there are now staying in temporary accommodation.
Fire crews brought the blaze under control within an hour, though they remained on scene for several hours.
By Sunday morning, May 31, the houses were still cordoned off with fire brigade tape.
The charred remains of the shed and its contents lay in the front garden, while the house’s doors and windows had been destroyed and were boarded up.
Robert Bescoby, 66, who has lived in the neighbourhood for 20 years, said: “We had just come back from Lowestoft and we saw the blaze.
“Everybody was rounded up out of the houses.”
Another neighbour, who did not wish to be named, said she initially thought the smoke was from a barbecue.
“We were in the garden when we saw a bit of smoke,” she said. “Then it smelled like rubber burning.
“The next thing, the shed in the front garden was on fire. I saw a young lad pushing a moped out of the garden. I asked if they had called the fire brigade and he said they had.
“The fire spread rapidly, first to the neighbouring house on the left and then the right. People were wetting the fence to try to stop it spreading.”
In the aftermath of the blaze, Briston Clothes Bank launched an appeal to support the affected family.
“I have been asked to help support a local family in North Walsham who have sadly lost their home due to a fire,” the appeal said.
Donations are being sought for a one‑year‑old girl, a 13‑year‑old boy, a 16‑year‑old girl, and for men’s and women’s clothing.