Gordon Brown's family is said to have started looking for a new house in Edinburgh.
Last month, the Browns were warned they would have to move out of their family home in North Queensferry, Fife, when Brown leaves Number 10.
Police have told them the property, on a suburban street overlooking the Firth of Forth, would be too difficult to protect permanently.
At the moment, the Browns are only there for occasional weekends and holiday trips.
Now estate agents and some of Brown's wife Sarah's close friends have been searching for suitable homes in Edinburgh's exclusive New Town area.
And they have already found a potential home close to Bute House - the official residence of current Scottish First Minister Alex Salmond.
This is the first evidence that Brown has started considering life beyond Downing Street.
"Gordon and Sarah will be heartbroken to leave Queensferry," News of the World quoted Sarah's pal as saying.
"But they are both anxious to ensure they get away from their current life, where they are constantly ferrying the children around the country, and build something more stable," the pal added.