Judge Peter Jacobs said the Home Office had improved but still had much to do when it came to removing foreign criminals from the UK.
He said he was frustrated and angry after repeatedly recommending immigrants for deportation - only to spot them in the centre of Norwich months later.
Judge Jacobs spoke out as he jailed a West African woman who had lived and worked illegally in Norfolk for seven years.
He sentenced Jessica White, 22, for 10 months and ordered for her to be deported when she is released.
He told Norwich Crown Court: 'The reality is the Home Office is better than it was but they don't keep a proper take on these things.
'I and my brother judges recommend people for deportation and then we walk along King Street or London Street and see them a few months later.'
'In this case we will have to wait and see.'
Liberian-born White admitted possession of a false passport and entering the UK without leave in 2002. She was arrested after a fracas in her home in Attleborough, Norfolk.
The woman seems to have have had a hard life, to have worked hard here, and to have been involved in just a minor fracas. For that, the Judge is going to destroy her whole life and social network?
What wicked men some of these Judges are. When it comes to a final judgement, I think Judge Jacobs and his kind are going to find it pretty hard going when faced with God's love for all people.