A senior Labour council cabinet member has quit amid criticism that leader Sir Albert Bore has "shut himself away" and lacks "political vision" to take the city forward.

Harborne councillor James McKay announced his decision to stand down after a particularly angry meeting of Labour councillors last night.

He had been cabinet member for social cohesion and community safety and was recently responsible for drawing up the city's response to the unfolding refugee crisis in Syria.

His resignation comes as pressure is mounting on Sir Albert Bore, who has been Labour group leader since 1999 and is in the fourth year of his second spell as city council leader.

Sir Albert has been singled out for criticism from government through last year's damning Kerslake report and more recently the Independent Improvement Panel which has singled out the city's political leadership as a problem.

Related: Birmingham's Tory leader calls on entire city cabinet to quit

His Labour colleagues have also found him to be increasingly remote and failing to involve either them or the wider city in key decisions.

There is growing fear that the longer Sir Albert stays the more likely a government take over will happen.

Coun McKay said: "Birmingham has got an amazing future ahead of it, there is a great deal of potential.

"It owes Albert and enormous debt for his work over many years. But I do not believe he is the right person to take the council forward.

"We need a simple, convincing and realistic vision that the people of this city can respond to."

His letter stressed the failure of the leadership to work with partner organisations in the city.

Referring to his own future and a possible leadership bid, he said he was not ruling anything in or out.

He stressed he had come to the decision over the weekend but chose to wait until after the Labour meeting to go public.

Sir Albert Bore said today: "I am sorry that James has found it necessary to make this decision.

"His contribution to the work I, and the rest of the cabinet, have been doing over the last three years has been invaluable.

"Though we have faced a number of challenges, and continue to do so, we are making considerable progress to improve the city council itself and how it functions alongside its partners and its citizens. I can only wish James every personal and professional success in the future."

As well as councillors, Labour MPs have too been increasingly concerned at Sir Albert's leadership.

Edgbaston MP Gisela Stuart said: "There's a lack of coherent leadership. We are not making progress."