Ken Bates has warned Football Association chief executive Adam Crozier that he will take the FA to court if they try to remove him from the board of directors.
The Chelsea chairman, who resigned from the board of the new Wembley Stadium project on Thursday, claimed that he is being prevented from voicing his opinion by anonymous faces inside Soho Square.
And in a stinging outburst Bates labelled such people "cowards".
Bates said: "What they want to do is stifle free speech. Well, they're not going to stop me giving my opinion and exposing their weaknesses.
"And if they do try to get rid of me from the FA board, I'll take them to the High Court," he added in the Daily Mail.
Several non-attributable statements in the past week have condemned Bates.
Bates said: "Why don't these so-called spokesmen come from behind their anonymity.
"Let them come out and put a name to their claims and accusations.
"They remind me of New Labour spin-doctors, which I'm sure in one or two cases they'd quite like to be.
"Let them put a name to their quotes if that's what they think of me. They won't because they're cowards.
"The public have a right to know what's happening in the national game. They're the ones who pay their money to fill the grounds. There's too much that gets swept under the carpet.
"Unfortunately there are too many people at the top of the FA who think they're a law unto themselves.
"We have to ask ourselves here who's working for whom? Who appoints them and who pays their wages?
"If David Davies (FA executive director) thinks he can get rid of me, let him try." -PA-