'They made a model of me," says Jerry Dammers, picking up a plastic figurine from a shelf beneath his vinyl record collection. It's a miniature rude boy, with dark suit, porkpie hat and even the gappy smile that has been Dammers' trademark since he went over the handlebars of his bike as a schoolboy.

That gap grew wider when Dammers, aged 19, lost another molar to a pint glass thrust into his face in a nightclub in Coventry, the city that later inspired him to write 'Ghost Town' and 'Nite Klub' and other songs that defined the early '80s and made the Specials one of the most distinctive and important bands in popular music.

Amid great excitement, a series of concerts billed as "The Specials 30th Anniversary Tour" starts next month, culminating for Irish fans in an appearance at Oxegen next July. But it seems the audience will see nothing of the man who assembled this seven-piece band and forged its genre-defying sound, one that fused the defiant optimism of Jamaican ska with the anger of punk, alongside lyrics that reflected the dearth of opportunity in Thatcher's Britain.

Dammers may have spawned a youth cult, but he did so from a sense of individuality rather than tribalism. When he goes on stage these days his garb is an outlandish mix of ancient Egyptian and intergalactic traveller. He is leader and keyboard player of the 18-piece Spatial AKA Orchestra, inspired by the sounds of the American free jazz legend Sun Ra, playing what he describes as "21st-century music".

His instincts have always been progressive. Yet the legacy of the Specials endures; on the wall of his flat in Brixton, south London, is an ageing poster for 'Too Much Too Young', the Specials' first number one hit from 1980. But, at 53, Dammers now fears that the achievements of his younger years are in danger of being written out of history. "Through my teenage years I was writing songs, playing in club bands, but at the back of my mind was the day when I would form my own band. That's why what is happening now is so horrible to me because it's as though my whole youth, my whole life, is being stolen," he says. And what a youth it was, playing early hits such as 'Gangsters' and 'A Message To You, Rudy' to packed houses. "The whole place would be bouncing up and down in unison; whole buildings used to shake with the excitement at that time," he says.

It was never going to be easy to replicate that feeling 30 years on, especially after the group's acrimonious break-up in 1981. After just two albums, singer Terry Hall and backing vocalists Lynval Golding and Neville Staple left to form Fun Boy Three. Back then, as now, Dammers was trying to challenge himself musically. "At the beginning of the Specials it was fine, but when it came to the second album I wanted the music to progress, because the first album is all just three-chord tricks. I introduced the muzak and exotica elements, which was radical at the time," he says.

Though he subsequently produced 'Ghost Town', the band's masterpiece, his desire to experiment was not welcomed by some of his fellow band members. "I think that's maybe what the band don't like about me," he says now. "My ideas are radical, and hopefully they always will be." But he would still have liked to be part of this reunion. "I know for a fact from the way this thing has been advertised as the Specials' 30th year reunion that a lot of people have bought tickets assuming I was in it, and that it was the complete Specials," he complains. Over the past two years, negotiations have been taking place to bring the band together, a process as fraught as the original break-up. "I think I've been completely reasonable, rational and level-headed throughout this entire thing. I haven't expected anything unreasonable from anybody. I have been treated in the most despicable manner." (For their part, the other members of the Specials state: "To respond would only give credence to [Dammers'] claims. We are far too busy preparing for the sold-out tour to do that.")

A couple of rehearsals took place, though not with all band members present. Dammers was keen to do more than just replicate the Specials' early work: "I had lots of ideas for how to do this in a way that's a bit more interesting, just tweak it to make it more modern and not just a nostalgia knees-up," he says. But the arguments continued as old personal differences surfaced. Dammers was upset by the involvement of some of Hall's friends and advisers, including Simon Jordan, the mobile-phone entrepreneur and chairman of Crystal Palace football club. Dammers wanted nothing to do with them.

Dammers began composing some of the early Specials songs on the family piano, developing his musical ideas while studying art at Coventry's Lanchester Polytechnic. He began putting together the band that started out as the Automatics, morphing by a succession of name changes to the Special AKA. "The Specials, I handpicked everyone in it, I put it together and had the vision for the whole thing; it didn't just happen. It was originally set up primarily to perform my songs, although I did encourage everybody else to write songs as much as I possibly could – contrary to what's been said."

He resents the suggestion that he was dictatorial but, as they did in 1981, last summer his fellow Specials stopped working with him again, performing a reunion concert at the Bestival festival on the Isle of Wight in September. Despite the mudbath conditions, Dammers went along to watch. "It sounds like I'm being rude but I was bemused by it and a bit bored because it was so predictable." Asked if he will watch any of the tour, he struggles to find words and sighs, exasperated. "I don't know... well, it's not the Specials, that's an historical fact."