In 2006, Kansas Republican Sam Brownback was crowned “God’s Senator” by Rolling Stone magazine. As he struggles for re-election as governor in this reliably conservative state, he is now praying for divine intervention. In 2010, he won the governorship by a 30-point margin. This year, he is in a dead heat with his Democratic challenger, who has the support of more than 100 Republicans, most of them former or current state-wide office holders.

Brownback’s problems are not difficult to fathom. Caffeinated by the Tea Party movement and funded by the billionaire Koch brothers, he came into office with a plan to slash taxes and spending while simultaneously creating jobs, stimulating economic growth and bridging the deficit. He said it would be “like a shot of adrenaline in the heart of the Kansas economy”. Instead, Kansas flatlined. Since he took over the state has gone deeper into debt, the poverty rate has risen 3 per cent, the economy is growing at half the rate of the four neighbouring states, and its credit rating has been downgraded.

Meanwhile, Kansas’s Republican senator Pat Roberts, who won by a 24-point margin in 2008, is also struggling against an independent businessman. The establishment, mistakenly, took his re-election to a fourth term for granted. “[Roberts] is basically furniture in the Senate,” one Republican strategist told the Washington Post. “You could give the average Kansan 24 hours to come up with something Pat Roberts has done [and] even the crickets would be standing there befuddled.”

Kansas is not typical. Indeed the problem with these midterm elections, which take place on Tuesday, is that there is no such thing as “typical”. This is not what they call a wave election, when one party surfs in on a tide of popular discontent and the promise of radical reform. There are few grand narratives. The economy is recovering but still weak. Obamacare is unpopular but nobody wants to repeal it. The nation has embarked on a war which most support but few think is succeeding or has clear goals. Obama has low favourability ratings, but voters are even less impressed by the opposition. Neither side is really promising anything beyond hanging on to or gaining office.

Since Republicans are likely to take over the Senate, giving them both houses of Congress, they are equally likely to claim victory. But if there are broader lessons from this cycle then these celebrations will be short-lived. Economically, politically and demographically, the long-term prospects for Republicans are far from rosy for two reasons.

First, one thing that Kansas does illustrate is that the reformation and reassertion of the American right has passed its peak of influence. Organisationally, the Republican establishment has become more adept at defeating hard-right candidates, who would prove a liability, at the primary stage (had they managed this earlier they would control the Senate already). But politically it is now the electorate that is rejecting the Republican agenda. “We’ve got a series of blue states raising taxes and a series of red states cutting taxes,” Brownback said last year, referring to his policies as an experiment. “Now let’s watch and see what happens.” We all watched, and it wasn’t pretty.

In Wisconsin, Republican governor Scott Walker, who was lionised for union-busting policies and seeing off a recall vote, ran on a similar if less extreme agenda to Brownback, and failed in a similar if less dramatic way. He too is in a tough re-election battle. Similar stories of Republican overreach are playing out in otherwise moderate states such as Maine, Michigan and North Carolina. The experiments failed. The reality could not deliver on the rhetoric. Some of these candidates, including Brownback and Walker, may still win. But all have been both chastened and exposed.

While this will make the Republican party less unruly, it also demotivates the most dedicated part of its base. Support for the Tea Party has declined precipitously, but its supporters are still far more motivated to vote than other sections of the electorate, including other Republicans. And while their agenda may have been extreme, they at least had an agenda, which cannot be said for the Republican party as a whole.

The second reason Republicans should temper their joy is because the Senate races reveal their national vulnerabilities. Of the 10 states considered toss-ups this year, Mitt Romney won seven and Obama won three in 2012. Obama won those races by 6 per cent or less; Romney won all but two of his by more than double digits. Put bluntly, it should not even be close. But while Democrats are struggling in swing states that are supposed to be tough, like Iowa, Colorado, New Hampshire and North Carolina, Republicans are in trouble in Georgia, which has not voted Democratic in a presidential election since 1992. Meanwhile, it has given up on the states where they need to be competitive if they are to win back the White House, like Michigan, Minnesota and Virginia.

This is partly about local factors but it also represents broader social and demographic trends that are increasingly stretching the party, given its present platform – particularly, but not exclusively, among minorities and women.

Take Georgia. The party’s core here, as elsewhere, is white men, married white women, evangelical Christians, the elderly and rural voters — only more so because it is in the south. All these categories but one are in decline. In the past decade the proportion of white registered voters in Georgia has declined from 72 per cent to 59 per cent; the Hispanic population there increased by 96 per cent between 2000 and 2010 and Hispanic voter registration in that time increased by 400 per cent; since 1990, the state’s rural population has fallen from 31 per cent to 25 per cent.

True, the population is ageing, but it is also dying out. Three-quarters of active registered voters over the age of 65 in Georgia are white, which is true for just under a third of those under 30. In short, thanks in no small part to their policies on everything from immigration reform to gay marriage, with each election cycle, the Republican party needs to get more votes from fewer voters.

None of this makes a Democratic victory inevitable. Far from it. Texas and Arizona have changed at a faster pace and remain reliably Republican for now. Hispanics, for example, may be growing fast in Georgia, but they still comprise just 4 per cent of the electorate. And if nobody wins 50 per cent, the Senate race will go to a run-off that Democrats are likely to lose.

What it does indicate is that with a good candidate and a sophisticated get-out-the-vote operation, Democrats are becoming more viable in places where they previously did not have a prayer, while Republicans are becoming less viable in places where they were once competitive or even dominant. Not only have they failed to deliver to their base, their base is also shrinking. Come Tuesday, they may be uncorking the champagne; but, all else being equal, in years to come they will be crying into their beer.

— Guardian News & Media Ltd