Mr Swan told reporters on the Gold Coast that Labor and the Greens were "cut from a different cloth".
The government would not pander to interests on the left or right as it put "jobs and growth first", he said.
"Most importantly, if you look at the operation of the parliament over the last two years I don't think you'll see this decision of the Greens ... (will) have a great impact on the operation of the parliament," he said.
Asked whether the government had sought formal assurances about supply and confidence from the Greens, Mr Swan said his information was that it would continue.
Mr Swan said Labor faced extremists on the left and right, as it attempted to spread the benefits of the mining boom.
"The Greens want to abolish the mining industry ... (and) on the far right you've got the Liberal party and all their Tea Party elements who argue that mining billionaires shouldn't pay their fair share for the resources the Australian people own 100 per cent," he said.
Mr Swan dismissed the comment.
"You can't put lipstick on a pit bull and call it a blue heeler - the fact is the Liberal Party is dominated by a right wing that have fashioned their policies on the Tea Party in the United States," he said.
Facing calls from the coalition to resign over his economic management, Mr Swan said: "I will continue to ensure we get the big decisions right for the Australian economy."