Harry Potter and the Prisoner of Azkaban Chapter 3 The Knight Bus

Having left Privet Drive, Harry isn't sure what to do. Feeling as though he's being watched he spots a large dog watching him. Suddenly, the Knight Bus appears on which Harry takes a wild ride to the Leaky Cauldron. The Minister of Magic is there he explains to Harry matters have been taken care of and that he will be expelled. Harry is to spend three weeks at the Leaky Cauldron before going to Hogwarts.

Harry was several streets away before he collapsed onto a low wall in Magnolia Crescent, panting from the effort of dragging his trunk. He sat quite still, anger still surging through him, listening to the frantic thumping of his heart.
But after ten minutes alone in the dark street, a new emotion overtook him: panic. Whichever way he looked at it, he had never been in a worse fix.

JK wrote that so exact to what it's like.

Fudge has been criticized by some members of the INternational Federation of Warlocks for informing the Muggle Prime Minister of the crisis.

I find myself surprised that I'm agreeing with Fudge but he had good reasons to warn the Muggle Prime Minister. Sirius had already showed he wasn't afraid of killing innocent Muggles. (But not really.)

He, Harry, had broken wizard law just like Sirius Black. Was inflating Aunt Marge enough to land him in Azkaban?

Harry, Harry, Harry. You didn't mean to blow her up. It was magic caused by emotion not action.

"Oh, my dear boy, we're not going to punish you for a little thing like that!" cried Fudge, waving his crumpet impatiently. "It was an accident! We don't send people to Azkaban just for blowing up their aunts!"
But this didn't tally at all with Harry's past dealings with the Ministry of Magic.
"Last year, I got an official warning just because a house-elf smashed a pudding in my uncle's house!" he told Fudge frowning.
"The Ministry of Magic said I'd be expelled from Hogwarts if there was anymore magic there!"
Unless Harry's eyes were decieving him, Fudge was suddenly looking awkward.
"Circumstances change, Harry....We have to take into account...in the present climate...Surely you don't want to be expelled?"
"Of course I don't." said Harry.
"Well then what;s all the fuss about?" laughed Fudge.

This doesn't make sense to me. Okay, yes, last year Harry was warned for magic. But that magic Dobby did purposefully. Blowing up Aunt Marge was not planned. The way Fudge acts make it seem Harry should be punished for the magic he did. But if he's going to be punished for emotion based magic why then wasn't he punished for all those times he used magic on accident through emotion in Sorcerer's Stone (before he went to Hogwarts, growing his hair pack, shrinking sweater, being on the roof, etc)? It doesn't add up.