In a world where Harry Potter never met Ron Weasley on the train, thus having no reason to reject the Sorting Hat's decision, and being turned into an outcast by all of the school for accepting its choice.
When someone lives a life of abuse, it's only natural to avoid it at any cost, even if the only way possible is to enter a house of silver and green than gold and red.