Ever wonder how all those plotlines that get used again and again come about? It's not how you think...
Mr. Potter, did you kill your relatives? Harry: Yes.
The Dursleys adopted Harry. They still don't like him. See what a difference a name makes.