Harry's life with the Dursleys was not fun. It was constant, backbreaking and often humiliating work, paired with little food and no affection. But it did teach him a thing or two about his priorities in life. Specifically; to be safe, have trusted companions, able to go wherever he wished and most importantly, able to protect it all.