Harry Potter and the Queen of Slytherin

The Potters were an old family; somewhere along the lines, there had to have been a brother or sister running around. A distant family member that could take in a runaway child when no one else could? With a mass murderer running around and no family to watch after him, would the Ministry or Dumbledore really leave a small child running around Diagon Alley?