Perhaps , when they first visited Steventon, they found Edward down in the dumps because his brothers were all away somewhere...and took him away out of pity.

Infuriating not having any answers, isn't it?