The earliest known image of Willie Lincoln; In 1862 Mary's favorite son, Willie, died in the White House. This led to a tormented period of mourning. According to Elizabeth Keckley, Mary's seamstress, her grief was so overbearing that Mr. Lincoln warned she would have to be sent to an asylum if she couldn't control it.