"Oh. Um, but what if the person who raised you and teaches you isn't a woman? Like Gaster or Sans?"

Both of them have done a lot for him, but neither of them are female. So they can't be mothers. But they still seem like they do very important things, and S-4 doesn't want to dismiss them.