Well, the catalyst doesn't exactly have to be material. If nothing else is present, the Master's personality will be used as a catalyst and the Servant summoned will resemble them in some way. I assume that was what happened with you.