I designed a new architecture for language models to learn how to speak by starting with an empty dataset & only using accumulating memory.

Savvy is a model designed to accumulate data for episodic memory, sentence prediction & morpheme token prediction. These two experiments are proof of concept The goal for the first experiment was to teach Savvy how to say “hi Spaceman” which was harder than I thought because telling somon