Deprecating the Hash Encoder: The Transition to CMP v1.9
A detailed breakdown of why the hash encoder failed to generalize across OOV and morphologically rich structures, and how the LearnedSparseEncoder solves these specific failure modes while maintaining state efficiency.
Read Architecture Note →Hebbian Updates in Conversational State
Initial findings from attempting to map emotional weights to concept nodes across 1,000-turn conversational histories using localized Hebbian updates instead of full-context backpropagation.
View Log →Predictive Coding vs BPTT on Sequence Memorization
We tested a toy PC-CMP model against a standard LSTM on a sequence memorization task. Local prediction-error updates reached 92% of the accuracy achieved by global BPTT, but struggled with sequences longer than 50 steps.
Read Report →The Relational Binding Matrix Formulation
The core mathematical formulation for our early relational state binder, detailing how entity-role pairs are compressed into a fixed-size state vector without catastrophic interference.
Download PDF →