Pinned Loading

1. smo-optimizer smo-optimizer Public

   SMO (State Memory Optimizer) is an ultra-memory-efficient PyTorch optimizer designed to solve the "Memory Wall" problem in Deep Learning. It reduces the optimizer state memory by 60-93% while retai…

   Python

2. delta-phase delta-phase Public

   DeltaPhase: High-Expressivity O(N) Complex Phase Matrix Delta-Rule Memory & Lerp Spectral Transformer for Subquadratic LLMs.

   Python

3. spec-rama spec-rama Public

   spec-rama is a parameter-efficient fine-tuning (PEFT) framework that combines Weight Permutation (Greedy TSP / Bipartite) with Spectral Core Adaptation (DCT, FWHT, DWT Wavelet) and RAMA Multiplicat…

   Python

4. soma soma Public

   SOMA: Sovereign Operative Memory Architecture — A cognitive operating system for long-horizon autonomous agents

   JavaScript

5. attention-neuron attention-neuron Public

   A neural architecture framework exploring low-rank multiplicative gating, spectral orthogonal bases (DCT/Walsh), complex-valued phase mixers, and conformal geometry over frozen substrates. Learning…

   Python

6. tiny-thinker tiny-thinker Public

   Un experimento educativo para construir, entrenar y evaluar un Modelo de Lenguaje Pequeño/Grande experimental (~100M parámetros) completamente desde cero usando PyTorch.

   Python