Skip to content

ZeroNihl/triads

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Triads

Cognicum

Road Map

  • General
    • Energy Based Continuous and Non Continuous Local Hopfield Hebbian Backprop Based Learning
    • Prevent Solution Space Sadel Points and Growing Plasticity Laziness (Search Term For It)
    • Better Local and Global Temporal and Dream Space Navigation
    • Merge Sparsely Managed Tensors and Classes Into a Single Class and Forward Where The Sparse Tensors Are Now Part of Large Tensor Chunks We Can Now Define Conditional Operation Branching on This Chunk For Reduced CPU and Improved GPU Usage
    • TODO
  • SQHN
    • TODO: See Github Page, Don't Forget Paper of Spherical Asynchronous Triadic Neuron
  • Attention Heads
    • Basic Attention Head
    • 3D Attention Head
    • Convolutional Attention Head
    • SSM Attention Head
    • SQHN Attention Head
    • 3D SSM + SQHN + Convolutional Attention Head
    • 3D SSM + SQHN + Self Feedback + Convolutional Attention Head
    • TODO
  • Latent Space
    • Basic Attention Head Encoder
    • Basic Attention Head Decoder
    • Multi Modal Associative Encoding
    • Multi Modal Associativity Attention Head Routing
    • TODO
  • Information Identifiers (Identity/Holon ID)
    • Simple Identifier
    • Identifier with 3D SSM + SQHN + Convolutional Attention Heads
    • Identifier With Local/Internal Context
    • Identifier With Global/External Context
    • Identifier with 3D SSM + SQHN + Context + Convolutional Attention Heads
    • TODO
  • Routers (Correlation/Holon Interactions)
    • Basic MOE Router
    • Attention Head MOE Router
    • Hierarchical Dimensional Axis Attention Head MOE Routers
    • Interconnect Attention Head MOE Routers
    • 3D SSM + SQHN + Context + Convolutional Attention Head MOE Routers
    • TODO
  • Cognicum Space (Chage/Holon Evolution)
    • TODO

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published