current-stuff
Table of Contents
- The Neuronal Ensembles | Neuronal Memes
- Neurophilosophy Stuff | Neuronal Memetics, Wizards Of Activation
- Neuronal Memetics
- Notes On A Constructor Theory of Adaptation
- The Activity On Top of the Neurons are Animals | A new Biology
- Hyperdimensional Computing | Sparse Distributed Memory | Associative Models
- Multiparadigm
- Literature
- The Computational Universe Telescope
Ideas are a kind of animal.
- Software developer, clojure enthusiast, social activism volunteer, now thinking about neurophilosophy from an engineering and biology point of view.
- Looking for the stuff between the mind and the computer.
"The Current AI is not as smart as a 4 year old. It's not as smart as a cat for that matter".
embodied… ?
- robots?, nah - toy worlds
- software animals with their own rules ✅
- toy chemistry ✅
- toy game worlds ✅
- toy sub-cognitive modeling ✅
- toy toys ✅

- go slow, engineer small animals
- Braitenberg: 'Upward Synthesis'
- bottom up design: programming philosophy of the MIT lab
- S. Papert, M. Minsky, G. Susmann, H. Abelson
- There is plenty of room at the bottom. (R. Feynman).
- Perhaps there is plenty of animal capability at the bottom, building animals shows what the requirements are.
- The logic of evolutionary drivers: A function is implemented via structure.
- How do the control centers of the brain relate to the world and each other?
(colors aesthetics)
[From S. Murray Sherman and R. W. Guillery, Functional Connections of Cortical Areas]
Perhaps by building the other control centers, we will ganglia-thalamo-cortical shaped holes.
The Neuronal Ensembles | Neuronal Memes
Recurrent neuronal nets with sheet inhibition make stable, coherently sub-networks. They are the on top of the neurons, and can be see as the "neuronal letter" of the "neuronal alphabet" (Yuste).
My idea is that there is a new kind of biology, the structure and function of the neuronal ensembles. They are a kind of animal.
Levin tentatively suggests "Ideas are alive". We merely have a substance chauvinism.
Braitenberg, Donald Hebb, Rafael Yuste, György Buzsáki, others: The Neuronal Ensembles.
Figure 1: Blerp fields with different parameters. Cyan has higher attenuation, making the elements move. Blerps are inspired by neuronal ensembles.
Hebb: Cell Assemblies, The Organisation of Behaviour 1949
- theoretical psychology
- Influenced Dan Dennett
focus: causality structure
Figure 2: A Hebban Cell Assembly (conceptual) is a group of neurons activating each other.
If A goes to B, then B follows A. The cell assemblies together with the proposed local learning rule, Hebbian Learning is called Hebbian Theory. Neurons that fire together, wire together - the slogan is somewhat misleading. It is the neurons that cause each other to fire that wire, it takes 2 timesteps to do that.
Thought Pump:
- Activate the halo of the assembly by increasing the excitability.
- By decreasing the excitability, the assembly would narrow down into one of its centers.
- This depends on a threshold device, something that regulates the thresholds (excitability) of all neurons in question "area"?, column?, whole cortex?, 'sheet wise', claustrum?, basal ganglia? thalamus?, not figured out.
- It should select the best-connected sub-center (given ideal inhibition, see below).
- This move then, could be done at the speed of 2 neuron timesteps, and it could be a parallel search process.
- Jumping from thought to thought, creating a 'train of thought', hence 'thought pump'.
Figure 3: Concept of a Cell Assembly with halo. The halo only only activates if the excitability of the neuronal substrate is high.
- If the assemblies are 'settled' and "don't move" anymore, perhaps this could be interpreted as the 'best reachable interpretation' for the system.
- This remains to be purely conceptual afaik. But is a cool idea to have in any case.
Since you are scrolling through already, check out this work on visualizing much of the activity in a zebrafish larva:
Moshes Abeles: Synfire Chain
And so forth.
Perhaps the details don't matter.
Reverberating across brain areas for multisensory integration
[Pulvermueller: Semantic grounding of concepts and meaning in brain-constrained neural networks] [A neuroanatomically grounded Hebbian-learning model of attention–language interactions in the human brain]
The Thalamus
- Messages and modulators are 2 different kind of things, messages drive activity
- The thalamus is the driving input to all cortical areas
- Cortex cannot be understood without understanding cortex and thalamus (my conclusion)
- Consequently, the only way for a lower cortical area to drive activation in a higher area, is by outputing some kind of motor data! I find this quite remarkable.
- SDM Address Decoder?
- awesome talk:
- maybe memes are bags of counterfactual expectations
- memes know themselves how to be used
Up to pre-frontal areas, perhaps…
Not only circuits, electric fields
- (Peter Godfrey-Smith Metazoa for a chapter, György Buzsáki Rhythms of the Brain for a book).
- Ephaptic coupling, has a cool history
Synchrony
- This is old: Wolf Singer:
Gray, Charles M.; König, Peter; Engel, Andreas K.; Singer, Wolf (1989). "Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties". Nature. 338 (6213). Springer Science and Business Media LLC: 334–337.
- Earl Miller: Cognition is Rhythm, neurons that humm together, wire together.
- Has been proposed as a bind operator for long.
Rhythms / Neuronal Syntax
Seminal, as far as I am concerned: Neural syntax: cell assemblies, synapsembles, and readers György Buzsáki
Buzsáki cleans up the Cell Assembly concept with the reader centric cell assembly.
At the same time he puts into the center what was obvious and causing a certain amount of confusion so far:
Synchronous (correlated) activity only has an effect, if it has an effect. For instance a reader neuron listening for sync activation.
- György Buzsáki, Neuronal syntax
- Ensembles are like notes
- ~7 ensembles are a putative neuronal letter
- Rhythms are widely preserved across brain sizes
- Bonus: Octopi have a similar EEG to humans with more γ [Peter Godfrey-Smith, Metazoa]
Multiple γ cycles, each containing their own cell assembly, can be thought of as being “neural letters” and these letters can then be combined to create “words” and later “sentences.” More precisely: discrete episodes or packets of γ oscillations, which are typically shortlasting,5,15,45,58,59 are often grouped by slower oscillations via cross-frequency phase coupling (Figure 2).12,14,15,60-62 This packeting can be thought to associate the “letters” contained in the series γ cycles to form a neural “word.” An example would be a γ “burst” which might be cross-frequency coupled to 0 and therefore present in a single θ cycle.63-66 Then slower rhythms In which θ waves nest can bind such words into “neural sentences,” ie, longer messages of information, coordinated across large brain territories.
- Peter Pesic Polyphonic Minds, Music of the Hemispheres: Understanding brain function in terms of music.
- I.e. consoncance, dissonance, multi-voicednes (~ parallelism), 'tonal fabric' | stuff like that not as mere analogy

Nereunal interpreter
If there is a code, there is an interpreter / interpreters.
Genome computation:
- letter: Base pair
- word: codon tripplet
- interperter: ribosome
Neuronal computation:
- letter: γ oscillations packets, discrete ensemble
- word: A series of γ cycles, for instance ~7 in one θ cycle
- sentence / composite: speculative, longer time intervals? 👈
- interpreter: ??? 👈
Neurophilosophy Stuff | Neuronal Memetics, Wizards Of Activation
- The dragons of old turned out to be dinosaurs
- So the spirits of old turn out to be the software that animates the world. (Josha Bach, Valentino Braitenberg).
What is brain software?
An operating system of a biological computer that makes a magical interface to it's user (also person).
The Magical Interface
- Is the benchmark for a good interface. As in: "This tool is like an extension of my mind".
Perhaps It allows an ad-hoc crafting and debugging of pieces of technology until something that sticks is found that serves some purpose until a replacement is found.
Sevant-syndrome indicates that the capacity of this technology is seemingly infinite, the bottle-neck being how much time and effort the person is engaging with the activity in question.
- The developing brain has 4 years + some months to make a 4 year old
- The brain performs a software synthesis task, this must incorporate substantial design
The synaptic overproduction and subsequent pruning seems at first glance a general fit for evolutionary variation and selection.
Synaptic pruning:
- at least 50% of synapses disappear
- neurons that act jointly appear to maintain synapses between them
- 'the brian is sculped by activity'
critical periods:
WIESEL TN, HUBEL DH. SINGLE-CELL RESPONSES IN STRIATE CORTEX OF KITTENS DEPRIVED OF VISION IN ONE EYE. J Neurophysiol. 1963
The Magical Interface
- Dan Dennett acknowledged the user interface nature of the mind, and made an anology to virtual machines.
- Dennett's analysis stopped at a 'hiding of the details', this is where we can improve upon.
A main idea of computer science is that each layer can be implemented by any layer below, becase of turing universality.
But… if this is software
But with ~ 200 brain structures, the brain might wear it's computational layer on it's sleave so to say.
Not the software layer, that would be implemented in terms of information transformations.
The flip side of turing universality is that programming languages are not powerful because they allow something new to say. It is how they allow to say it. It is a concern of elegance and design.
The competence of a software framework, language, operating system is in what it makes it easy to say. 👈
- Software engineering so far did not have much influence on neuroscience.
- Part of the reason for this is that the philosophy of programming is a niche topic
- For instance the property of Lisp to have a runtime interface to the language is not widely appreciate, yet it is a fundamental step in the power of a language
Neuronal Memetics
- genotypes, phenotypes?
- meme engine wizards
Notes On A Constructor Theory of Adaptation
(Colors merely aesthetic).
Gene: A piece of information that replicates and is instantiated in the genome as "genome snippet" (the second meaning of the word gene).
Knowledge: A replicator which causes itself to be stable in an enviroment, also called it's niche. I.e given a niche it is a replicator.
Adaptation: The effects that a knowledge has, given a niche, that causes it to be a replicator.
Adaptation is allowed to become intricate, with many sub-parts contributing to a system of effects. I would say the means of survival and replication - called the extended phenotype (Dawkins 2016).
This typically involves an organism, instantiated via development (Ontogenesis) in biology, but it is not limited to the borders of an animals skin.
Indeed it is not limited to biological substrate at all, as in technology like beaver dams and even more insubstantially, in animal behaviour. And propensities for learning (Baldwin), psychological developmental plans (A. Sloman), etc.
The phenotype is extended, actually this is another thing sayable with constructor theory. All possible effects that genes can have are allowed to be phenotypes.
Adaptationism: The bio philosophical position that holds that design in biological systems is created by natural selection.
Natural selection: a approximate construction, whose substrates are populations of replicators and whose (highly approximate) constructor is the environment. Marletto Constructor Theory of Life.
Is a mechanism that is sufficient for creating design, i.e. adaptations.
And is the only known mechanism for creating design in biology.
Natural selection needs a population of variants of replicators, from which the ones with highest fitness (inclusive genetic fitness in biology) are selected. I.e. the ones with best design, the best effects that caused them to replicate.
For this reason, any adaptation can only be an adaptation (i.e. display design), if it caused by a replicator for which the variants are possible. 👈
An attribute is a set of states of system.
Adaptation, the sense of design has to be caused by a replicator. Information with causal power (C. Marletto, S. Walker).
In constructor theory of information - the permutations have to be possible.
Something like that:
For all attributes of an adaptation a
, there exist permutations of the information variable Σ,
that causes the variants of a
.
Not sure what the variants are, has to do with the kind of universality the system achieves?
The interpreter of the genomic code (Ribosomes in the case of genes) have to have 'a certain universality'.
If a natural selection theory of brain software design is true, there should be a 'genome-like' information medium.
- The information variable Σ, is a set of attribues where the task of peforming the permutation over Σ and the replication task over Σ are possible.
- The attributes of an information variable are called information attributes.
- An information medium is a substrate whose attributes constitute an information variable.
(C. Marletto 2014, ct-life):
??
- Do the information attributes of the genome-like neuronal meme medium correspond to the neuronal code?
Everything the neuronal interpreter can do, the neuronal memes need to be able to say.
Here I'm drawing what I think Dawkins has in mind:
The Activity On Top of the Neurons are Animals | A new Biology
Hyperdimensional Computing | Sparse Distributed Memory | Associative Models
It should also be noted that the message system used in the nervous system, […] is of an essentially statistical character. In other words, what matters are not the precise positions of definite markers and digits, but the statistical characteristics of their occurrence, i.e. frequencies of periodic or nearly periodic pulse-trains, etc. Thus the nervous system appears to be using a radically different system of notation from the ones we are familiar with in ordinary arithmetic and mathematics: instead of the precise systems of markers where the position - and presence or absence - of every marker counts decisively in determining the meaning of the message, we have here a system of notations in which the meaning is conveyed by the statistical properties of the message. […] This leads to a lower level of arithmetical precision but to a higher level of logical reliability: a deterioration in arithmetics has been traded for an improvement in logic.
John von Neuman - The computer and the Brain

Pentti Kanerva - Sparse Distributed Memory
hyperdimensional computing:
H
, the hyperspace is vast.- 'The blessing of dimensionality'
- All hypervectors are roughly same distance apart.
- There is a tiny region in
H
where inputs similar to the address lie. - Encountering inputs that are similar to the address is astronomically to be random.
- 'programming with embeddings', can model semantic spaces, 'concept particles'
- and structure via VSA operations: Datastructures, trees, sequences, FSA, etc.
- programming in superposition (in the classical domain)
The address decoder neuron:
Hearing the voice of a person, say 'Bob', always sounds like the same voice, even though the particulars of the sensor data must be quite variable.
In Hofstadter's terms, we make an analogy between the instances of hearing Bob's voice. We understand/categorize/make the analogy / analyze the situation / find the essence of the 'hearing Bob's voice situation'.
Whatever represents such an internal situation is quite robust to noise.
The Reader Centric Cell Assembly
- They share a downstream
reader
. - They fire together in a time window given by the integration time ("tau") of the reader.
Neural syntax: cell assemblies, synapsembles, and readers György Buzsáki
Attention Approximates Sparse Distributed Memory
Multiparadigm
Flavours of Neuronal Nets?
Basal ganglia, Striatum: Medium spinal neurons look like a dense layer.

[ Rafael Yuste, Lectures in Neuroscince © 2023 Gil Costa ]
- each spine dendrite gets 1 neuron input
- cortical pyramidal neurons make as many connections to single dendrites
Cajal (Santiago Ramón y Cajal 1852-1934):
this manner of connecting neurons was like telegraph wires strung on poles.
Early Nervous Systems / The Animal way of life


Rodolfo Llinás, György Buzsáki, others the primacy of action

Nicholas Stausfeld, Ph.D.:
identification of evolutionarily conserved ground patterns of neuronal organization
… of centers mediating visual perception, allocentric memory, and action selection.
Other 'basal cognition' kinda things:
Breaking the neural code of a cnidarian: Learning principles of neuroscience from the “vulgar” Hydra
Literature
The Brain From the Inside Out 2019
Valentino Braitenberg
https://en.wikipedia.org/wiki/Braitenberg_vehicle
P. Kanerva, “Hyperdimensional computing: An introduction to computing in distributed representation with high-dimensional random vectors,” Cognitive Computation, vol. 1, no. 2, pp. 139–159, 2009.
Sparse Distributed Memory, Pentti Kanerva 1988
Peter Pesic
The Computational Universe Telescope
