Preview of the talk I'm giving on Friday. #neuroscience #CompNeuro #ComputationalNeuroscience
Preview of the talk I'm giving on Friday. #neuroscience #CompNeuro #ComputationalNeuroscience
Low stakes pet peeve of the day: spiking neural network people stop saying SNNs are the third generation of ANNs. They predate them! #compneuro
I'm giving an online talk starting in 15m (as part of UCL's NeuroAI series).
It's on neural architectures and our current line of research trying to figure out what they might be good for (including some philosophy: what might an answer to this question even look like?).
Sign up (free) at this link to get the zoom link:
Come along to my (free, online) UCL NeuroAI talk next week on neural architectures. What are they good for? All will finally be revealed and you'll never have to think about that question again afterwards. Yep. Definitely that.
Wed 12 Feb 2025
2-3pm GMT
Details and registration: https://www.eventbrite.co.uk/e/ucl-neuroai-talk-series-tickets-1216638381149
Visual cognition in multimodal large language models
#CompNeuro #NeuroAI
www.nature.com/articles/s42...
Visual cognition in multimodal...
What's the right way to think about modularity in the brain? This devilish question is a big part of my research now, and it started with this paper with @GabrielBena finally published after the first preprint in 2021!
https://www.nature.com/articles/s41467-024-55188-9
We know the brain is physically structured into distinct areas ("modules"?). We also know that some of these have specialised function. But is there a necessary connection between these two statements? What is the relationship - if any - between 'structural' and 'functional' modularity?
TLDR if you don't want to read the rest: there is no necessary relationship between the two, although when resources are tight, functional modularity is more likely to arise when there's structural modularity. We also found that functional modularity can change over time! Longer version follows.
Discovered the COSYNE 2025 workshop program is out!
Looking forward to fascinating computational neuroscience talks & discussions (March 31-April 1, 2025).
Check out the program: https://www.cosyne.org/workshops-program-2025
See you there! #COSYNE2025 #CompNeuro @CosyneMeeting
@CosyneMeeting #Cosyne
New preprint! With Swathi Anil and @marcusghosh.
If you want to get the most out of a multisensory signal, you should take it's temporal structure into account. But which neural architectures do this best?
Emergence and maintenance of modularity in neural networks with Hebbian and anti-Hebbian inhibitory STDP
with R. Bergoin. @gzamora-lopez.bsky.social , G. Deco, M. Quoi
#neuroscience #compneuro #brain #neuralnetwork
#neurodon @virati @hnp_geneva
An open access paper :
Gamma oscillatory complexity conveys behavioral information in hippocampal networks with V Douchamps, M di Volo, D Battaglia and R Goutagny
Nat Comm 15, 1849 (2024)
Our findings challenge the idea of rigid gamma sub-bands, showing that behavior shapes ensembles of irregular gamma elements that evolve with learning and depend on hippocampal layers
https://www.nature.com/articles/s41467-024-46012-5
#neuroscience #compneuro #brain #neuralnetwork
#neurodon @virati @hnp_geneva
(10/n) If you’ve made it this far, you’ll definitely want to check out the full paper. Grab your copy here:
https://www.biorxiv.org/content/10.1101/2024.12.17.628339v1 Sharing is highly appreciated!
#compneuro #neuroscience #NeuroAI #dynamicalsystems
We have a new preprint on the emergence of orientation selectivity in layers 2/3 and 4 of the mouse. We use data from the Allen Institute's Microns project, which includes structure plus function of thousands of neurons, to constrain network models that account for the observations and hint some key features on the origin of tuning in L2/3. For any feedback, do not hesitate to contact us!
My latest work “Zero-shot counting with a dual-stream neural network model” is now published in Neuron. We present evidence for an enactive theory of the role of posterior parietal cortex in visual scene understanding and structure learning. Like the primate brain, our model apprehends a visual scene via a sequence of foveated glimpses. Both glimpse contents and glimpse locations are fed into our model, enabling the model to learn abstractions that are grounded in action (here, eye movements) rather than merely in the sensory domain. We show that this architecture enables zero-shot generalization of a previously learned structure (numerosity) to new objects in new contexts in a setting where a vanilla CNN fails to generalize. Our model also replicates several signatures of (the development of) human counting behaviour and learns representations that mimic neural codes for space and number in the primate brain.
#neuralnetworks #compneuro #neuroscience #4ECognition #attention
https://www.sciencedirect.com/science/article/pii/S0896627324007293
I've added a new chapter on #VariationalAutoencoders (VAE), including an exercise that shows how to train a #VAE to predict behavior from neural data inputs.
We just completed a new course on #DimensionalityReduction in #Neuroscience, and the full teaching material is now freely available (CC BY 4.0 license):
https://www.fabriziomusacchio.com/blog/2024-10-24-dimensionality_reduction_in_neuroscience/
The course is designed to provide an introductory overview of the application of dimensionality reduction techniques for neuroscientists and data scientists alike, focusing on how to handle the increasingly high-dimensional datasets generated by modern neuroscience research.
Functional responses in the brain to linguistic inputs are spatially organized -- but why? We show that a simple smoothness loss added to language model training explains a range of topographic phenomena in neuroscience: https://arxiv.org/abs/2410.11516
#NeuroAI #neuroscience #compneuro #language
PhD position openings in my group! Check out topics and how to apply below. At the moment, I'm particularly interested in the topic of modularity in both biological and artificial networks, and how it can be used to scale up intelligent processes.
https://neural-reckoning.org/openings.html
Note that competition for PhD funding at Imperial is pretty strong these days, so worth checking if your undergrad/masters grades are equivalent to UK 1st/Distinction before applying. I'm afraid I don't take self-funded PhD students.
Oh Tx A!
What a pleasure reading classic pioneers humble candid remarks!
Contrast to nowadays endless new-papers new-models proposals without any scientific model self awareness on bias towards invalidation, and lacking such kind of remarks of owns models testable limitations, with such candid remarks alerts to fellow readers!
Also from B. Katz, the other coauthor in one of the #HodgkinHuxley original quintet of seminal #compneuro papers!
Reminds of their 1952b that remarks:
I'm not the physicist here, but honestly, framed as "showing how statistical physics can explain and implement forms of learning" sounds great as a Nobel Prize motive.
Now get with me through the rabbit hole...
(Maybe I should flip the edges and put something else in the center of the meme)
Belief stickiness and poor state inference aka obsessions are anticorrelated with plasma levels of SSRI esticalopram in a randomized double-blind placebo controlled study #neuroscience #compneuro #ComputationalPsychiatry https://www.biorxiv.org/content/10.1101/2023.12.08.570769v1