neuroscience

CNS 2015 in Prague: Notes

Right after ICML 2015 I got to visit the Computational Neuroscience meeting in Prague. Impressed by the advances in deep learning and the AI field in general, I was eager to see how NS could benefit. This post served as a notebook during the conference and is biased towards trying to find applications of DL in the field of NS.

In general, this meeting seems to be quite modeling-oriented. Compared to the Bernstein meeting I attended last year CNS has less diversity in topics, which makes it probably good for people interested in their particular field, but leaves less space for more general ideas. Here the “computational” part seems to be more like a tool, and it is rarely an aim in itself.

Day 1

Learning and variability in birdsong by Adrienne Fairhall.
The computational model uses STDP in a reinforcement learning paradigm implemented in a simple shallow neural net. To note: STDP as a core of a learning algorithm once again.

Day 2

Wilson-Cowan Equations for Neocortical Dynamics by Jack Cowan.
Quite interesting history lesson about McCulloch, Pitts, von Neumann, Shannon. Wilson-Cowan equation — a model for neuronal populations.

Limit of scalability of neural network models by Sacha van Albada.
Typical correlations in networks are 0.01-0.25. Looked at downscaling.

High-conductance state in prediction of LIF neurons and sampling. by Mihai A. Petrovici.
LIF (Leaky Integrate-and-Fire)-based Boltzmann machines. 96.7 on MNIST (95 is kNN, 99.5 with CNN). Implemented on the “Spikey” neuromorphic chip.

Quantifying the distance to criticality under subsampling by Jens Wilting, Viola Priesemann.
Subsampling means just that we are limited in how much we can measure. Criticality maximizes information processing in networks. Supercritical — epilepsy. The brain does not operate at the critical threshold, but in the subcritical region. They want to measure the distance from the brain operation mode to criticality and overcome the limits of subsampling the process. Distance measure: branching network, branching factor: σ<1\sigma < 1 — subcritical, σ=1\sigma = 1 — critical, σ>1\sigma > 1 — supercritical. Multistep Linear Regression estimator from sample instead of the conventional extrapolation of spike numbers from a subsample. MLR is robust to subsampling.

www.neuroelectro.org
Lots of ways to explore the collected data. Genetic microarray data coupled with electrophysiology data as an example.

Complex synapses as efficient memory systems by Marcus K. Benna.
Why is a synapse not just a number? One of the important roles of the complicated synaptic connection scheme is maximizing memory capacity. Measure memory by SNR over time: the lower the SNR after time Δt\Delta t, the less memory the synapse has. Could this model serve as a replacement for LSTM or GRU gate? Not sure what the constraint on the complexity of the model is: if my task is to maximize memory, why can’t I just take as complex a system as I want and be done with it? Biological constraints are probably the answer, but they were not explained.

Self-organization of computation by synaptic plasticity interactions by Sakyasingha Dasgupta.
STDP as a learning mechanism once again: Wi,j∼Fi×FjW_{i,j} \sim F_i \times F_j, where FiF_i is presynaptic spikes and FjF_j is postsynaptic?

A model for spatially periodic firing in hippocampus
Place cells. Grid cells. Head direction cells.

Day 3

The Dynamics of Resting Fluctuations in the Brain by Gustavo Deco.
There is resting state activity in the brain, thus we should not treat black-box-brain as a baseline, but should try to account for underlying processes.

Investigating the Effect of Electrical Brain Stimulation using a Connectome-based Brain Network Model by Tim Kunze.
1-2 mA stimulation with 2 electrodes. Experimented in The Virtual Brain framework. Different input levels provoke different dynamic states. Not sure what the conclusion is.

Closing the Loop: Optimal Stimulation of C. elegans Neuronal Network via Adaptive Control to Exhibit Full Body Movements by Julia Santos.
Created movement in an artificial worm by stimulating the right neurons. The resulting “worm” is able to crawl forward and backward.

Day 4

Self-Organization to sub-criticality by Viola Priesemann.
Try to drive DNN to criticality and see whether performance will be better / number of neurons needed smaller?

Day 5

Change Point Detection in Time-Series by Justin Dauwels.
Gaussian graphical models. Other methods for point detection are slow (like O(n3)O(n^3)), here O(n)O(n) and o(n)o(n) are proposed. Penalized maximum likelihood method. Variational Bayesian inference.

Large-scale cortical network models with laminar structure: frequency-specific feedforward and feedback interactions by Jorge Mejias.
Large-scale model with bioplausible constraints (shouldn’t all brain models be like that?) of the macaque cortex. Explains how inputs (stimuli) affect gamma and a bunch of other things.

Slow Sleep Oscillations and Memory Consolidation by Maxim Bazhenov.
Sleep consolidates memories of facts and events. Slow wave sleep — declarative memory, REM — non-declarative. Wake: sensors -> thalamus -> cortex (short-term) -> hippocampus. Sleep: thalamus <-> cortex (reinforcement) <-> hippocampus.

Reconstruction and Simulation of Neocortical Microcircuitry by Eilif Muller.
Blue Brain Project. Overview of modelled structures. 86% excitatory, 14% inhibitory. They do massive simulations over morphologies and over different neuron types. Synaptic anatomy. Looks like the most reasonable view of the modeling approach I’ve seen so far.

Spatial properties of evolving seizures: what we can learn from human microelectrode recordings by Cathy Schevon.
Seizure localization from intracranial recordings. Utah array + ECoG grid.

Day 6

…

Posters

There was a poster about Tempotron — a perceptron with time. Should I look into it, or is this once again a reformulation of known things into a new framework?

Poster by Michael — we can ask him about it once we want to understand the IT measure he is developing.