Rapid three dimensional two photon neural population scanning
Renaud Schuck, Peter Quicke, Caroline Copeland, Stefania Garasto, Luca A. Annecchino, June Kyu Hwang, Simon R. Schultz

TL;DR
This paper introduces a new method for 3D two-photon imaging of neural activity using electrically tunable lenses and spiral scanning algorithms to improve sampling rates.
Contribution
The novel integration of electrically tunable lenses with the Adaptive Spiral Scanning algorithm enables higher theoretical sampling rates for 3D neural imaging.
Findings
The proposed method achieves a theoretical sampling rate of 36.2Hz for 3D neural population scanning.
MATLAB simulations using Izhikevich neurons validated the algorithm's performance improvements over existing techniques.
Abstract
Recording the activity of neural populations at high sampling rates is a fundamental requirement for understanding computation in neural circuits. Two photon microscopy provides one promising approach towards this. However, neural circuits are three dimensional, and functional imaging in two dimensions fails to capture the 3D nature of neural dynamics. Electrically tunable lenses (ETLs) provide a simple and cheap method to extend laser scanning microscopy into the relatively unexploited third dimension. We have therefore incorporated them into our Adaptive Spiral Scanning (SSA) algorithm, which calculates kinematically efficient scanning strategies using radially modulated spiral paths. We characterised the response of the ETL, incorporated its dynamics using MATLAB models of the SSA algorithm and tested the models on populations of Izhikevich neurons of varying size and density. From…
Click any figure to enlarge with its caption.
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Fluorescence Microscopy Techniques · Photoreceptor and optogenetics research · Spectroscopy Techniques in Biomedical and Chemical Research
INTRODUCTION
I.
Understanding neuronal dynamics is a key step towards comprehending brain function and dysfunction and will help inform future treatments of brain disorders. In order to understand these dynamics the activity of many neurons must be sampled at high frequency and in three dimensions. Multiphoton laser scanning microscopy (MPLSM) of genetically encoded Ca^2+^ indicators enables high spatial (µm) and rapidly improving temporal (ms) resolution imaging of large numbers (up to 1000) of labelled neuronal subtypes. Thus far most imaging occurs in two dimensions due to the difficulty of quickly shifting the focal plane along the optical axis. This precludes cross-layer cortical information flow capture. To address this problem, several strategies evolved to image in 3D including acousto-optic devices (AODs) [1], mechanical objective translation [2], wavefront shaping [3] and electrically tunable lenses (ETLs) [4]. All of these techniques except ETLs require custom built or extensive additions to microscopes, whereas an ETL can easily integrate into a commercial MPLSM setup. Previous implementations combined ETLs with x-y raster scanning; however, as demonstrated by our previous work [5], ‘smart’ scanning strategies increase sample rates 5-10x by reducing time spent scanning extracellular space. Our algorithms take galvanometric scanners (GSs) and ETL inertia into account to calculate a faster spiral scanning trajectory in 3D. In this paper, we show two examples of 3D scanning strategies that resolve Ca^2+^ transients from GCaMP6f for a population of 800 neurons.
MATERIALS AND METHODS
II.
ETL Model
A.
Our system uses an ETL (EL-10-30-VIS-LD, Optotune) in conjunction with an offset lens (f = -75mm, LC4513-A, Thorlabs) placed close to the objective rear aperture, powered by a current source (LD3000R, Thorlabs), to axially translate the focal plane. We measured the current source command voltage/axial shift curve (Figure 1) using a phantom of 1µm fluorescent beads (F-13080, Life Technologies) suspended in 1% agarose. By measuring the objective displacement required to refocus the microscope onto beads as a function of voltage, we show that the ETL can be approximated by a linear system over a range of 120-800 µm. This range spans up to layer five of the mouse cortical column. Figure 1 shows the data with a linear fit with a slope of -3508µmV^−1^ and an offset of 51.94µm.
The measured axial shift of the focal plane (blue squares) as a function of command voltage fit with a linear function (red line) which we use to calculate its response. A = f (V) = −3508V + 51.94 where A is the axial shift in microns and V is the command voltage.
Figure 2 shows ETL step response data measured by Optotune [6] fit with our model (see table I), a damped sine modulated by a first order exponential:
Our model of the dynamic response of the ETL (blue line) fit to the step response recorded by Optotune (red points).
TABLE I:: Fitted parameters for our model of the ETL step response function. G is the gain, β the time constant of the first order exponential, ω0 the natural oscillation frequency, A the amplitude of the oscillation, α the damping factor and φ the phase.
Scanning and neural population model
B.
Our previous work introducing the 2D SSA algorithm [5] showed how we characterised the galvanometer’s (6215H, Cambridge Technology) transfer function similarly to the ETL. In order to validate the scanning algorithm on real brain tissue samples, GFP was expressed in mouse primary somatosensory cortex (S1) via stereotactic injection of adenoassociated viruses under the CAG promoter into C57BL/6 mice (Figure 3). 6 weeks post-injection, animals were perfused with 4% PFA, the brain removed and submerged in ACSF prior to 2-photon imaging. Procedures were Home Office (UK) approved and accorded with the Animals (Scientific Procedures) Act 1986. 3D algorithms use the transfer functions to calculate the driving signals, I_X_, I_Y_ and V_z_ delivered to the two GSs and the ETL respectively, to move the focal point to the coordinates X,Y,Z. The algorithm, given a set of neuronal coordinates, sorts the neurons by distance from the center of the field of view (FOV) and increasing axial depth. Starting at the FOV center it scans the neurons in an x-y spiral trajectory in a z-plane defined by the center of the first neuron. Once the spiral reaches the first neuron’s center the axial focal depth is increased stepwise using the ETL. Neuron densities are usually high enough such that the spiral will have sampled activity from the tops of deeper neurons. Therefore the depth is increased to coincide with the shallowest neuron center not already sampled sufficiently by the beam. This is shown schematically in figure 4. To test the algorithm we generated surrogate data from functional fluorescent signals governed by calcium indicator GCaMP6f dynamics [7] from firing patterns of Izhikevich neurons [8], [5].
An example beam path from our SSA algorithm applied to GFP labelled neurons. We acquired a full frame raster scan of 1024x1024 pixels and automatically extracted the coordinates of the neuron centres (red circles). Finally, we used these coordinates with our 2DSSA algorithm to generate a spiral scanning path (green line).
3D Scanning model block diagram. αX, αY and G are the gains in the open loop from GSX, GSY and the ETL respectively which are modulated to produce axially displaced spiral paths which sufficiently sample all neurons.
RESULTS
III.
Combining a simulated population of neurons emitting fluorescent signals and a 3D dynamical model of the scanning elements from a MPSLM, we built a platform that is able to test various kinds of scanning strategies. Here we describe the performance and limitations of the SSA algorithm extension.
SSA Algorithm extension for 3D scanning
A.
We used the SSA algorithm in a 2D experiment on 6µm fluorescent beads (Polyscience Inc) suspended in 1% Agarose. Driving the GSs above a threshold frequency elicited position drift. Hence, in our simulation we decreased the amplitude modulated sine frequency applied to the GSs I_X_, I_Y_ from ω_I_ = 10kHz to ω_I_ = 1kHz. Two 3D Algorithm were tested: the ‘Cylindrical’ scanning strategy (CST) and
Algorithm: 3D Cylinder Scanning Strategy
‘Orbital’ scanning strategy (OST) which differ by the type of ETL driving signal. For the CST, the voltage V_z_ applied to the ETL is a series of steps: [eqn] where i ∈{1..N}, G is the gain of the ETL, [z_i_]i∈{1..N} are the planes occupied by the neurons and N is the total number of scanned cells (See Algorithm (i)). For the OST, the voltage V_z_ applied to the ETL is an amplitude modulated sinusoid: [eqn] where A_i_∈{1..N} is the amplitude and ω_ETL_ the frequency of the voltage applied to the ETL. For reasons of clarity, we present only the CST algorithm in detail here. We combined the previously CST presented driving signals with specific geometric conditions (see Algorithm (ii) and Figure 4) resulting in modulated, tilted, circular trajectories fit to a randomly positioned 3D set of cells (Figure 5A, 5B and 5C), reducing the impact of the GSs inertia and where the user can define a neuron dwell time determining the time spent in each axial plane.
Two examples of 3D MPLSM scanning strategies on pseudo-random population of neurons. A, B and C represent the laser path in red for the CST for five, fifty and five hundred cells. The spherical neuron distribution is modelled with the spatial density of active cells in mouse V1 [9]. D, E and F represent the laser path of the OST.
Sampling frequency and Calcium transient acquisition
B.
Driving the dynamics of the GSs and the ETL with the above described driving signals enabled us to calculate the sampling frequency of our 3D scanning strategies across various neural geometries. Figure 6A shows that for a constant density of cells, there is a log-log linear decrease in sampling frequency for both the CST and the OST. Theoretically, single neuron action potential extraction necessitates a sampling rate over the Nyquist frequency corresponding to a calcium transient from a specific fluorescent protein. Based on these requirements, our simulation simultaneously resolved calcium transients (GCaMP6f) from 800 neurons with the CST and 700 neurons with the OST (Figure 6A). Our simulated raw PMT signal acquisition is based on the same principle as for the 2DSSA [5]. Figure 6B, 6C and 6D show ground truth fluorescent (green) and reconstructed Calcium transient (blue) from 5, 50 and 100 neurons sampled at 156Hz, 18Hz and 10Hz respectively for the CST.
3DSSA allows the sampling of high number of neurons. A is a loglog plot representing the Sampling frequency decay of both CST and OST according to the number of cells. This was done for a specific neuron density d = 9.5 ×10−5µm−3 and shows that we can resolve calcium transient for up to 800 cells with the cylinder scanning strategy. B, C and D describe ground truth fluorescent in green and reconstructed Calcium transient in blue from 5, 50 and 100 neurons sampled at 156Hz, 18Hz and 10Hz over 5s, respectively with the CST.
DISCUSSION
IV.
Here we present faster 3D scanning strategies using an ETL. Previous studies such as [4] reported a 21.6Hz scan rate for 34 neurons in two planes separated by 40µm using AODs. Our CST can sample 40 neurons distributed in and between equivalent planes using cheaper GSs at a higher rate of 36.2Hz. Simulations also indicate our strategy will be able to sample 800 neurons sufficiently fast to detect Ca^2+^ transients from GCaMP6f. Our OST further increases scanning speeds up to 51.6Hz for the same situation and offers significant increases for up to 200 neurons (Figure 6). We also hope to further increase scan speeds by applying optimal control theory to our 3D algorithms to find kinematically optimal modulations of the driving signals applied to GSs and ETL. The highest scanning speed that we can achieve whilst maintaining high enough sampling for good spike detection accuracy [10], [11] remains to be seen. One possible problem we anticipate when we implement high speed scanning in hardware is drift in focal spot position caused by heating of the ETL and GSs. This could cause the trajectory to drift enough to bypass some neurons completely and require software compensation. We are currently working towards validating our model by imaging functional fluorescent indicators in mouse cortex both in vivo and in vitro.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1G. Katona, G. Szalay, P. Maák, A. Kaszás, M. Veress, D. Hillier, B. Chiovini, E. S. Vizi, B. Roska, and B. Rózsa, “Fast two-photon in vivo imaging with three-dimensional random-access scanning in large tissue volumes,” Nature methods, vol. 9, no. 2, pp. 201–208, 2012.
- 2W. Göbel, B. M. Kampa, and F. Helmchen, “Imaging cellular network dynamics in three dimensions using fast 3d laser scanning” Nature methods, vol. 4, no. 1, pp. 73–79, 2007.
- 3S. Quirin, J. Jackson, D. S. Peterka, and R. Yuste, “Simultaneous imaging of neural activity in three dimensions” Frontiers in neural circuits, vol. 8, 2014.
- 4B. F. Grewe, F. F. Voigt, M. vant Hoff, and F. Helmchen, “Fast two-layer two-photon imaging of neuronal cell populations using an electrically tunable lens” Biomedical optics express, vol. 2, no. 7, pp. 2035–2046, 2011.
- 5R. Schuck, L. A. Annecchino, and S. R. Schultz, “Scaling up multiphoton neural scanning: The SSA algorithm” in Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE. IEEE, 2014, pp. 2837–2840.
- 6Datasheet: EL-10-30-Series, Optotune AG, 2014, updated: 13.04.2015.
- 7T.-W. Chen, T. J. Wardill, Y. Sun, S. R. Pulver, S. L. Renninger, A. Baohan, E. R. Schreiter, R. A. Kerr, M. B. Orger, V. Jayaraman et al., “Ultrasensitive fluorescent proteins for imaging neuronal activity” Nature, vol. 499, no. 7458, pp. 295–300, 2013.
- 8E. M. Izhikevich et al., “Simple model of spiking neurons” IEEE Transactions on neural networks, vol. 14, no. 6, pp. 1569–1572, 2003.
