Pulse-to-pulse wavefront sensing at free-electron lasers using ptychography
Simone Sala, Benedikt J. Daurer, Michal Odstrcil, Flavio Capotondi,, Emanuele Pedersoli, Max F. Hantke, Michele Manfredda, N. Duane Loh, Pierre, Thibault, Filipe R. N. C. Maia

TL;DR
This paper introduces a ptychography-based method for pulse-to-pulse wavefront sensing in free-electron lasers, enabling high-resolution, diffraction-limited characterization of individual ultra-short pulses in their native imaging state.
Contribution
The paper presents a novel lensless ptychography technique capable of retrieving complex wave functions of FEL pulses at high resolution, suitable for native diffraction conditions.
Findings
Achieves diffraction-limited resolution in wavefront sensing
Successfully retrieves complex wave functions of individual pulses
Applicable to various short-pulse instruments
Abstract
The pressing need for the detailed wavefront properties of ultra-bright and ultra-short pulses produced by free-electron lasers (FELs) has spurred the development of several complementary characterization approaches. Here we present a method based on ptychography that can retrieve full high-resolution complex-valued wave functions of individual pulses. Our technique is demonstrated within experimental conditions suited for diffraction experiments in their native imaging state. This lensless technique, applicable to many other short-pulse instruments, can achieve diffraction-limited resolution.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
\journalcode
J
Sala\aufnCurrent address: MAX IV Laboratory, Lund University, Lund, \countrySweden
Daurer Odstrcil Capotondi Pedersoli Hantke Manfredda Loh
\cauthor
\cauthor
[c]Filipe R. N. [email protected]
\aff
[a]Department of Physics & Astronomy, University College London, London, \countryUK \aff[b]Department of Physics & Astronomy, University of Southampton, Southampton, \countryUK \aff[c]Department of Cell and Molecular Biology, Uppsala University, Uppsala, \countrySweden \aff[d]Department of Biological Sciences, National University of Singapore, \countrySingapore \aff[e]Paul Scherrer Institut, Villigen, \countrySwitzerland \aff[f]Elettra-Sincrotrone Trieste, Trieste, \countryItaly \aff[g]Department of Chemistry, Oxford University, Oxford, \countryUK \aff[h]Department of Physics, National University of Singapore, \countrySingapore
Pulse-to-pulse wavefront sensing at free-electron lasers using ptychography
Simone
Benedikt J
Michal
Flavio
Emanuele
Max F
Michele
N. Duane
Abstract
The pressing need for the detailed wavefront properties of ultra-bright and ultra-short pulses produced by free-electron lasers (FELs) has spurred the development of several complementary characterization approaches. Here we present a method based on ptychography that can retrieve full high-resolution complex-valued wave functions of individual pulses. Our technique is demonstrated within experimental conditions suited for diffraction experiments in their native imaging state. This lensless technique, applicable to many other short-pulse instruments, can achieve diffraction-limited resolution.
1 Introduction
Free-electron lasers (FELs) are opening the way to a number of new research paths. Within the field of microscopy, the highly coherent and short pulses produced by FELs are used to conduct diffractive imaging of individual particles, also called flash X-ray imaging (FXI), potentially down to atomic resolution [Neutze2000, Chapman2006a, Seibert2011]. Many other investigations exploit FEL tight focal spots to maximize fluence or improve spatial resolution [Willems2017, Vidal2017, Mincigrucci2018]. For all these applications, a reliable high-resolution characterization of the shot-to-shot focal spot is crucial. A number of beam diagnostics methods have been purposely designed for this task. However, with ultrashort pulses (down to femtoseconds) which can reach a flux sufficient to destroy or irreversibly damage most targets, these methods mostly provide only partial information about the wavefront, such as position, size, shape, intensity or curvature [Chalupsky2011, Vartanyants2011, Rutishauser2012, Loh2013, Sikorski2015, Keitel2016, Daurer2017]. A recent grating-based method can provide real-time wavefront distributions [Schneider2018, Liu2018], though away from the focal plane and with a resolution limited by the grating’s manufacturing process.
At third-generation synchrotron sources, ptychography is now a popular wavefront characterization tool [Kewish2010a, Schropp2010, Takahashi2011, Honig2011, Vila-Comamala2011], thanks to its ability to retrieve the complex-valued wavefield in or close to the focal plane (the probe) along with the transmission function of the sample (the object) [Thibault2009, Maiden2009]. Recent improvements to ptychographic reconstruction algorithms address additional sources of data degradation, such as partial coherence [Thibault2013], scanning position jitter [Guizar-Sicairos2008, Maiden2012a, Beckers2013, Zhang2013, Tripathi2014] and probe variations [Odstrcil2016]. The recovered illumination wavefields can be numerically propagated to refine the focal position or to reveal optics-induced aberrations.
Here we show that ptychography can be used to reliably reconstruct the wavefront of individual FEL pulses. Our approach requires no a priori information on either object or probes, and all individual wavefronts are allowed to vary, including their positions. Unlike a previous application of ptychography at the FEL which filtered the pulses through additional optics [Schropp2013], our method retrieves wavefronts in the native imaging state, i.e. the same conditions in which the apparatus is used for imaging or diffraction experiments.
2 Methods
The experiment was carried out at the DiProI instrument of FERMI (see Appendix for details), a seeded FEL producing pulses, at a photon energy of , equivalent to a wavelength of . Figure 1 gives a schematic representation of the experimental setup. After attenuation by about 4 orders of magnitude to avoid damage, the beam was focused by a pair of perpendicular bendable Kirkpatrick-Baez (KB) mirrors to a focal spot size of under 10\text{,}\mathrm{\SIUnitSymbolMicro m}. The sample – positioned close the focal plane – was a gold test pattern featuring a 30\text{,}\mathrm{\SIUnitSymbolMicro m} Siemens star whose SEM image is represented in Fig. 2a. At the sample behaves as a binary object since the gold-plated areas absorb completely the incident X-rays. Far-field diffraction patterns were detected with a CCD camera located downstream from the sample.
Ptychographic data were collected by scanning the sample over the Siemens star area. A wide jitter of the photon beam position, observed throughout data acquisition and caused by vibrations of an upstream optical component, was first corrected using a cross-correlation approach and then further refined. This procedure, which would normally not be needed in a routine application of the method, reduced the number of valid frames down from 1515 to 937.
The ptychographic reconstruction was carried out using a single-pulse retrieval algorithm derived from the orthogonal probe relaxation ptychographic (OPRP) method [Odstrcil2016] which recovers a different probe for each diffraction pattern while keeping the problem over-constrained through dimensionality reduction. Individual probes are thus modeled as linear combinations of a number of dominant components (also called “modes” or “eigenprobes”) recovered dynamically and without a priori information. As usual for ptychography, the object’s transmission function is also retrieved without enforcing any prior knowledge. The essence of OPRP is compatible with any ptychographic reconstruction algorithm and has been implemented within the PtyPy reconstruction suite [Enders2016] for both difference map (DM) [Thibault2009] and maximum likelihood (ML) [Thibault2012] algorithms. The reconstructions presented here were obtained using DM followed by ML refinement, both using a 10-component decomposition of the retrieved probes.
3 Results
The absolute value of the retrieved object transmission function is represented in Fig. 2b, which can be compared with the SEM image of the same region in Fig. 2a. The agreement between the two images is apparent, even well outside the field-of-view of the original scanning area, thanks to the wide beam jitter effectively enlarging the imaged area. The fidelity of the reconstructed object confirms the robustness of the algorithm and the validity of the retrieved probes, whose components are represented in Fig.s 3a-j. Though each component’s contribution to each pulse varies, a qualitative indication of their relative weight is given by the singular values obtained through truncated singular-value decomposition (SVD) and annotated on each component (cf Fig.s 3a-j). When back-propagated to the virtual secondary source plane located at the mid-point between the pair of KB mirrors, upstream from the interaction plane (Fig.s 3k-t) the components exhibit the expected intensity distribution, with the intensity dropping to negligible values outside of the main pupil.
The normalized amplitude of four selected probes is shown in Fig.s 4a-d as a representative sample of the full stack of retrieved probes which is available as a video in the Supplementary Material. For comparison purposes, the amplitude of a probe retrieved starting from Hartmann sensor data is shown in Fig. 4e. The Hartmann sensor routinely available at the beamline for wavefront sensing [Raimondi2013] was operated within the same experimental conditions as those of the ptychography experiment, although it did not sample the same pulses. Figures 4f-j show the amplitude of the same wavefronts (Fig.s 4a-e) after they have been numerically back-propagated to the virtual secondary source plane. Pulse-to-pulse variations can be observed both at the sample plane and at the virtual secondary source plane.
Using the full stack of retrieved probes, it is possible to gather valuable statistical information, such as variations in intensity and beam pointing. Figure 5a illustrates the fluctuations of the total intensity found for each probe relative to the median total intensity, revealing significant variations, with a relative standard deviation of . Figure 5b shows the radial displacement of the center of mass of each probe relative to the center of the detector, revealing a median relative displacement of , confirming the presence of beam pointing variations.
We numerically propagated the main component – as it is the most representative part of all retrieved probes – downstream and upstream from object plane to investigate the region around the focal position. Sections of the propagated main component are shown in Fig. 6 and can be compared with the unpropagated reconstructed main component from Fig. 3a. The dotted line in Fig. 6 indicates the sample plane; the focal plane has been estimated to be some further upstream, as the plane at which the beam size is minimized.
4 Conclusions
We have demonstrated the first fully pulse-to-pulse ptychographic wavefront reconstruction for a FEL instrument in its native imaging state. Our approach provides the complex-valued wavefront of each pulse directly at the sample plane, in its near-focus position. As a lensless microscopy technique, its achievable resolution is limited only by flux and detector numerical aperture.
The full set of 937 retrieved probes reveals pulse-to-pulse variations, providing statistical information on FEL beam fluctuations and direct insight into FERMI’s performance. The retrieved probes also confirm the elongated shape of the beam at and around the focal position, as expected from previous experiments carried out at the same beamline [Raimondi2013].
Ptychographic wavefront characterisation brings some benefits compared to grating-based methods [Schneider2018, Liu2018], which recover information far from the focal position, tend to underestimate the intensity in the tails of the power distribution and are limited by grating fabrication. The method has also proven effective even in the presence of significant setup vibrations – another advantage over Hartmann and grating-based wavefront sensing, which are mostly insensitive to beam position variations.
Pulse-to-pulse ptychography is primarily expected to benefit wavefront characterization experiments at FELs, contributing to the development of FEL and FEL-based science. Its application can be extended to other imaging experiments, which would benefit from the relaxation of the single-illumination probe constraint.
Appendix A Experimental setup
The ptychography experiment was carried out at the Diffraction and Projection Imaging (DiProI) beamline [Capotondi2013, Capotondi2015] at FERMI, EUV and soft X-ray seeded FEL, using the FEL-2 line [Allaria2012, Allaria2013, Allaria2015]. The vertical and horizontal bendable KB mirrors had a focal length of and , respectively [Raimondi2013]. The sample (Xradia X30-30-2) was a S membrane with a thick Au test pattern deposited on top. A 3-axis translation stage was used to translate and scan the sample within a vacuum chamber. The in-vacuum CCD camera was a PI-MTE:2048B with pixels, each. To decrease readout time to , only the intensities collected by the central pixels were recorded. As readout frequency was lower than the FEL’s repetition rate, a fast shutter was used to prevent more than one pulse from contributing to each detector reading. Due to further overhead, the acquisition rate was effectively reduced to , i.e. only one every 50 FEL pulses was recorded.
The beam was attenuated with a combination of attenuators. A long gas chamber was filled with \text{,}\mathrm{mbar}$$ of and complemented with solid Zr () and Al () attenuators. Thus attenuated, pulses remained well below the sample’s damage threshold, given by Au melting dose of per atom [David2011].
Appendix B Data acquisition and processing
Ptychographic data were collected using three 25\text{,}\mathrm{\SIUnitSymbolMicro m} spiral scans in the - plane, with a step size of for a total of 101 positions each. Five single-pulse diffraction patterns were collected at each scanning position, for a total of 1515 frames over the 3 spiral scans. The center of the last spiral scan was translated in to extend the overall scanned area which is highlighted by the rectangles in Fig.s 7a,b. The collected diffraction patterns were binned by a factor of 2 and then padded to a size of pixels in order to decrease computational cost. Each frame was then dark-subtracted. Detector counts were thresholded to a value of 0 in order to remove unphysical negative counts and converted into units of photon counts.
A wide jitter of the photon beam position was found to have occurred throughout data acquisition. Ascribed to vibrations in the optics upstream from the experimental setup, the jitter was of such a large amplitude – tens of microns – that the scanning positions recorded by the sample motors were essentially unusable. Most known position refinement approaches within ptychographic algorithms [Guizar-Sicairos2008, Maiden2012a, Beckers2013, Zhang2013, Tripathi2014] have been designed to account for minor deviations from the expected positions, typically smaller than the scanning step size. Here, a customized approach was implemented to accommodate for such a wide jitter. Coarse positions were first obtained by cross-correlating the recorded diffraction patterns with simulations based on the interaction of a simulated probe and an object modelled from the available high-resolution image of the test pattern (cf Fig. 7a). The coarse positions were then further refined with a purposely-designed position refinement algorithm [Odstrcil2018]. Diffraction patterns corresponding to positions far from the intended field-of-view were discarded, as well as others for which position refinement failed, effectively reducing the dataset to 937 frames.
Figure 7b shows the corrected and refined positions, along with the intended rectangular scanning area. The deviation of the retrieved scanning positions to the nominal ones is represented in Fig. 7c where the main axis of the vibration distribution is annotated, revealing a dominant horizontal component associated to a standard deviation of .
Although the coarse position correction was only possible thanks to the in-depth characterization of the test pattern prior the experiment, the developed position refinement algorithm is expected to benefit several other experiments performed at FELs which are affected by intrinsic pointing instability, beside minor vibrations of the optics and sample stages.
Given the experiment geometry and detector specifications, the achieved pixel size in the ptychographic reconstruction was . The initial illumination function was produced by numerical back-propagation of the mean diffraction pattern. The initial object was assigned a uniform unit transmission function. The ptychographic algorithm ran 200 iterations of DM, followed by 800 of ML refinement.
Appendix C Reconstruction algorithm
The ptychographic wavefront characterization approach used within this work for single-pulse investigation is derived from OPRP [Odstrcil2016]. It recovers a different probe for each of the diffraction patterns recorded during a ptychographic scan, with the frame index varying between and . The SVD step is added at the end of every iteration of the ptychographic reconstruction algorithm and generates the probes’ main principal components or “modes”.
Given the complex matrix whose columns contain estimates of the individual probes , applying SVD to leads to where denotes the Hermitian transposition of and both and are unitary matrices such that and with as the identity matrix. By multiplying with its Hermitian transpose , one gets
[TABLE]
with as a Hermitian matrix and as a diagonal matrix. This is equivalent to the eigenvalue problem
[TABLE]
so that the non-zero elements on the diagonal of correspond to the square roots of the eigenvalues of .
The solution to this problem within the ptychographic algorithm is implemented as a truncated diagonalisation: the eigenvalues and main eigenvectors can be retrieved, with and denoting truncation of . Applying this in the SVD step, a set of orthogonal components is generated via where denotes the probe matrix at the -th iteration. The obtained component matrix is then used to generate the updated probes .
\ack
We are thankful to N. Mahne, M. Zangrando and L. Raimondi from the PADReS group at FERMI for their contribution to the experiment leading to these results. We acknowledge the use of the IRIDIS High Performance Computing Facility, and associated support services at the University of Southampton, in the completion of this work. The research leading to these results has received funding from the European Community’s Seventh Framework Programme (FP7/2007-2013) under grant agreements n. 279753 and n. 312284 and from Diamond Light Source Limited, the Swedish Research Council, the Knut and Alice Wallenberg Foundation, the Swedish Foundation for Strategic Research and the Swedish Foundation for International Cooperation in Research and Higher Education (STINT).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] \harvarditem [Allaria et al. ]Allaria, Appio, Badano, Barletta, Bassanese, Biedron, Borga, Busetto, Castronovo, Cinquegrana, Cleva, Cocco, Cornacchia, Craievich, Cudin, D’Auria, Dal Forno, Danailov, De Monte, De Ninno, Delgiusto, Demidovich, Di Mitri, Diviacco, Fabris, Fabris, Fawley, Ferianis, Ferrari, Ferry, Froehlich, Furlan, Gaio, Gelmetti, Giannessi, Giannini, Gobessi, Ivanov, Karantzoulis, Lonza, Lutman, Mahieu, Milloch, Milton, Musardo, Nikolov, Noe, Parmigiani, Penco, Petronio, Pi
- 2[2] \harvarditem [Allaria et al. ]Allaria, Badano, Bassanese, Capotondi, Castronovo, Cinquegrana, Danailov, D’Auria, Demidovich, De Monte, De Ninno, Di Mitri, Diviacco, Fawley, Ferianis, Ferrari, Gaio, Gauthier, Giannessi, Iazzourene, Kurdi, Mahne, Nikolov, Parmigiani, Penco, Raimondi, Rebernik, Rossi, Roussel, Scafuri, Serpico, Sigalotti, Spezzani, Svandrlik, Svetina, Trovó, Veronese, Zangrando \harvardand Zangrando 2015 Allaria 2015 Allaria, E., Badano, L., Bassanese, S., Capotondi, F., Cast
- 3[3] \harvarditem [Allaria et al. ]Allaria, Castronovo, Cinquegrana, Craievich, Dal Forno, Danailov, D’Auria, Demidovich, De Ninno, Di Mitri, Diviacco, Fawley, Ferianis, Ferrari, Froehlich, Gaio, Gauthier, Giannessi, Ivanov, Mahieu, Mahne, Nikolov, Parmigiani, Penco, Raimondi, Scafuri, Serpico, Sigalotti, Spampinati, Spezzani, Svandrlik, Svetina, Trovo, Veronese, Zangrando \harvardand Zangrando 2013 Allaria 2013 Allaria, E., Castronovo, D., Cinquegrana, P., Craievich, P., Dal Forno, M., Danailo
- 4[4] \harvarditem [Beckers et al. ]Beckers, Senkbeil, Gorniak, Giewekemeyer, Salditt \harvardand Rosenhahn 2013 Beckers 2013 Beckers, M., Senkbeil, T., Gorniak, T., Giewekemeyer, K., Salditt, T. \harvardand Rosenhahn, A. \harvardyearleft 2013 \harvardyearright . Ultramicroscopy , \volbf 126, 44–47.
- 5[5] \harvarditem [Capotondi et al. ]Capotondi, Pedersoli, Bencivenga, Manfredda, Mahne, Raimondi, Svetina, Zangrando, Demidovich, Nikolov, Danailov, Masciovecchio \harvardand Kiskinova 2015 Capotondi 2015 Capotondi, F., Pedersoli, E., Bencivenga, F., Manfredda, M., Mahne, N., Raimondi, L., Svetina, C., Zangrando, M., Demidovich, A., Nikolov, I., Danailov, M., Masciovecchio, C. \harvardand Kiskinova, M. \harvardyearleft 2015 \harvardyearright . J. Synchrotron Radiat. \volbf 22, 544–552
- 6[6] \harvarditem [Capotondi et al. ]Capotondi, Pedersoli, Mahne, Menk, Passos, Raimondi, Svetina, Sandrin, Zangrando, Kiskinova, Bajt, Barthelmess, Fleckenstein, Chapman, Schulz, Bach, Frömter, Schleitzer, Müller, Gutt \harvardand Grübel 2013 Capotondi 2013 Capotondi, F., Pedersoli, E., Mahne, N., Menk, R. H., Passos, G., Raimondi, L., Svetina, C., Sandrin, G., Zangrando, M., Kiskinova, M., Bajt, S., Barthelmess, M., Fleckenstein, H., Chapman, H. N., Schulz, J., Bach, J., Frömter, R., Schleitz
- 7[7] \harvarditem [Chalupsky et al. ]Chalupsky, Bohacek, Hajkova, Hau-Riege, Heimann, Juha, Krzywinski, Messerschmidt, Moeller, Nagler, Rowen, Schlotter, Swiggers \harvardand Turner 2011 Chalupsky 2011 Chalupsky, J., Bohacek, P., Hajkova, V., Hau-Riege, S. P., Heimann, P. A., Juha, L., Krzywinski, J., Messerschmidt, M., Moeller, S. P., Nagler, B., Rowen, M., Schlotter, W. F., Swiggers, M. L. \harvardand Turner, J. J. \harvardyearleft 2011 \harvardyearright . Nucl. Instruments Methods Phy
- 8[8] \harvarditem [Chapman et al. ]Chapman, Barty, Bogan, Boutet, Frank, Hau-Riege, Marchesini, Woods, Bajt, Benner, London, Plönjes, Kuhlmann, Treusch, Düsterer, Tschentscher, Schneider, Spiller, Möller, Bostedt, Hoener, Shapiro, Hodgson, van der Spoel, Burmeister, Bergh, Caleman, Huldt, Seibert, Maia, Lee, Szöke, Timneanu \harvardand Hajdu 2006 Chapman 2006 a Chapman, H. N., Barty, A., Bogan, M. J., Boutet, S., Frank, M., Hau-Riege, S. P., Marchesini, S., Woods, B. W., Bajt, S., Benner, W. H.,
