I08-1-Soft X-ray Ptychography
|
Abstract: The scales of butterflies display a vast array of vivid colors. However, the exact mechanisms behind these colours are not yet fully understood. Butterfly scales consist of intricate nanostructures that in- teract with light through interference, diffraction, and scattering. Additionally, the nanostructures on butterfly scales vary in pigment density across different species.
A combination of 'pigment effects' and ‘structural effects’ gives rise to the vivid colors observed on a butterfly’s wings. Variations in pigment density have been correlated with specific nanostructures. However, the interplay between pigmentation and nanostructures - how they influence each other - remains largely unexplored. Hence, our work aims to perform a detailed examination of the distribution of various matrix components within butterfly scales, leading to a deeper understanding of not only their colour, but also their role in guiding nano- structure growth.
|
Jul 2025
|
|
I08-1-Soft X-ray Ptychography
|
Abstract: When an object is illuminated by a source, the resulting exit wave is a complex function intricately connected to the object's structure. Generally speaking, the wave's modulus corresponds to the object's transmittance, while its phase represents the cumulative phase shift relative to free space, caused by the object's refractive index as the wave traverses it. Therefore, to fully characterise the object, both the modulus and phase of the exit wave are required. However, detectors only measure the intensities (the modulus squared) of the waves striking the detector. The modulus can thus be easily obtained by taking the square root of the measured intensity. The phase, on the other hand, is much more challenging to determine. Any potential phase configuration could theoretically produce the same measured intensity, leading to what is known as the 'Phase Retrieval Problem', whereby the true phases that were lost during the experiment are not easily recovered. Ptychography offers a possible solution to the phase retrieval problem. Multiple diffraction intensity patterns are obtained by scanning a finite probe over an extended specimen with sufficient overlap between adjacent illumination positions. Combined with suitable iterative reconstruction algorithms, these measured diffraction patterns can be effectively utilised to accurately determine both the amplitude and phase of the object's exit wave, providing a robust approach that significantly enhances the ability to retrieve complete structural information about a specimen. Ptychography can be combined with X-ray absorption spectroscopy by using an X-ray beam of tuneable energies at each scan position. The diffraction patterns are now collected when the X-rays are scanned over absorption edges of specific elements, providing chemical information, in addition to high resolution reconstructions. This method has been dubbed 'Spectro-Ptychography'. Our work aims to push the limits of ptychography by employing it to analyse various butterfly scales. These scales are intricate self-assemblies of proteins that form complex structures. Beyond exhibiting pigment colour—where specific compounds absorb particular wavelengths of light—butterfly scales are also remarkable examples of structural colour, where their unique structures manipulate light in specific ways. We will showcase the application of spectro-ptychography on butterfly scales and demonstrate how we extracted detailed 3D spatial and chemical information from the dataset, aiding in our understanding of both 'pigment colour' and 'structural colour'.
Preliminary results reveal distinct chemical variations in the carbon and oxygen signatures across different regions of a butterfly scale. By segmenting the scale into defined classes, we gain deeper insights into the chemical compositions of each specific segment, enhancing our understanding of its complex structure.
|
Feb 2025
|
|
|
Abstract: Recent advances in single particle analysis (SPA) for cryogenic electron microscopy (cryo-EM) have significantly enhanced the resolution of 3D particle reconstructions. However, a gap remains between the theoretical models of cryo-EM image formation and experimental results. While the multislice and in-line holography models accurately describe image formation in electron microscopy experiments, most cryo-EM SPA software still rely on simplified linear approximations, like projection approximation and contrast-transfer function theory. These linearized models lead to ghost-like artifacts (Fig. 1) in the reconstructed particle due to the inaccurate Fourier coefficients inferred from phase-less cryo-EM images, which are subsequently used in Ewald sphere curvature correction (ESCC) algorithms. As such, current approaches cannot fully remove the effects of multiple scattering in thick particles.
In this work, we aim to close this theory-experiment gap by incorporating the full physics of the imaging process to go beyond Ewald sphere curvature correction (ESCC) algorithms for cryo-EM single particle reconstruction. To achieve this, we developed a diffraction tomography algorithm, Ghostbuster, which refines 3D particle reconstructions using batch stochastic gradient descent. Ghostbuster minimizes the error between simulated images from a multislice-based forward model and actual cryo-EM measurements. Implicitly, Ghostbuster retrieves the lost phases of the measured images that are then backpropagated to reconstruct the 3D particle. We validate our approach by comparing the reconstruction of an adeno-associated virus serotype 2 variant (AAV2) particle (Empiar-10202) between Ghostbuster and CryoSPARC, a state-of-the-art cryo-EM processing software. We demonstrate a reduction in ghost-like artifacts in Ghostbuster’s reconstruction, which leads to an overall improvement in resolution based on both half-map and map-to-model Fourier shell correlation (FSC) metrics (Fig. 2). This preliminary result suggests that there remains more physics that can be accounted for to close the theory-experiment gap currently in cryo-EM image processing pipelines. Ghostbuster has the potential to improve 3D particle refinement without requiring additional data collection or hardware changes to the microscope.
|
Feb 2025
|
|
|
Abstract: ances in high-resolution electron microscopy have enabled remarkable insights into both biological and materials science, particularly in the detailed structural imaging of small particles and complex materials interfaces. Yet, as resolution increases, the effective depth of field (DOF) of Transmission Electron Microscopy (TEM) narrows, creating new challenges for accurately imaging thick samples. Traditional phase retrieval approaches rely on contrast transfer functions (CTF) and projection approximations (PA) that linearize image formation physics. While effective at near-atomic resolutions, these methods lose critical phase information, limiting resolution in cases that require a full 3D reconstruction of complex structures. The maximum achievable contrast in Transmission Electron Microscopy (TEM) for small particles, including biomolecules, is theoretically set by the scattering cross sections of these particles. Our previous work has shown that, under ideal conditions, computational phase retrieval can reach this theoretical limit by precisely modeling electron-matter interactions1. However, the real-world limitations of TEM—such as noise, sample damage, and heterogeneity in imaging conditions—create a gap between theoretical predictions and actual experimental outcomes, especially for challenging samples like small or flexible biomolecules. This theory-experiment gap has historically hindered the ability to fully exploit TEM for resolving fine structural details in complex materials. First-principles simulations struggle to account for the empirical effects present in real data, including variations in ice thickness, specific particle damage, and environmental noise. To address this gap, we integrate these theoretical models into Physics-Informed Neural Networks (PINNs), which incorporate the physical laws governing electron scattering directly into the machine learning framework.
|
Feb 2025
|
|
I13-1-Coherence
|
Abstract: The butterfly wing scales are biocomposites with impressive structural and optical properties, owing to their features spanning from hundreds of microns to a few nanometers. Though they demonstrate efficient color production and structural rigidity, the mechanisms to achieve them are well-concealed across different length scales. As a result, understanding these biocomposites' composition, structure, and corresponding function remains challenging. No single technique can provide a high-resolution three-dimensional (3D) volume with an accurate color map. Traditionally, approaches such as light microscopy (LM) and spectrophotometry for color responses, and scanning electron microscopes (SEM) and transmission electron microscopes (TEM) for structural imaging provide key insights. However, these methods offer either limited resolution (LM) or limited field of view (TEM), falling short of capturing the full complexity of the scales. Here, we used ptychographic X-ray computed tomography (PXCT), which provides 3D density maps at an intermediate resolution (66.5nm) over hundreds of microns. This allowed us to combine the inferences from the high-resolution (<1 nm), limited view structural insights from TEM/SEM with the low-resolution (>1 microm) color response from LM/spectrophotometry. In Figure 1, the images obtained from various modalities are shown along with their corresponding length scales. Notably, PXCT provides both 3D structural measurements and density values. The 3D structural measurements enable us to estimate the tilt map of the continuous lower lamina structure of the scale and the thickness map of the intricate upper lamina structure. The known physics behind the reflectance and absorbance spectra enables us to combine insights from a wide range of imaging modalities synergistically. An optical model estimates reflectance spectra by integrating thickness and tilt information from PXCT and sub-layer separation insights from the resin section TEM. This computational scheme iteratively solves for the refractive indices of the scale layers from the experimentally measured reflectance spectra. Further, such correlative modeling provides the reflectance map of the scale (Fig. 2), which explains the spatial colour variation (adwing) and the influence of the upper lamina in diffusing the color (abwing). In addition, the 3D thickness map of the upper lamina is utilized to get the absorption coefficient of the upper and the lower lamina from the measured absorbance spectra. The absorption coefficient values showed that the upper and lower lamina have similar pigment densities. This work demonstrates that a multi-modal imaging approach, integrating computational and optical modeling, can reveal unique and novel insights into biocomposites that cannot be possible with any single imaging method alone.
|
Feb 2025
|
|
I08-1-Soft X-ray Ptychography
|
Jeffrey
Neethirajan
,
Benedikt J,
Daurer
,
Marisel
Di Pietro Martinez
,
Ales
Hrabec
,
Luke
Turnbull
,
Rikako
Yamamoto
,
Marina
Raboni Ferreira
,
Ales
Stefancic
,
Daniel A.
Mayoh
,
Geetha
Balakrishnan
,
Zhaowen
Pei
,
Pengfei
Xue
,
Liao
Chang
,
Emilie
Ringe
,
Richard
Harrison
,
Sergio
Valencia
,
Majid
Kazemian
,
Burkhard
Kaulich
,
Claire
Donnelly
Diamond Proposal Number(s):
[32984, 33254]
Open Access
Abstract: Imaging of nanoscale magnetic textures within extended material systems is of critical importance to both fundamental research and technological applications. While high-resolution magnetic imaging of thin nanoscale samples is well established with electron and soft x-ray microscopy, the extension to micrometer-thick systems currently requires hard x rays, which limits high-resolution imaging to rare-earth magnets. Here, we overcome this limitation by establishing soft x-ray magnetic imaging of micrometer-thick systems using the pre-edge phase x-ray magnetic circular dichroism signal, thus making possible the study of a wide range of magnetic materials. By performing dichroic spectroptychography, we demonstrate high spatial resolution imaging of magnetic samples up to 1.7 μm thick, an order of magnitude higher than conventionally possible with soft x-ray absorption-based techniques. We demonstrate the applicability of the technique by harnessing the pre-edge phase to image thick chiral helimagnets, and naturally occurring magnetite particles, gaining insight into their three-dimensional magnetic configuration. This new regime of magnetic imaging makes possible the study of extended non-rare-earth systems that have until now been inaccessible, including magnetic textures for future spintronic applications, non-rare-earth permanent magnets for energy harvesting, and the magnetic configuration of giant magnetofossils.
|
Aug 2024
|
|
|
Zhou
Shen
,
Paul Lourdu
Xavier
,
Richard
Bean
,
Johan
Bielecki
,
Martin
Bergemann
,
Benedikt
Daurer
,
Tomas
Ekeberg
,
Armando D.
Estillore
,
Hans
Fangohr
,
Klaus
Giewekemeyer
,
Mikhail
Karnevskiy
,
Richard A.
Kirian
,
Henry
Kirkwood
,
Yoonhee
Kim
,
Jayanath C. P.
Koliyadu
,
Holger
Lange
,
Romain
Letrun
,
Jannik
Lübke
,
Abhishek
Mall
,
Thomas
Michelat
,
Andrew J.
Morgan
,
Nils
Roth
,
Amit K.
Samanta
,
Tokushi
Sato
,
Marcin
Sikorski
,
Florian
Schulz
,
Patrik
Vagovic
,
Tamme
Wollweber
,
Lena
Worbs
,
Filipe
Maia
,
Daniel A.
Horke
,
Jochen
Küpper
,
Adrian P.
Mancuso
,
Henry
Chapman
,
Kartik
Ayyer
,
N. Duane
Loh
Open Access
Abstract: Nanoparticles, exhibiting functionally relevant structural heterogeneity, are at the forefront of cutting-edge research. Now, high-throughput single-particle imaging (SPI) with X-ray free-electron lasers (XFELs) creates opportunities for recovering the shape distributions of millions of particles that exhibit functionally relevant structural heterogeneity. To realize this potential, three challenges have to be overcome: (1) simultaneous parametrization of structural variability in real and reciprocal spaces; (2) efficiently inferring the latent parameters of each SPI measurement; (3) scaling up comparisons between 105 structural models and 106 XFEL-SPI measurements. Here, we describe how we overcame these three challenges to resolve the nonequilibrium shape distributions within millions of gold nanoparticles imaged at the European XFEL. These shape distributions allowed us to quantify the degree of asymmetry in these particles, discover a relatively stable “shape envelope” among nanoparticles, discern finite-size effects related to shape-controlling surfactants, and extrapolate nanoparticles’ shapes to their idealized thermodynamic limit. Ultimately, these demonstrations show that XFEL SPI can help transform nanoparticle shape characterization from anecdotally interesting to statistically meaningful.
|
May 2024
|
|
|
Open Access
Abstract: Ewald sphere curvature correction, which extends beyond the projection approximation, stretches the shallow depth of field in cryo-EM reconstructions of thick particles. Here we show that even for previously assumed thin particles, reconstruction artifacts which we refer to as ghosts can appear. By retrieving the lost phases of the electron exitwaves and accounting for the first Born approximation scattering within the particle, we show that these ghosts can be effectively eliminated. Our simulations demonstrate how such ghostbusting can improve reconstructions as compared to existing state-of-the-art software. Like ptychographic cryo-EM, our Ghostbuster algorithm uses phase retrieval to improve reconstructions, but unlike the former, we do not need to modify the existing data acquisition pipelines.
|
Apr 2024
|
|
|
Tomas
Ekeberg
,
Dameli
Assalauova
,
Johan
Bielecki
,
Rebecca
Boll
,
Benedikt J.
Daurer
,
Lutz A.
Eichacker
,
Linda E.
Franken
,
Davide E.
Galli
,
Luca
Gelisio
,
Lars
Gumprecht
,
Laura H.
Gunn
,
Janos
Hajdu
,
Robert
Hartmann
,
Dirk
Hasse
,
Alexandr
Ignatenko
,
Jayanath
Koliyadu
,
Olena
Kulyk
,
Ruslan
Kurta
,
Markus
Kuster
,
Wolfgang
Lugmayr
,
Jannik
Lübke
,
Adrian P.
Mancuso
,
Tommaso
Mazza
,
Carl
Nettelblad
,
Yevheniy
Ovcharenko
,
Daniel E.
Rivas
,
Max
Rose
,
Amit K.
Samanta
,
Philipp
Schmidt
,
Egor
Sobolev
,
Nicusor
Timneanu
,
Sergey
Usenko
,
Daniel
Westphal
,
Tamme
Wollweber
,
Lena
Worbs
,
Paul Lourdu
Xavier
,
Hazem
Yousef
,
Kartik
Ayyer
,
Henry N.
Chapman
,
Jonas A.
Sellberg
,
Carolin
Seuring
,
Ivan A.
Vartanyants
,
Jochen
Küpper
,
Michael
Meyer
,
Filipe R. N. C.
Maia
Open Access
Abstract: The idea of using ultrashort X-ray pulses to obtain images of single proteins frozen in time has fascinated and inspired many. It was one of the arguments for building X-ray free-electron lasers. According to theory, the extremely intense pulses provide sufficient signal to dispense with using crystals as an amplifier, and the ultrashort pulse duration permits capturing the diffraction data before the sample inevitably explodes. This was first demonstrated on biological samples a decade ago on the giant mimivirus. Since then, a large collaboration has been pushing the limit of the smallest sample that can be imaged. The ability to capture snapshots on the timescale of atomic vibrations, while keeping the sample at room temperature, may allow probing the entire conformational phase space of macromolecules. Here we show the first observation of an X-ray diffraction pattern from a single protein, that of Escherichia coli GroEL which at 14 nm in diameter is the smallest biological sample ever imaged by X-rays, and demonstrate that the concept of diffraction before destruction extends to single proteins. From the pattern, it is possible to determine the approximate orientation of the protein. Our experiment demonstrates the feasibility of ultrafast imaging of single proteins, opening the way to single-molecule time-resolved studies on the femtosecond timescale.
|
Jan 2024
|
|
|
Abstract: The complexity of self-assembled photonic structures like butterfly wing scales spans 3–4 orders of magnitude in length scales. These monolithic structures produced by single cells on a butterfly wing typically measure a few hundred micrometres across, with intricate features going well below the nanometre scale. While this complexity makes the self-assembly of these structures fascinating, imaging and capturing this gamut of complexity is extremely challenging. The available imaging methods can either capture the overall field of view at a lower resolution (scanning electron microscopy (SEM)) or can capture high-resolution details of the structure at a specific region (resin section transmission electron microscopy) [1]. Further, three-dimensional (3D) characterization techniques either can only image the topology of a single surface (atomic force microscopy) [1] or are limited to fewer synchrotron facilities (ptychographic x-ray tomography (PXCT)) [2], rendering them impractical to promptly test a large number of scales for gene expression studies.
|
Aug 2023
|
|