Electrical and Computer Engineering

Image denoising, one of the essential inverse problems, targets to remove noise/artifacts from input images. In general, digital image denoising algorithms, executed on computers, present latency due to several iterations implemented in, e.g., graphics processing units (GPUs). While deep learning-enabled methods can operate non-iteratively, they also introduce latency and impose a significant computational burden, leading to increased power consumption. Here, we introduce an analog diffractive image denoiser to all-optically and non-iteratively clean various forms of noise and artifacts from input images - implemented at the speed of light propagation within a thin diffractive visual processor that axially spans <250 × λ, where λ is the wavelength of light. This all-optical image denoiser comprises passive transmissive layers optimized using deep learning to physically scatter the optical modes that represent various noise features, causing them to miss the output image Field-of-View (FoV) while retaining the object features of interest. Our results show that these diffractive denoisers can efficiently remove salt and pepper noise and image rendering-related spatial artifacts from input phase or intensity images while achieving an output power efficiency of ~30-40%. We experimentally demonstrated the effectiveness of this analog denoiser architecture using a 3D-printed diffractive visual processor operating at the terahertz spectrum. Owing to their speed, power-efficiency, and minimal computational overhead, all-optical diffractive denoisers can be transformative for various image display and projection systems, including, e.g., holographic displays.

Bremsstrahlung-the spontaneous emission of broadband radiation from free electrons that are deflected by atomic nuclei-contributes to the majority of X-rays emitted from X-ray tubes and used in applications ranging from medical imaging to semiconductor chip inspection. Here, we show that the bremsstrahlung intensity can be enhanced significantly-by more than three orders of magnitude-through shaping the electron wavefunction to periodically overlap with atoms in crystalline materials. Furthermore, we show how to shape the bremsstrahlung X-ray emission pattern into arbitrary angular emission profiles for purposes such as unidirectionality and multi-directionality. Importantly, we find that these enhancements and shaped emission profiles cannot be attributed solely to the spatial overlap between the electron probability distribution and the atomic centers, as predicted by the paraxial and non-recoil theory for free electron light emission. Our work highlights an unprecedented regime of free electron light emission where electron waveshaping provides multi-dimensional control over practical radiation processes like bremsstrahlung. Our results pave the way towards greater versatility in table-top X-ray sources and improved fundamental understanding of quantum electron-light interactions.

Mitosis is a critical criterion for meningioma grading. However, pathologists assessment of mitoses is subject to significant inter-observer variation due to challenges in locating mitosis hotspots and accurately detecting mitotic figures. To address this issue, we leverage digital pathology and propose a computational strategy to enhance pathologists mitosis assessment. The strategy has two components: (1) A depth-first search algorithm that quantifies the mathematically maximum mitotic count in 10 consecutive high-power fields, which can enhance the preciseness, especially in cases with borderline mitotic count. (2) Implementing a collaborative sphere to group a set of pathologists to detect mitoses under each high-power field, which can mitigate subjective random errors in mitosis detection originating from individual detection errors. By depth-first search algorithm (1) , we analyzed 19 meningioma slides and discovered that the proposed algorithm upgraded two borderline cases verified at consensus conferences. This improvement is attributed to the algorithms ability to quantify the mitotic count more comprehensively compared to other conventional methods of counting mitoses. In implementing a collaborative sphere (2) , we evaluated the correctness of mitosis detection from grouped pathologists and/or pathology residents, where each member of the group annotated a set of 48 high-power field images for mitotic figures independently. We report that groups with sizes of three can achieve an average precision of 0.897 and sensitivity of 0.699 in mitosis detection, which is higher than an average pathologist in this study (precision: 0.750, sensitivity: 0.667). The proposed computational strategy can be integrated with artificial intelligence workflow, which envisions the future of achieving a rapid and robust mitosis assessment by interactive assisting algorithms that can ultimately benefit patient management.

The photoisomerization reaction of a fluorescent protein chromophore occurs on the ultrafast timescale. The structural dynamics that result from femtosecond optical excitation have contributions from vibrational and electronic processes and from reaction dynamics that involve the crossing through a conical intersection. The creation and progression of the ultrafast structural dynamics strongly depends on optical and molecular parameters. When using X-ray crystallography as a probe of ultrafast dynamics, the origin of the observed nuclear motions is not known. Now, high-resolution pump-probe X-ray crystallography reveals complex sub-ångström, ultrafast motions and hydrogen-bonding rearrangements in the active site of a fluorescent protein. However, we demonstrate that the measured motions are not part of the photoisomerization reaction but instead arise from impulsively driven coherent vibrational processes in the electronic ground state. A coherent-control experiment using a two-colour and two-pulse optical excitation strongly amplifies the X-ray crystallographic difference density, while it fully depletes the photoisomerization process. A coherent control mechanism was tested and confirmed the wave packets assignment.

Understanding and controlling protein motion at atomic resolution is a hallmark challenge for structural biologists and protein engineers because conformational dynamics are essential for complex functions such as enzyme catalysis and allosteric regulation. Time-resolved crystallography offers a window into protein motions, yet without a universal perturbation to initiate conformational changes the method has been limited in scope. Here we couple a solvent-based temperature jump with time-resolved crystallography to visualize structural motions in lysozyme, a dynamic enzyme. We observed widespread atomic vibrations on the nanosecond timescale, which evolve on the submillisecond timescale into localized structural fluctuations that are coupled to the active site. An orthogonal perturbation to the enzyme, inhibitor binding, altered these dynamics by blocking key motions that allow energy to dissipate from vibrations into functional movements linked to the catalytic cycle. Because temperature jump is a universal method for perturbing molecular motion, the method demonstrated here is broadly applicable for studying protein dynamics.

Free-space optical communication becomes challenging when an occlusion blocks the light path. Here, we demonstrate a direct communication scheme, passing optical information around a fully opaque, arbitrarily shaped occlusion that partially or entirely occludes the transmitters field-of-view. In this scheme, an electronic neural network encoder and a passive, all-optical diffractive network-based decoder are jointly trained using deep learning to transfer the optical information of interest around the opaque occlusion of an arbitrary shape. Following its training, the encoder-decoder pair can communicate any arbitrary optical information around opaque occlusions, where the information decoding occurs at the speed of light propagation through passive light-matter interactions, with resilience against various unknown changes in the occlusion shape and size. We also validate this framework experimentally in the terahertz spectrum using a 3D-printed diffractive decoder. Scalable for operation in any wavelength regime, this scheme could be particularly useful in emerging high data-rate free-space communication systems.

Terahertz waves offer advantages for nondestructive detection of hidden objects/defects in materials, as they can penetrate most optically-opaque materials. However, existing terahertz inspection systems face throughput and accuracy restrictions due to their limited imaging speed and resolution. Furthermore, machine-vision-based systems using large-pixel-count imaging encounter bottlenecks due to their data storage, transmission and processing requirements. Here, we report a diffractive sensor that rapidly detects hidden defects/objects within a 3D sample using a single-pixel terahertz detector, eliminating sample scanning or image formation/processing. Leveraging deep-learning-optimized diffractive layers, this diffractive sensor can all-optically probe the 3D structural information of samples by outputting a spectrum, directly indicating the presence/absence of hidden structures or defects. We experimentally validated this framework using a single-pixel terahertz time-domain spectroscopy set-up and 3D-printed diffractive layers, successfully detecting unknown hidden defects inside silicon samples. This technique is valuable for applications including security screening, biomedical sensing and industrial quality control.

Ferromagnetism and superconductivity are two key ingredients for topological superconductors, which can serve as building blocks of fault-tolerant quantum computers. Adversely, ferromagnetism and superconductivity are typically also two hostile orderings competing to align spins in different configurations, and thus making the material design and experimental implementation extremely challenging. A single material platform with concurrent ferromagnetism and superconductivity is actively pursued. In this paper, we fabricate van der Waals Josephson junctions made with iron-based superconductor Fe(Te,Se), and report the global device-level transport signatures of interfacial ferromagnetism emerging with superconducting states for the first time. Magnetic hysteresis in the junction resistance is observed only below the superconducting critical temperature, suggesting an inherent correlation between ferromagnetic and superconducting order parameters. The 0-π phase mixing in the Fraunhofer patterns pinpoints the ferromagnetism on the junction interface. More importantly, a stochastic field-free superconducting diode effect was observed in Josephson junction devices, with a significant diode efficiency up to 10%, which unambiguously confirms the spontaneous time-reversal symmetry breaking. Our work demonstrates a new way to search for topological superconductivity in iron-based superconductors for future high Tc fault-tolerant qubit implementations from a device perspective.

Cytochrome c oxidase (CcO) is a large membrane-bound hemeprotein that catalyzes the reduction of dioxygen to water. Unlike classical dioxygen binding hemeproteins with a heme b group in their active sites, CcO has a unique binuclear center (BNC) composed of a copper atom (Cu_B) and a heme a₃ iron, where O₂ binds and is reduced to water. CO is a versatile O₂ surrogate in ligand binding and escape reactions. Previous time-resolved spectroscopic studies of the CO complexes of bovine CcO (bCcO) revealed that photolyzing CO from the heme a₃ iron leads to a metastable intermediate (Cu_B-CO), where CO is bound to Cu_B, before it escapes out of the BNC. Here, with a pump-probe based time-resolved serial femtosecond X-ray crystallography, we detected a geminate photoproduct of the bCcO-CO complex, where CO is dissociated from the heme a₃ iron and moved to a temporary binding site midway between the Cu_B and the heme a₃ iron, while the locations of the two metal centers and the conformation of Helix-X, housing the proximal histidine ligand of the heme a₃ iron, remain in the CO complex state. This new structure, combined with other reported structures of bCcO, allows for a clearer definition of the ligand dissociation trajectory as well as the associated protein dynamics.

BACKGROUND: Risk-based screening for lung cancer is currently being considered in several countries; however, the optimal approach to determine eligibility remains unclear. Ensemble machine learning could support the development of highly parsimonious prediction models that maintain the performance of more complex models while maximising simplicity and generalisability, supporting the widespread adoption of personalised screening. In this work, we aimed to develop and validate ensemble machine learning models to determine eligibility for risk-based lung cancer screening. METHODS AND FINDINGS: For model development, we used data from 216,714 ever-smokers recruited between 2006 and 2010 to the UK Biobank prospective cohort and 26,616 high-risk ever-smokers recruited between 2002 and 2004 to the control arm of the US National Lung Screening (NLST) randomised controlled trial. The NLST trial randomised high-risk smokers from 33 US centres with at least a 30 pack-year smoking history and fewer than 15 quit-years to annual CT or chest radiography screening for lung cancer. We externally validated our models among 49,593 participants in the chest radiography arm and all 80,659 ever-smoking participants in the US Prostate, Lung, Colorectal and Ovarian (PLCO) Screening Trial. The PLCO trial, recruiting from 1993 to 2001, analysed the impact of chest radiography or no chest radiography for lung cancer screening. We primarily validated in the PLCO chest radiography arm such that we could benchmark against comparator models developed within the PLCO control arm. Models were developed to predict the risk of 2 outcomes within 5 years from baseline: diagnosis of lung cancer and death from lung cancer. We assessed model discrimination (area under the receiver operating curve, AUC), calibration (calibration curves and expected/observed ratio), overall performance (Brier scores), and net benefit with decision curve analysis. Models predicting lung cancer death (UCL-D) and incidence (UCL-I) using 3 variables-age, smoking duration, and pack-years-achieved or exceeded parity in discrimination, overall performance, and net benefit with comparators currently in use, despite requiring only one-quarter of the predictors. In external validation in the PLCO trial, UCL-D had an AUC of 0.803 (95% CI: 0.783, 0.824) and was well calibrated with an expected/observed (E/O) ratio of 1.05 (95% CI: 0.95, 1.19). UCL-I had an AUC of 0.787 (95% CI: 0.771, 0.802), an E/O ratio of 1.0 (95% CI: 0.92, 1.07). The sensitivity of UCL-D was 85.5% and UCL-I was 83.9%, at 5-year risk thresholds of 0.68% and 1.17%, respectively, 7.9% and 6.2% higher than the USPSTF-2021 criteria at the same specificity. The main limitation of this study is that the models have not been validated outside of UK and US cohorts. CONCLUSIONS: We present parsimonious ensemble machine learning models to predict the risk of lung cancer in ever-smokers, demonstrating a novel approach that could simplify the implementation of risk-based lung cancer screening in multiple settings.