Federated learning (FL) has become a burgeoning and attractive research area, which provides a collaborative training scheme for distributed data sources with privacy concerns. Most existing FL studies focus on taking unimodal data, such as images and text, as the model input and resolving the heterogeneity challenge, i.e., the non-identically distributed (non-IID) challenge caused by data distribution imbalance related to data labels and data amount. In real-world applications, data are usually described by multiple modalities. However, to the best of our knowledge, only a handful of studies have been proposed to improve the system performance by utilizing multimodal data. In this survey paper, we identify the significance of this emerging research topic – multimodal federated learning (MFL) and perform a literature review on the state-of-art MFL methods. Furthermore, we categorize multi-modal federated learning into congruent and incongruent multimodal federated learning based on whether all clients possess the same modal combinations. We investigate the feasible application tasks and related benchmarks for MFL. Lastly, we summarize the promising directions and fundamental challenges in this field for future research.

Dye wastewater containing bisphenol A (BPA) and dyes as pollutants have not been adequately studied. Our previous study revealed that thermoplastic polyurethane (TPU) nanofiber membranes (NFMs) modified by the addition of polyethyleneimine (PEI) and polydopamine (PDA) satisfactorily adsorb dyes. Herein, we first optimized the synthesis conditions for such membranes, noting a PEI:PDA monomer ratio of 2:2 and a deposition time of 48 h to be optimal. Experiments using these membranes revealed that binary systems containing BPA and the dyes (Congo red (CR), Eosin yellow (EY), or sunset yellow (SY)) exhibit three adsorption behaviors. CR and BPA compete with each other for adsorption sites, decreasing the maximum adsorption capacity (Qmax) for CR 208.3 mg/g (in a monomeric system) to 182.4 mg/g, whereas for BPA, it decreased from 26.7 to 22.8 mg/g. The adsorption rates for CR and BPA decreased from 0.002 min−1 and 0.331 min−1 in the monomeric systems to 8.37 × 10−4 min−1 and 0.072 min−1, respectively, in the binary CR–BPA system, exhibiting antagonistic effects. When EY and BPA coexist, Qmax for EY increased from 60.0 (monomeric) to 71.9 mg/g, whereas that for BPA increased from 35.6 to 43.2 mg/g, showing a synergistic effect due to the possible bridging effect. The adsorption sites for SY and BPA are independent of each other. Thus, PDA/PEI TPU NFMs exhibit the potential for removal of dye–BPA composites, whereas binary systems containing BPA with different dyes are adsorbed differently.

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), the novel coronavirus responsible for the coronavirus disease 2019 (COVID-19) pandemic, represents a serious threat to public health. The spike (S) glycoprotein of SARS-CoV-2 mediates viral entry into host cells and is heavily glycosylated. In this study, we systemically analyzed the roles of 22 putative N-linked glycans in SARS-CoV-2 S protein expression, membrane fusion, viral entry, and stability. Using α-glycosidase inhibitors, castanospermine and NB-DNJ, we confirmed that disrupting the N-linked glycosylation process blocked the maturation of the S protein, leading to impairment of S protein-mediated membrane fusion. Single substitution of each of the 22 N-linked glycosylation sites with glutamine revealed that 9 out of the 22 N-linked glycosylation sites were critical for S protein folding and maturation, resulting in reduced S protein-mediated cell-cell fusion and viral entry. Of note, N1074Q mutation markedly affected S protein stability and induced significant receptor-independent syncytium (RIS) formation in HEK293T/hACE2-KO cells, and removal of the furin-cleavage site partially compensated instability of N1074Q mutation. Although the corresponding mutation in the SARS-CoV S protein (N1056Q) did not induce RIS in HEK293T cells, the mutants N669Q and N1080Q exhibited increased fusogenic activity and induced syncytia formation in HEK293T cells. Therefore, N-glycans on the SARS-CoV and SARS-CoV-2 S2 subunits are of great importance in maintaining the prefusion state of the S protein. The study revealed the critical roles of N-glycans in S protein maturation and stability, which have implications for the design of vaccines and anti-viral strategies.