In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Long unpunctuated texts containing complex linguistic sentences are a stumbling block to processing any low-resource languages. Thus, approaches that attempt to segment lengthy texts with no proper punctuation into simple candidate sentences are a vitally important preprocessing task in many hard-to-solve NLP applications. In this paper, we propose (PDTS) a punctuation detection approach for segmenting Arabic text, built on top of a multilingual BERT-based model and some generic linguistic rules. Furthermore, we showcase how PDTS can be effectively employed as a text tokenizer for unpunctuated documents (i.e., mimicking the transcribed audio-to-text documents). Experimental findings across two evaluation protocols (involving an ablation study and a human-based judgment) demonstrate that PDTS is practically effective in both performance quality and computational cost.

Fundamental science and applied research and technology development (RTD) are facing significant challenges that particularly compound to the notorious credibility, reproducibility, funding and sustainability crises. The underlying, serious shortcomings are substantially amplified by a metrics-obsessed publication culture, and a growing cohort of academics fishing for fairly stagnant (public) funding budgets. This work presents, for the first time, a groundbreaking strategy to successfully address these severe issues; the novel strategy proposed here leverages the distributed ledger technology (DLT) “blockchain” to capitalize on cryptoeconomic mechanisms, such as tokenization, consensus, crowdsourcing, smart contracts, reputation systems as well as staking, reward and slashing mechanisms. This powerful toolbox, which is so far widely unfamiliar to traditional scientific and RTD communities (“TradSci”), is synergistically combined with the exponentially growing computing capabilities for virtualizing experiments through digital twin methods in a future scientific “metaverse”. Project contributions, such as hypotheses, methods, experimental data, modelling, simulation, assessment, predictions and directions are crowdsourced using blockchain, and captured by so-called non-fungible tokens (“NFTs”). The so enabled, highly integrative approach, termed decentralized science (“DeSci”), is destined to move research out of its present silos, and to markedly enhance quality, credibility, efficiency, transparency, inclusiveness, sustainability, impact, and sustainability of a wide spectrum of academic and commercial research initiatives.