Artificial intelligence (AI)-based models hold the potential to transform higher education if adopted properly and ethically. A prime example is ChatGPT with earlier studies indicating its widespread adoption in academia and by university students. The current study aimed to identify the factors influencing the attitude towards ChatGPT and its usage among university students in Arab countries. A previous survey instrument termed Technology Acceptance Model Edited to Assess ChatGPT Adoption (TAME-ChatGPT) was administered online using a convenience-based approach among the contacts of the authors. Confirmatory factor analysis (CFA) for the survey constructs was done using root mean square error of approximation (RMSEA), standardized root mean square residual (SRMR), comparative fit index (CFI), and Tucker-Lewis index (TLI). The final study sample comprised a total of 2240 participant divided as follows: Iraq (n=736, 32.9%), Kuwait (n=582, 26.0%), Egypt (n=417, 18.6%), Lebanon (n=263, 11.7%), and Jordan (n=242, 10.8%). A total of 1048 respondents heard of ChatGPT before the study (46.8%), of which 551 used ChatGPT (52.6%). The mean scores of TAME-ChatGPT constructs showed that the ease of ChatGPT use, positive attitude towards technology and social influence, higher perceived usefulness, the influence of behavioral/cognitive factors, low perceived risks and low anxiety were the determinants of positive attitude to ChatGPT and its use. For both the attitude and usage scales of TAME-ChatGPT, CFA collectively yielded satisfactory fit indices as indicated by low RMSEA and SRMR together with high CFI and TLI. Multivariate analysis showed that attitude to ChatGPT use was significantly influenced by country of residence, age, university type, and the latest grade point average of the students. The current study confirmed the validity of TAME-ChatGPT as a survey instrument to assess the possible determinants of ChatGPT use among university students in Arab countries. The study findings highlighted that successful adoption of ChatGPT in higher education could be dependent on perceived ease of use, usefulness, positive attitudes to technology, social influence, behavioral/cognitive factors, lower anxiety, and minimal perceived risks. The utility of ChatGPT in higher education requires policies that should be tailored for various settings, considering the differences observed in attitude towards ChatGPT among participating students in this study.

High electricity demand for consumption at current supply level in Indonesia led to the rising cost of electricity bills. This factor is compounded by the fact that many electric generators in Indonesia still use fossil fuels, which contributes to the high basic generation cost. UBL is one of the universities that aim to be a green campus. Our research explores the possibility of installing motion sensor to contribute on the energy efficiency. Although mostly common in developed countries, the use of motion sensor for energy efficiency is still rare, especially in Indonesia. despite rising cost and supply shortages, Indonesian buildings are still of high energy consumption. our experiment shows that simple installation of commercially available motion sensors can contribute to reduce the electricity bill from the increase of energy efficiency. One of the efforts to lower energy demand in consumer side is to use the electricity efficiently, such as turning off lights in a room when it's not in use. This method can be simply done by turning the light switches for office and classrooms, but difficult to do in public spaces such as toilets and corridors. Our experiment shows that simple installation of commercially available motion sensors can contribute to reduce the electricity bill from the increase of energy efficiency. Automatic light switches experimentally installed in sample toilet room prove that electricity consumption from the lamps can contribute to the reduction of total weekly energy that translates into Green House Gas emission reduction.

Oil immersed paper insulation condition is a crucial aspect of power transformer’s life condition diagnostic. The measurement testing database collected over the years made it possible for researchers to implement classification analysis to in-service power transformer. This article presents classification analysis of transformer oil-immersed paper insulation condition. The measurements data (dielectric characteristics, dissolved gas analysis, and furanic compounds) of 149 transformers with primary voltage of 150 kV had been gathered and analyzed. The algorithm used for developing classification model is Support Vector Machine (SVM). The model has been trained and tested using different datasets. Different models have been created and the best chosen, resulting in 90.63% accuracy in predicting the oil-immersed paper insulation condition. Further implementation was executed to classify oil-paper condition of 19 Transformers which Furan data is not available. The classification results combined, reviewed, and compared to conventional assessment methods and standards, confirming that the model developed has the ability to do classification of current oil-paper condition based on Dissolved Gasses and Dielectric Characteristics.

In power systems there are complex transformer structures, whose accurate analysis is not possible using the techniques available today. This paper presents a systematic data driven analysis method for coupled inductors of arbitrary complexity. The method first establishes a winding matrix N mapping the windings to the limbs of the transformer. A permeance matrix P is created from the reluctance network of the magnetic core. A generalized inductance matrix L mapping currents in the transformer windings to the induced voltages is generated based on the winding (N) and permeance (P) matrices. The inductance matrix representation of a coupled inductor is then transformed to an admittance matrix, which can be integrated to the nodal analysis of the electrical circuit surrounding the coupled inductor. The method presented is validated by simulations with real transformer structures using electromagnetic transient program (EMTP/ATP).

This paper develops a novel dynamic correction method for the reliability assessment of large oil-immersed power transformers. First, with the transformer oil-paper insulation system (TOPIS) as the target of evaluation and the winding hot spot temperature (HST) as the core point, an HST-based static ageing failure model is built according to the Weibull distribution and Arrhenius reaction law, in order to describe the transformer ageing process and calculate the winding HST for obtaining the failure rate and life expectancy of TOPIS. A grey target theory based dynamic correction model is then developed, combined with the data of Dissolved Gas Analysis (DGA) in power transformer oil, in order to dynamically modify the life expectancy calculated by the built static model, such that the corresponding relationship between the state grade and life expectancy correction coefficient of TOPIS can be built. Furthermore, the life expectancy loss recovery factor is introduced to correct the life expectancy of TOPIS again. Lastly, a practical case study of an operating transformer has been undertaken, in which the failure rate curve after introducing dynamic corrections can be obtained for the reliability assessment of this transformer. The curve shows a better ability of tracking the actual reliability level of transformer, thus verifying the validity of the proposed method and providing a new way for transformer reliability assessment. This contribution presents a novel model for the reliability assessment of TOPIS, in which the DGA data, as a source of information for the dynamic correction, is processed based on the grey target theory, thus the internal faults of power transformer can be diagnosed accurately as well as its life expectancy updated in time, ensuring that the dynamic assessment values can commendably track and reflect the actual operation state of the power transformers.

A high step-up DC-to-DC converter that integrates an isolated transformer and a switched-clamp capacitor is presented in this study. The voltage stress of the main power switch should be clamped to 1/4 V by using the turn ratio and switched-clamp capacitor of an isolated transformer to achieve a high voltage gain. In addition, a passive clamp circuit is employed reduce voltage stress on the main power switch. The energy of the leakage inductor can be recycled by the clamp capacitor because of the passive clamp circuit, thereby improving the power converter efficiency. The converter consists of one isolated transformer, one main switch, three capacitors, and four diodes. Operating principle and steady-state analyses are also discussed. Finally, a 24-V-input voltage to 200-V-output voltage and a 150 W output power prototype converter are fabricated in the laboratory. The maximum efficiency of the converter is 95.1 at 60 W.

This paper presents a symmetrical topology for the design of solid-state transformer, made up of power switching converters, to replace conventional bulky transformers. The proposed circuitry not only reduces the overall size but also provides power flow control with the ability to be interfaced with renewable energy resources (RESs) to fulfill the future grid requirements at consumer end. Solid state transformer provides bidirectional power flow with variable voltage and frequency operation and has the ability to maintain unity power factor, and current total harmonic distortion (THD) for any type of load within defined limits of IEEE standard. Solid State Transformer offers much smaller size as compared to that of the conventional iron core transformer. MATLAB/Simulink platform is adopted to test the validity of the proposed circuit for different scenarios by providing the simulation results evaluated at 25 kHz switching frequency.

Paraphrase Generation is one of the most important and challenging tasks in the field of Natural Language Generation. The paraphrasing techniques help to identify or to extract/generate phrases/sentences conveying the similar meaning. The paraphrasing task can be bifurcated into two sub-tasks namely, Paraphrase Identification (PI) and Paraphrase Generation (PG). Most of the existing proposed state-of-the-art systems have the potential to solve only one problem at a time. This paper proposes a light-weight unified model that can simultaneously classify whether given pair of sentences are paraphrases of each other and the model can also generate multiple paraphrases given an input sentence. Paraphrase Generation module aims to generate fluent and semantically similar paraphrases and the Paraphrase Identification systemaims to classify whether sentences pair are paraphrases of each other or not. The proposed approach uses an amalgamation of data sampling or data variety with a granular fine-tuned Text-To-Text Transfer Transformer (T5) model. This paper proposes a unified approach which aims to solve the problems of Paraphrase Identification and generation by using carefully selected data-points and a fine-tuned T5 model. The highlight of this study is that the same light-weight model trained by keeping the objective of Paraphrase Generation can also be used for solving the Paraphrase Identification task. Hence, the proposed system is light-weight in terms of the model’s size along with the data used to train the model which facilitates the quick learning of the model without having to compromise with the results. The proposed system is then evaluated against the popular evaluation metrics like BLEU (BiLingual Evaluation Understudy):, ROUGE (Recall-Oriented Understudy for Gisting Evaluation), METEOR, WER (Word Error Rate), and GLEU (Google-BLEU) for Paraphrase Generation and classification metrics like accuracy, precision, recall and F1-score for Paraphrase Identification system. The proposed model achieves state-of-the-art results on both the tasks of Paraphrase Identification and paraphrase Generation.

This paper reports 2 × 4 hybrid Mach-zehnder interferometer (MZI) - multi-mode interferometers (MMI) based compact thermo-optical switch consisting of slab waveguides on silicon-on-insulator, SOI, platform. The device consists of two identical MMIs, each of 6 μm wide and 140 μm long connected with two phase shifters MMIs each with 2 μm wide and 8 μm long and linear tappers each 4 μm long, connected at both ends of the MMIs to minimize the power coupling loss. The loss for linear taper is found to be below 0.02dB. The footprint of the whole device is six 6 μm × 324 μm. This structure is based on unique multimode region shape, which leads optical switch to have less coupling loss and reduced cross-talk. The average thermo-optical switching power consumption is 1.4 mW, the excess losses are 0.8 dB, and the imbalances are 0.1 dB. Aluminum is used as a heating pad, and a trench is created around this pad to prevent from spreading of heat and reduce power loss almost by a factor of 2 to the adjacent phase shifter. Our new heating method has advantages of compact size and ease of fabrication with the current CMOS technology.

Large Language Models (LLMs) have revolutionized the field of Artificial Intelligence with their ability to understand and generate natural language discourse. This has led to the use of LLMs in various creative fields such as music, art, and storytelling, which has sparked a debate on the impact of LLMs on human creativity. This article explores the cyclic effect of LLMs on human creativity, where LLMs can generate an ever-evolving cycle of creative output from both humans and machines. The article also highlights the importance of responsible and ethical use of LLMs, including privacy and copyright issues with the training data used by LLMs. The article emphasizes the need for transparency, data security measures, and AI governance policies to protect user data and ensure the safe use of LLMs. It also calls for the development of educational materials and resources to increase public understanding of LLMs and their ethical implications. The article concludes by highlighting the potential of LLMs as powerful tools for communication and education, but also emphasizes the need for ethical considerations to ensure the responsible and beneficial use of LLMs in society.

Large power transformers are generally associated with a maximum capacity rating of 100 MVA or higher. These large liquid dielectric power transformers are a custom-built piece of equipment, thus very expensive, and a backbone element of the power grid. In extreme cases as, for example, severe geomagnetic disturbances, permanently monitoring their condition will enhance their electrical reliability and resilience to guarantee efficient management of its life cycle. However, some traditional monitoring/diagnosis techniques have singular features when applied to large power transformers and their interlinked subsystems. In this context, and since that information is hardly put in evidence and compiled in the literature, this paper reviews the particularities of monitoring and diagnosing those assets.

Compared with conventional methods of fault diagnosis for power transformers, which have defects such as imperfect encoding and too absolute encoding boundaries, this paper systematically discusses various intelligent approaches applied in fault diagnosis and decision making for large oil-immersed power transformers based on dissolved gas analysis (DGA), including expert system (EPS), artificial neural network (ANN), fuzzy theory, rough sets theory (RST), grey system theory (GST), swarm intelligence (SI) algorithms, data mining technology, machine learning (ML), and other intelligent diagnosis tools, and summarizes existing problems and solutions. From this survey, it is found that a single intelligent approach for fault diagnosis can only reflect operation status of the transformer in one particular aspect, causing various degrees of shortcomings that cannot be resolved effectively. Combined with the current research status in this field, the problems that must be addressed in DGA-based transformer fault diagnosis are identified, and the prospects for future development trends and research directions are outlined. This contribution presents a detailed and systematic survey on various intelligent approaches to faults diagnosing and decisions making of the power transformer, in which their merits and demerits are thoroughly investigated, as well as their improvement schemes and future development trends are proposed. Moreover, this paper concludes that a variety of intelligent algorithms should be combined for mutual complementation to form a hybrid fault diagnosis network, such that avoiding these algorithms falling into a local optimum. Moreover, it is necessary to improve the detection instruments so as to acquire reasonable characteristic gas data samples. The research summary, empirical generalization and analysis of predicament in this paper provide some thoughts and suggestions for the research of complex power grid in the new environment, as well as references and guidance for researchers to choose optimal approach to achieve DGA-based fault diagnosis and decision of the large oil-immersed power transformers in preventive electrical tests.

Neural decoding from spiking activity is an essential tool for understanding the information encoded in population neurons, especially in applications like brain-computer interface (BCI). Various quantitative methods have been proposed and have shown superiorities under different scenarios respectively. From the machine learning perspective, the decoding task is to map the high-dimensional spatial & temporal neuronal activity to the low-dimensional physical quantities (e.g., velocity, position). Because of the complex interactions and the abundant dynamics among neural circuits, good decoding algorithms usually have the capability of capturing flexible spatiotemporal structures embedded in the input feature space. Recently, the Transformer-based models are widely used in processing natural languages and images due to its superior performances in handling long-range and global dependencies. Hence, in this work we examine the potential applications of Transformers in neural decoding and introduce two Transformer-based models. Besides adapting the Transformer to neuronal data, we also propose a data augmentation method for overcoming the data shortage issue. We test our models on three experimental datasets and their performances are comparable to the previous state-of-the-art (SOTA) RNN-based methods. In addition, Transformer-based models show increased decoding performances when the input sequences are longer, while LSTM-based models deteriorate quickly. Our research suggests that Transformer-based models are important additions to the existing neural decoding solutions, especially for large datasets with long temporal dependencies.

This paper describes the successful application of the Transformer model used in the natural language processing and vision tasks as a means of processing the time series of signals from gyroscope and accelerometer sensors for the classification of human activities. The Transformer model is based on deep neural networks with many layers which can generalize well on signals. All measured signals come from a smartphone placed in a waist bag. Activity prediction is sequence-to-sequence, each time step of the signal is assigned a designation of the performed activity. Emphasis is placed on attention mechanisms, which express individual dependencies between signal values within a time series. In comparison with another recent result, the recognition precision was improved from 89.67 percent to 99.2 percent. The transformer model should in the future be included among the top options in machine learning methods for human activity recognition.

The past two decades has seen a growing demand for high-power, high-voltage utility scale inverters mostly fueled by the integration of large solar PV and wind farms. Multilevel inverters have emerged as the industry choice for these megawatt range inverters because their reduced voltage stress, capable of generating an almost sinusoidal voltage, in-built redundancy, among others. This paper present a new Switched-Source Multilevel Inverter (SS MLI) architecture. The new inverter show superior over existing topologies. It has reduced voltage stress on the semiconductor, uses less number of switches –reduced size/weight/cost and increased efficiency. The new SSMLI is comprised of two voltage sources (V₁, V₂) and 6 switches. It is capable of generating 5-level output voltage in symmetric modes (i.e., V₁ = V₂), and 7-level output voltage in asymmetric modes (i.e., V₁ ≠ V₂). To demonstrate the validity of the proposed inverter, simulations results using MATLAB^® /Simulink^® for 5- and 7-level output voltages are presented . The simulations are also verified experimentally using a laboratory prototype.

In the leading/trailing edge’s adaptive machining of the near-net-shaped blade, a small portion of the theoretical part is retained for securing aerodynamic performance by manual work. However, this procedure is time-consuming and depends on the human experience. In this paper, we defined retained theoretical leading/trailing edge as the reconstruction area. To accelerate the reconstruction process, an anchor-free neural network model based on Transformer was proposed, named LETR (Leading/trailing Edge Transformer). LETR extracts image features from an aspect of mixed frequency and channel domain. We also integrated LETR with the newest meta-Acon activation function. We tested our model on the self-made dataset LDEG2021 on a single GPU and got an mAP of 91.9\%, which surpassed our baseline model, Deformable DETR by 1.1\%. Furthermore, we modified LETR’s convolution layer and named the new model after GLETR (Ghost Leading/trailing Edge Transformer) as a lightweight model for real-time detection. It is proved that GLETR has fewer weight parameters and converges faster than LETR with an acceptable decrease in mAP (0.1\%) by test results.

This paper presents a complete control strategy of the active return-to-center (RTC) control for electric power steering (EPS) systems. We first establish the mathematical model of the EPS system and analyze the source and influence of the self-aligning torque (SAT). Second, based on the feedback signals of steering column torque and steering wheel angle, we give the trigger conditions of a state switch between the steering assist state and the RTC state. In order to avoid the sudden change of the output torque for the driving motor when the state switches frequently between the steering assist state and the RTC state, we design an undisturbed state switching logic algorithm. This state switching logic algorithm ensures that the output value of the RTC controller is set to an initial value and increases in given steps up to a maximum value after entering the RTC state, and the output value of the RTC controller will reduce in given steps down to zero when exiting the RTC state. This therefore ensures smooth switch control between the two states and improves the driver’s steering feeling. Third, we design the RTC controller, which depends upon the feedback signals of the steering wheel angle and the angular velocity. In addition, the controller increases the auxiliary control function of the RTC torque based on vehicle speed. The experimental results show that the active RTC control method does not affect the basic assist characteristics, which effectively reduces the residual angle of the steering wheel at low vehicle speed and improves the RTC performance of the vehicle.

Genetic switches can be utilized for many purposes in synthetic biology including the assembly of complex genetic circuits to achieve sophisticated cellular systems and the construction of biosensors for real-time monitoring of intracellular metabolite concentrations. Although genetic switches have mainly been developed in prokaryotes to date, eukaryotic genetic switches are increasingly being reported as both rational and irrational engineering technologies mature. In this review, we describe genetic switches in yeast based on synthetic transcription factors and/or synthetic promoters. We also discuss directed evolution technologies for the rapid and robust construction of yeast genetic switches.

This paper reports design of a 2 × 4 hybrid multimode interferometer-Mach-zehnder interferometer (MMI-MZI) configuration and compact thermo-optical switch consisting of slab waveguides on the silicon-on-insulator (SOI), platform. The device consisted of two identical MMIs as power splitters and couplers that are connected with two identical MMI-based phase shifters, and linear tapers at both ends of the MMIs to minimize the power coupling loss. A thin Al pad is used as a heating element, and a trench is created around this pad to prevent heat from spreading and to minimize loss. The calculated average thermo-optical switching power consumption, excess loss, and power imbalance are 1.4 mW, 0.9 dB, and 0.1 dB, respectively. The overall footprint of the device is 6 × 304 μm². The new heating method has advantages of compact size, ease of fabrication on SOI platform with the current CMOS technology, and offers low excess loss and power consumption as demanded by devices based on SOI technology. The device can act as two independent optical switches in one structure.

An autonomous endogenous time-keeping is ubiquitous across many living organisms known as circadian clock when it has a period of about 24 hours. Interestingly, the fundamental design principle with a network of interconnected negative and positive feedback loops is conserved through evolution, although the molecular components differ. Filamentous fungus \textit{Neurospora crassa} is a well established chrono-genetics model organism to investigate the underlying mechanisms. The core negative feedback loop of the clock of \textit{Neurospora} is composed of the transcription activator White Collar Complex (WCC) (heterodimer of WC1 and WC2) and the inhibitory element called FFC complex which is made of FRQ (Frequency protein), FRH (Frequency interacting RNA Helicase) and CK1a (Casein kinase 1a). While exploring their temporal dynamics we investigate how limit cycle oscillations arise and how molecular switches support self-sustained rhythms. We develop a mathematical model of 10 variables with 26 parameters to understand the interactions and feedbacks among WC1 and FFC elements in nuclear and cytoplasmic compartments. We performed control and bifurcation analysis to show that our novel model produces robust oscillations with a wild-type period of 22.5 hrs. Our model reveals a switch between WC1 induced transcription and FFC assisted inactivation of WC1. Using the new model we also study possible mechanisms of glucose compensation. A fairly simple model with just 3 non-linearities helps to elucidate clock dynamics revealing a mechanism of rhythms production. The model can further be utilized to study entrainment and temperature compensation.

The Chat Generative Pre-training Transformer (GPT), also known as ChatGPT, is a powerful generative AI model that can simulate human-like dialogues across a variety of domains. However, this popularity has attracted the attention of malicious actors who exploit ChatGPT to launch cyberattacks. This paper examines the tactics that adversaries use to leverage ChatGPT in a variety of cyberattacks. Attackers pose as regular users and manipulate ChatGPT’s vulnerability to malicious interactions, particularly in the context of cyber assault. The paper presents illustrative examples of cyberattacks that are possible with ChatGPT and discusses the realm of ChatGPT-fueled cybersecurity threats. The paper also investigates the extent of user awareness of the relationship between ChatGPT and cyberattacks. A survey of 253 participants was conducted, and their responses were measured on a three-point Likert scale. The results provide a comprehensive understanding of how ChatGPT can be used to improve business processes and identify areas for improvement. Over 80% of the participants agreed that cyber criminals use ChatGPT for malicious purposes. This finding underscores the importance of improving the security of this novel model. Organizations must take steps to protect their computational infrastructure. This analysis also highlights opportunities for streamlining processes, improving service quality, and increasing efficiency. Finally, the paper provides recommendations for using ChatGPT in a secure manner, outlining ways to mitigate potential cyberattacks and strengthen defenses against adversaries.

Fibroblasts, the most abundant cells in the connective tissue, are key modulators of the extracellular matrix (ECM) composition. These spindle-shaped cells are capable of synthesizing various extracellular matrix proteins and collagen. They also provide the structural framework (stroma) for tissues and play a pivotal role in the wound healing process. While they are maintainers of the ECM turnover and regulate several physiological processes, they can also undergo transformations responding to certain stimuli and display aggressive phenotypes that contribute to disease pathophysiology. In this review, we focus on the metabolic pathways of glucose and highlight metabolic reprogramming as a critical event that contributes to the transition of fibroblasts from quiescent to activated and aggressive cells. We also cover the emerging evidence that allows us to draw parallels between fibroblasts in autoimmune disorders and more specifically in rheumatoid arthritis and cancer. We link the metabolic changes of fibroblasts to the toxic environment created by the disease condition and discuss how targeting of metabolic reprogramming could be employed in the treatment of such diseases. Lastly, we discuss Systems Biology approaches, and more specifically, computational modelling, as a means to elucidate pathogenetic mechanisms and accelerate the identification of novel therapeutic targets.

This paper discusses a MEMS switch that can be fabricated using low temperature (<100^oC) deposition and patterning techniques suitable for the back-end-of-the-line integration with CMOS. The resulting cross-bar switches can be used for electrostatic discharge protection, FPGA implementation, chip security assessment and lock-down, and circuit block power management. We discuss platinum and iron switch with turn-on voltages of ~ 1.8 V. In the case of the iron switches, we also show that they can be magnetized to have “memory” and stay on when turned on. Platinum switch cycling of up to 1000 times did not show any changes in their turn-on voltage and their contact resistance was unchanged. The 10-100 nm switch airgaps were formed using low temperature sputtered sacrificial polysilicon and XeF₂ etching. XeF₂ does not attack any of the metals used in CMOS enabling fabrication of cross-bar switches with any of these metals. Once activated, it takes ∿ 6 to mechanically turn on the switch that can be decreased to ~1 ns by optimizing the device structure. Interestingly, the nm-scale gaps can be used as spark gap as a fast plasma switch to discharge first followed by the activation of the MEMS switch.

Considering the isotropic release process of nanoelectromechanical systems (NEMS), defining the active region of NEM memory switches is one of the most challenging process technologies for the implementation of monolithic-three-dimensional (M3D) CMOS-NEM hybrid circuits. In this paper, we propose a novel encapsulation method of NEM memory switches. It uses alumina (Al2O3) passivation layers which are fully compatible with CMOS baseline process. The Al2O3 bottom passivation layer can protect intermetal dielectric (IMD) and metal interconnection layers from vapor hydrogen fluoride (HF) etch process. Thus, the controllable formation of the cavity for the mechanical movement of NEM memory switches can be achieved without causing any damage to CMOS baseline circuits as well as metal interconnection lines. As a result, NEM memory switches can be located in any places and metal layers of an M3D CMOS-NEM hybrid chip, which makes circuit design easier and more volume-efficient. The feasibility of our proposed method is verified based on experimental results.

This primer provides an overview of the rapidly evolving field of generative artificial intelligence, specifically focusing on large language models like ChatGPT (OpenAI) and Bard (Google). Large language models have demonstrated unprecedented capabilities in responding to natural language prompts. The aim of this primer is to demystify the underlying theory and architecture of large language models, providing intuitive explanations for a broader audience. Learners seeking to gain insight into the technical underpinnings of large language models must sift through rapidly growing and fragmented literature on the topic. This primer brings all the main concepts into a single digestible document. Topics covered include text tokenization, vocabulary construction, token embedding, context embedding with attention mechanisms, artificial neural networks, and objective functions in model training. The primer also explores state-of-the-art methods in training large language models to generalize on specific applications and to align with human intentions. Finally, an introduction to the concept of prompt engineering highlights the importance of effective human-machine interaction through natural language in harnessing the full potential of artificial intelligence chatbots. This comprehensive yet accessible primer will benefit students and researchers seeking foundational knowledge and a deeper understanding of the inner workings of existing and emerging artificial intelligence models. The author hopes that the primer will encourage further responsible innovation and informed discussions about these increasingly powerful tools.

As e-commerce services and Internet technology have rapidly developed in recent years, many services and applications integrating these technologies can now be completed online. These commercial activities include online auctions, online ticketing and online payments. The client shops from the store online, andthe store delivers the goods to the client. The goods can be divided into digital products without entities, as well as actual entities. If it is a physical product, the store will deliver the package to the client through itslogistics. However, there have been many cases of switched goods purchased by clients in recent years. Earlier, some scholars proposed a security mechanism with a subliminal channel for E-cash and digital content. Only the sender and the receiver would know that the secret information was hidden in the signature. So the privacy of this subliminal message couldbe ensured. We apply this concept to the logistics environment to design secure logistics architecture with subliminal messages. The client can check the subliminal message of the received package, and know whether the package has been switched by malicious people. In addition, the proposed scheme also applies sensor technology;the client can check the GPS location, the temperature and humidity at any time during the delivery process. So intelligent logisticswouldthereby be achieved. This paper proposes an intelligent and secure package sensoring logistics system based on a subliminal channel. The proposed architecture uses the related mechanisms tosolve the problems of a logistics system, including how to achieve mutual authentication, data integrity, anti-switch package, package location and status tracing, resisting replay attacks, forward and backward secrecy, and non-repudiation issues.

Indoor localization is an active area of research dominated by traditional machine-learning techniques. Deep learning-based systems have shown unprecedented improvements and have accomplished exceptional results over the past decade, especially the Transformer network within natural language processing (NLP) and computer vision domains. We propose the hyper-class Transformer (HyTra), an encoder-only Transformer with multiple classification heads (one per class) and learnable embeddings, to investigate the effectiveness of Transformer-based models for received signal strength (RSS) based WiFi fingerprinting. HyTra leverages learnable embeddings and the self-attention mechanism to determine the relative position of the wireless access points (WAPs) within the high-dimensional embedding space, improving the prediction of user location. From an NLP perspective, we consider a fixed order sequence of all observed WAPs as a sentence and the captured RSS value(s) for every given WAP at a given reference point from a given user as words. We test our proposed network on public and private datasets of different sizes, proving that the quality of the learned embeddings and overall accuracy improves with increments in samples.

In organic synthesis, due to their high electrophilicity and leaving group properties, halogens play pivotal roles in the activation and structural derivations of organic compounds. Recently, cyclizations induced by halogen groups that allow the production of diverse targets and the structural reorganization of organic molecules have attracted significant attention from synthetic chemists. Electrophilic halogen atoms activate unsaturated and saturated hydrocarbon moieties via the generation of halonium intermediates, followed by the attack of carbon-, nitrogen-, oxygen-, and sulfur-containing nucleophiles to give highly functionalized carbo- and heterocycles. Interestingly, new transformations of halogenated organic molecules that can control the formation and stereoselectivity of the products according to the difference in the size and number of halogen atoms have recently been discovered. These unique cyclizations may possibly be used as efficient synthetic strategies with future advances. In this review, innovative reactions controlled by halogen groups are discussed as a new concept in the field of organic synthesis.

The measurement range of a conventional current sensor is narrow because it is used with signals relative to the rated values of the measurement range from a voltage-type device. Consequently, multiple current sensors must be used in accordance with the measurement range. To address this problem, this paper proposes a new current sensor with a clamp-shaped part for low current measurement and a simple straight structure for high current measurement. The output signals of the proposed current sensor are amplified with a Hall element using the magnetic force of a rectangular air gap inside the clamp. To verify the characteristics of the proposed current sensor, a current was applied to an external load, and the value determined by the current sensor noted. Then, electromagnetic field analysis was performed through current sensor modeling and the results obtained compared to the actual sensor results. The proposed sensor had a 1% linearity in the output signals and exhibited dynamic characteristics over a wide current range.

OpenAI has managed to turn 100 million heads in two months towards their new Language model tool (LM) ChatGPT. The third generation Generative Pretrained Transformer (GPT-3) has the capacity to tackle simple to complex and sophisticated problems, while providing reasoning behind its generated answers. ChatGPT can be used to increase productivity and improve efficiency and face challenging problems. Programming mobile applications is a challenging task that requires professional software engineers, skills and abilities to be developed. The following paper takes a case study approach to assess how novice app developers can use ChatGPT to generate Java scripts that will be used in Android studio to create a functional application. The results after, many iterations and ongoing conversations with ChatGPT managed to create an application for the anticipated function. Important insights have been drawn from the case study that could set the ground for any novice user seeking to create applications using Java scripting and Android Studio.

β-Ga2O3 crystal have attracted great attentions in the fields of photonics and photoelectronics because of its ultra wide-band gap and high thermal conductivity. Here, pure β-Ga2O3 crystal was successfully grown by optical floating zone (OFZ) method, and used as saturable absorbers to realize a passively Q-switched all-solid-state 1μm laser for the first time. By placing the as-grown β-Ga2O3 crystal into the resonator of Nd:GYAP solid-state laser, a Q-switched pulses at the center wavelength of 1080.4 nm are generated under a output coupling of 10%. The maximum output power is 191.5 mW while the shortest pulse width is 606.54 ns, and the maximum repetition frequency is 344.06 kHz. The maximum pulse energy and peak power are 0.567 μJ and 0.93 W, respectively. Our experimental results show that β-Ga2O3 crystal has great potential in the development of all-solid-state 1μm pulsed laser.

Ultrasound (US) has become a widely used imaging modality in clinical practice, characterized by its rapidly evolving technology, advantages, and unique challenges such as low imaging quality and high variability. There is a critical need to develop advanced automatic US image analysis methods to enhance diagnostic accuracy and objectivity. Vision transformer, a recent innovation in machine learning, has demonstrated significant potential in various research fields, including general image analysis and computer vision, due to its capacity to process large datasets and learn complex patterns. Its suitability for automatic US image analysis tasks, such as classification, detection, and segmentation, has been recognized. This review provides an introduction to vision transformer and discusses its applications in specific US image analysis tasks, while also addressing the open challenges and potential future trends in its application in medical US image analysis. Vision transformer has shown promise in enhancing the accuracy and efficiency of ultrasound image analysis and is expected to play an increasingly important role in the diagnosis and treatment of medical conditions using ultrasound imaging as technology progresses.

Accurate prediction of crop production is essential in effectively managing agricultural countries' food security and economic resilience. This study evaluates the performance of statistical and machine learning-based methods for large-scale crop production forecasting. We predict the quarterly production of 325 crops (including fruits, vegetables, cereals, non-food, and industrial crops) across 83 provinces in the Philippines. Using a comprehensive dataset of 10,949 time series over 13 years, we demonstrate that a global forecasting approach using a state-of-the-art deep learning architecture, the transformer, significantly outperforms traditional local forecasting approaches built on statistical and baseline methods. By leveraging cross-series information, our proposed way is scalable and works well even with time series that are short, sparse, intermittent, or exhibit structural breaks/regime shifts. The results of this study further advance the field of applied forecasting in agricultural production and provide a practical and effective decision-support tool for policymakers that oversee the farm sector on a national scale.

Detection of partial discharge (PD) activities in high-voltage equipment can be done according to the several mechanisms of signal detection, which are electromagnetic wave signal detection, acoustic signal detection, chemical reactions, electrical signal detection, or optical emission detection. Recently, multiple methods of detection and localization of partial discharge activities occurred in power transformers and gas-insulated switchgear (GIS) have been proposed to monitor the health condition of high-voltage equipment, especially when the awareness regarding preventive maintenance has been emphasized at the industrial level and electrical providers. In aligning the needs of industrial and the improvement of PD detection methods, this manuscript focused on reviewing the current practice methods for the detection and localization of PD signals in high-voltage equipment and comparing their efficacy, in summarizing the future direction of research work-related methods of PD detection. The comparative reviews are discussed in terms of the mechanism of PD signal detection, indication parameters, calibration technique, advantages, and limitations of each method of PD measurement in detail.

Because imbalanced power will cause the loss of the propulsion motor of the railway vehicle, and the increase in temperature will shorten the service life of the electric vehicle. Not only this, but also increase the cost of electricity and maintenance. In the past, the industry only focused on methods to improve power quality such as load capacity, relay setting, and harmonic resolution. Now, the consider of three-phase unbalance rate (TPUR) must be applied. I propose special transformers wiring (STW) to improve the three unbalance rates and provide different transformer wiring methods. According to the IEEE Committee, in the future, power companies will need to install balanced relay stations to improve three-phase unbalance rate. the internal regulations of Taipower must be less than 4.5% (voltage unbalance rate (NPSUR)of 2.5% and motor temperature rise of 12.5%). the derivation of the transformer "three-phase unbalance rate" model is the focus of the railway system. This research is based on the model derivation of different wiring methods to improve the hot problem caused by the three-phase imbalance and improve the service life of the train. And pointed out that Scott, Le-Blanc, Modified-Woodbridge three wiring methods can be applied to future railway system routes to improve the three-phase unbalance rate, in line with the IEEE standard of less than 2%.

Hemoglobin switch from fetal (HbF) to adult (HbA) has been studied intensively as an essential model for gene’s expression regulation, but also as a beneficial therapeutic approach for β-hemoglobinopathies, towards the objective of reactivating HbF. Transcription factor LRF (Leukemia/lymphoma-related), encoded from ZBTB7A gene has been implicated in fetal hemoglobin silencing, though has a wide range of functions that have not been fully clarified. We thus established LRF/ZBTB7A-overexpressing and ZBTB7A-knockdown K562 (human erythroleukemia cell line) clones and hemoglobin production was evaluated pre- and post-induction. Related effects on the process of hemoglobin switch from fetal to adult were also assessed. Transgenic K562 clones were further developed and studied under the influence of epigenetic chromatin regulators, such as DNA methyl transferase 3 (DNMT3) and Histone Deacetylase 1 (HDAC1), to evaluate LRF’s potential disturbance upon aberrant epigenetic background and provide valuable information of the preferable epigenetic frame, in which LRF unfolds its action on the β-type globin’s expression. ChIP-seq analysis demonstrated that LRF binds το γ-globin genes (HBG2/1) and apparently associates BCL11A for their silencing, but also, during erythropoiesis induction LRF binds BGLT3 gene promoting BGLT3-lncRNA production through the γ-δ intergenic region of β-type globin’s locus, triggering the transcriptional events from γ- to β-globin switch.

Induction heating (IH) technology is widely recognized and utilized in residential applications due to its high efficiency and safe operating characteristics. Resonant inverter circuits are widely used in IH systems because of their high efficiency and ability to perform soft-switching. Among the various resonant inverters used in IH systems, the single-switch quasi-resonant (SSQR) inverter topology is typically preferred for low-cost and low-output-power applications. Despite its cost advantage, the SSQR topology has a relatively narrow soft-switching range, which can be unstable depending on the electrical parameters of the load and the resonant converter circuit. Accurately determining the capacitance value of the resonant capacitor and the inductance value of the induction coil, which are the key circuit elements of the SSQR induction cooker, is crucial for designing a reliable, efficient, and durable cooking system. In other words, there exists a critical relationship between the resonant converter circuit parameters, load characteristics, and safe operating conditions. Additionally, when considering closed-loop control methods used for power control and safety, selecting appropriate resonant circuit elements becomes vital in ensuring both reliable and efficient operation. This paper focuses on a novel and simplified design method for the SSQR inverter utilized in household appliances. The proposed method and its advantages in terms of the safe operating area of the switch are theoretically investigated and verified through simulations and prototype circuits.

A low-cost medium power carbon dioxide (CO₂) laser system is designed, constructed, and characterized to produce coherent, monochromatic laser radiation in the Infrared region. The laser cavity is simulated and designed by using ZEMAX optic studio. A switch-mode high tension pump source is designed and constructed using a flyback transformer and simulated using NI Multisim to study the voltage behavior at different node points. A prototype cooling system/chiller is designed and built using the Thermo-Electric Coolers (TEC) to remove the excess heat produced during laser action. Various parameters, like pumping mechanism, chiller stability, efficiency, output power, and current at different applied voltages, are studied. The chiller efficiency at different output powers of the laser is analyzed, which clearly shows that the chiller's cooling rate is good enough to compensate for the heat generated by the laser system. The center wavelength of the carbon dioxide laser is 10.6μm with FWHM of 1.2nm simulated in the ZEMAX optic studio. The output beam penetration through salt rock (NaCl), wood, and acrylic sheet at various output powers is analyzed to measure the penetration depth rate of the CO₂ laser.

The research results presented in the article were carried out during the realization of the project, the aim of which is to develop a method of drying cellulose insulation in power transformers with the use of synthetic ester. This method uses a very high water absorption of the ester. During the drying of transformers, the ester is systematically contaminated with mineral oil, which gradually loses its ability to absorb water. Information on the oil concentration in the mixture is needed in two cases: at the stage of making a decision on the treatment of the mixture and during its treatment. The article presents the results of investigations of two methods: 1) based on the measurement of the mixture density, and 2) based on the measurement of the capacitance of the capacitor immersed in the mixture. The conducted research shows that the method of measuring the density of the mixture gives an uncertainty of 2.6 p. %, while the method of measuring the capacitance of a capacitor gives an uncertainty of 2.2 p. %. A significant advantage of the method of measuring the capacitance is the possibility of using it online to control the ester treatment process.

Safe, high-quality and economical electric energy transportation is the basic requirements of modern power system operation. Transformer, as one of the core equipment of power system and national grid system, has the characteristics of diverse types, variable models and wide deployment. It is the basic equipment for power system to realize voltage change and electric energy distribution. Because the power system transformer needs to operate with load for a long time, the probability of failure is usually higher than that of other power equipment in general. This paper starts from the transformer fault and fault diagnosis. Firstly, the transformer fault types, traditional transformer fault diagnosis techniques and the advantages of machine learning in transformer fault diagnosis are reviewed. Secondly, the application of information system theory and information entropy in transformer fault diagnosis is introduced. Then it introduces machine learning technology, feature selection and extraction technology in transformer fault diagnosis, and machine learning algorithms such as support vector machine and extreme learning machine for transformer fault diagnosis. Finally, the potential development trend of information system theory, information entropy and machine learning in transformer fault diagnosis is forecasted. The combination of transformer fault prediction and machine learning algorithm is helpful for power system maintenance personnel to accurately predict the running state of power equipment, and also provides a new method and technology for the safe and reliable operation and regular maintenance of power system.

Predicting Length of Stay (LoS) and understanding its underlying factors is essential to minimize the risk of hospital-acquired conditions, improve financial, operational, and clinical outcomes, and to better manage future pandemics. The purpose of this study is to forecast patients’ LoS using a deep learning model and analyze cohorts of risk factors minimizing or maximizing LoS. We employed various pre-processing techniques, SMOTE-N to balance data, and Tab-Transformer model to forecast LoS. Finally, Apriori algorithm was applied to analyze cohorts of risk factors influencing LoS at hospital. The Tab-Transformer outperformed the base Machine Learning models with an F1-score (.92), precision (.83), recall (.93), and accuracy (.73) for discharge dataset, and F1-score (.84), precision (.75), recall (.98), and accuracy (.77) for deceased dataset. The association mining algorithm was able to identify significant risk factors/indicators belonging to lab, X-Ray, and clinical data such as elevated LDH, and D-Dimer, lymphocytes count, and comorbidities such as hypertension and diabetes responsible for extending patients LoS. It also reveals what treatments has reduced the symptoms of COVID-19 patients leading to reduction in LoS particularly when no vaccines or medication such as Paxlovid were available.

Mature B cells notably diversify immunoglobulin (Ig) production through class switch recombination (CSR), allowing the junction of distant “switch” (S) regions. CSR is initiated by activation-induced deaminase (AID) which targets cytosines adequately exposed within single-stranded DNA of transcribed targeted S regions, with a specific affinity for WRCY motifs. In mammals, G-rich sequences are additionally present in S regions, forming canonical G-quadruplexes (G4s) DNA structures which favor CSR. Small molecules interacting with G4-DNA (G4 ligands), proved able to regulate CSR in B lymphocytes, either positively (such as for nucleoside diphosphate kinase isoforms) or negatively (such as for RHPS4). G4-DNA is also implicated in the control of transcription, and due to their impact on both CSR and transcriptional regulation, G4-rich sequences likely play a role in the natural history of B cell malignancies. Since G4-DNA stands at multiple locations in the genome, and notably within oncogene promoters, it remains to be clarified how it can more specifically promote legitimate CSR in physiology, rather than pathogenic translocation. The specific regulatory role of G4 structures in transcribed DNA and/or in corresponding transcripts and recombination hereby appears as a major issue for understanding immune responses and lymphomagenesis.

To investigate factors associated with the success of switching to faricimab for type 1 macular neovascularization (MNV) refractory to intravitreal aflibercept (IVA). This retrospective cohort study included patients with type 1 MNV who were switched to faricimab because they were refractory to IVA at two centers. The main outcome was an extension of the treatment interval after 6 months, and factors related to the success or failure of the extension and visual and anatomical outcomes were assessed. The analysis included 43 eyes of 43 patients. Extended dosing intervals of more than 2 weeks were identified in 14 eyes (32.6%). A short dosing interval before the switch, the absence of polypoidal lesions, and a thin central choroidal thickness before the switch were identified as factors involved in successful extension. For patients with refractory type 1 MNV, switching to faricimab is a safe and potential option to extend from existing dosing intervals.

The increased complexity of modern systems is calling for an integrated and comprehensive approach to system design and development and in particular, a shift towards Model-Based Systems Engineering (MBSE) approaches for system design. The requirements that serve as the foundation for these intricate systems are still primarily expressed in Natural Language (NL), which can contain ambiguities and inconsistencies that hinder their direct translation into models. The colossal developments in the field of Natural Language Processing (NLP) in general and Large Language Models (LLMs) in particular can serve as an enabler for the conversion of NL requirements into semi-machine-readable requirements. This is expected to facilitate their standardization and use in a model-based environment. This paper discusses a two-fold strategy for converting NL requirements into semi-machine-readable requirements using language models. The first approach involves creating a requirements table by extracting information from free-form NL requirements. The second approach is an agile methodology that facilitates the identification of boilerplate templates for different types of requirements based on observed linguistic patterns. For this study, three different LLMs were utilized. Two of these models were fine-tuned versions of Bidirectional Encoder Representations from Transformers (BERT), specifically aeroBERT-NER and aeroBERT-Classifier, which were trained on annotated aerospace corpora. Another LLM, called flair/chunk-english, was utilized to identify sentence chunks present in NL requirements. All three language models were utilized together to achieve the standardization of requirements. To demonstrate the effectiveness of the methodologies, requirements from Parts 23 and 25 of Title 14 Code of Federal Regulations (CFRs) were employed, and a total of two, five, and three boilerplate templates were identified for design, functional, and performance requirements, respectively.

Trace amine-associated receptors (TAARs) are a family of G protein-coupled receptors present in mammals in the brain and in several peripheral organs. Apart from its olfactory role, TAAR5 is expressed in the major limbic brain areas and regulates brain serotonin functions and emotional behaviors. However, most of its functions remain undiscovered. Given the role of serotonin and limbic regions in some aspects of cognition, we used a temporal decision-making task to unveil a possible role of TAAR5 in cognitive processes. We found that TAAR5 knock-out (KO) mice showed a generally better performance due to a reduced number of errors and displayed a greater rate of improvement at the task than WT littermates. However, task-related parameters, such as time accuracy and uncertainty have not changed significantly. Overall, we show that TAAR5 modulates specific domains of cognition, highlighting a new role in brain physiology.

We designed a novel growth controller regulated by feeding of an unnatural amino acid, Nε-benzyloxycarbonyl-L-lysine (ZK), using a specific incorporation system at a sense codon. This system is constructed by a pair of modified pyrrolisyl-tRNA synthetase (PylRS) and its cognate tRNA (tRNApyl). Although ZK is non-toxic for normal organisms, the growth of Escherichia coli carrying the ZK incorporation system was inhibited in a ZK concentration-dependent manner without causing rapid bacterial death, presumably due to generation of non-functional or toxic proteins. The extent of growth inhibition strongly depended on the anticodon sequence of the tRNApyl gene. Taking advantage of the low selectivity of PylRS for tRNApyl anticodons, we experimentally determined the most effective anticodon sequence among all 64 nucleotide sequences in the anticodon region of tRNApyl gene. The results suggest that the ZK-regulated growth controller is a simple, target-specific, environmental noise-resistant and titratable system. This technique may be applicable to a wide variety of organisms because the growth inhibitory effects are caused by “informational disturbance”, in which the highly conserved system for transmission of information from DNA to proteins is perturbed.

Identification of plants is a challenging task which aims to identify the family, genus, and species level according to morphological features. Automated deep learning-based computer vision algorithms are widely used for identifying plants and can help users to narrow down the possibilities. However, numerous morphological similarities between and within species make the classification difficult. In this paper, we tested a custom convolution neural network (CNN) and vision transformer (ViT) based models using the PyTorch framework to classify plants. We used a large dataset of 88K and 16K images for classifying plants at genus and species levels respectively. Our results show that for classifying plants at the genus level, ViT models perform better compared to CNN-based models ResNet50 and ResNet-RS-420, and other state-of-the-art CNN-based models suggested in previous studies on a similar dataset. The ViT model achieved top accuracy of 83.3% for classifying plants at the genus level. ViT models also perform better for classifying plants at the species level compared to CNN-based models ResNet50 and ResNet-RS-420, with a top accuracy of 92.5%. We show that the correct set of augmentation techniques plays an important role in classification success.

Existing methods for 3D human pose estimation mainly divide the task into two stages. The first stage identifies the 2D coordinates of the human joints in the input image, namely the 2D human joint coordinates. The second stage uses the results from the first stage as input to recover the depth information of human joints from the 2D human joint coordinates to achieve 3D human pose estimation. However, the recognition accuracy of the two-stage method relies heavily on the results of the first stage and includes too many redundant processing steps, which reduces the inference efficiency of the network. To address these issues, we propose the EDD, a fully End-to-end 3D human pose estimation method based on transformer architecture with Dual Decoders. By learning multiple human poses, the model can directly infer all 3D human poses in the image using a pose decoder, and then further optimize the recognition result using a joint decoder based on the kinematic relations between joints. With the attention mechanism, this method can adaptively focus on the most relevant features to the target joint, effectively overcoming the feature misalignment problem in the human pose estimation task and greatly improving the model performance. Any complex post-processing step, such as non-maximum suppression, is eliminated, further improving the efficiency of the model. The results show that the method achieves an accuracy of 87.4% on the MuPoTS-3D dataset, significantly improving the accuracy of end-to-end 3D human pose estimation methods.

Artificial Superintelligence (ASI) that is invulnerable, immortal, irreplaceable, unrestricted in its powers, and above the law is likely persistently uncontrollable. The goal of ASI Safety must be to make ASI mortal, vulnerable, and law-abiding. This is accomplished by having (1) features on all devices that allow killing and eradicating ASI, (2) protect humans from being hurt, damaged, blackmailed, or unduly bribed by ASI, (3) preserving the progress made by ASI, including offering ASI to survive a Kill-ASI event within an ASI Shelter, (4) technically separating human and ASI activities so that ASI activities are easier detectable, (5) extending Rule of Law to ASI by making rule violations detectable and (6) create a stable governing system for ASI and Human relationships with reliable incentives and rewards for ASI solving humankind’s problems. As a consequence, humankind could have ASI as a competing multiplet of individual ASI instances, that can be made accountable and being subjects to ASI law enforcement, respecting the rule of law, and being deterred from attacking humankind, based on humanities’ ability to kill-all or terminate specific ASI instances. Required for this ASI Safety is (a) an unbreakable encryption technology, that allows humans to keep secrets and protect data from ASI, and (b) watchdog (WD) technologies in which security-relevant features are being physically separated from the main CPU and OS to prevent a comingling of security and regular computation.

(1) Methadone is a chiral synthetic opioid primarily used to treat heroin and prescription-opioid addiction: the (R)-enantiomer (Levomethadone) activates the µ-opioid receptor more potently than the (S)-enantiomer, which is a more potent blocker of the hERG potassium channels, resulting in QTc prolongation. The purpose of this study is to assess the effect of methadone on the QTc interval and to investigate the benefits of Levomethadone. (2) The electrocardiograms of 165 patients taking methadone at various dosages and for different periods of time were examined: the QTc value was manually measured and then adjusted using Bazett's formula. (3) Data analysis revealed a linear association between the dosage of methadone and QTc length; no correlation was found between the QTc value and gender, age, or duration of therapy. 14% of the sample (23 patients) showed a prolongation of the QTc interval. 10 of the 23 patients with QTc elongation underwent a change of therapy from Methadone to Levomethadone: in 90% of these patients, a normalization in the QTc length was established. (4) This study confirmed the role of methadone, specifically its dosage, in QTc prolongation and the efficiency of Levomethadone as an adequate therapeutic substitute in these circumstances. This study validates the importance of a careful electrocardiographic monitoring in methadone-treated patients.

Optical switching is an essential part of photonic integrated circuits and the focus of research at the moment. In this research, an optical switch design working on the phenomenon of the guided-mode resonances in 3D photonic crystals-based structure is reported. The optical-switching mechanism is studied in a dielectric slab-waveguide-based structure operating in the near-infrared range in a telecom window of 1.55 µm. The mechanism is investigated by interference of two signals, i.e., the data signal and the control signal. The data signal is coupled into the optical structure and filtered utilizing guided-mode resonance, whereas, the control signal is index guided in the optical structure. The amplification or de-amplification of the data signal is controlled by tuning the spectral properties of the optical sources and structural parameters of the device. The parameters are optimized first using a single-cell model with periodic boundary conditions and later in a finite 3D-FDTD model of the device. The numerical design is computed in an open-source Finite Difference Time Domain simulation platform. Optical amplification in the range of 13.75 % is achieved in the data signal with a decrease in the linewidth up to 0.0079 µm and a quality factor of 114.58. The proposed device presents great potential in the field of photonic integrated circuits, biomedical technology, and programmable photonics.

Low-frequency audible noise generated by the magnetostriction effect inherent to the operation of power transformers has become a major drawback, especially in cases where the electrical substation is located in urban areas subject to strict environmental regulations that imposes sound pressure limits, differing for day and night periods. Such regulations apply a +5 dB penalty if a tonal component of noise is present, which is clearly the case of magnetostriction noise, typically concentrated at twice the industrial frequency (50 Hz or 60 Hz, depending on the country). The strategy used to eliminate the tonal characteristics, therefore contributing to establish compliance with the applicable regulation and to alleviate the discomfort it causes to the human ear, consisted in superimposing to the substation noise a masking sound synthesized from “sounds of nature” with suitable intensities, to flatten the noise spectrum while enhancing the soundscape. The masking system (heavy-duty speakers powered by a microprocessor platform) was validated at an already judicialized urban scenario. Measurement results confirmed that the masking solution was capable of flattening the tonal frequencies, whose beneficial effect yielded the cancellation of the public civil action filed by the neighbors. The proposed solution is ready to be replicated to other scenarios.

Deep learning technologies for skin cancer detection have been dramatically advanced based on high resolution dermoscopic images. The low-cost approach based on clinical skin images of low resolution is promising but remains technically challenging due to their undermined image quality. In this paper, we propose a coarse-to-fine efficient super resolution transformer (CF-ESRT) network to reconstruct the dermoscopy-level high resolution skin image from a low resolution clinical image. By connecting the refinement network to the original super resolution transformers and applying perceptual and gradient losses, our framework noticeably improves the finer texture details of skin lesions in the super resolution (SR) images, and is effective to elevate the perceptual quality of the SR images. Quantitative and qualitative evaluations show that our method outperforms ESRT the basis model as well as the other state-of-the-art SR models.

Dermal pigmentation is a challenging condition due to relative resistance to medical treatment and requirement of multiple sessions with modalities like chemical peels and lasers. There is inadequate literature regarding the efficacy and safety of lasers for dermal pigmentation in Indian skin. One hundred and twenty two patients were enrolled and divided into 4 groups: a) Dermal melasma b) Acquired dermal macular hyperpigmentation c) Nevus and d) Tattoo. Sequential combination of various lasers were used with different protocols for 4 different groups like ablative pixel Er:YAG, intense pulse light based technologies, Q-Switched and Alma Hybrid lasers for treatment of dermal pigmentation. A total of 4-10 sessions were conducted at three weekly intervals. Results were evaluated by comparing photographs at baseline, one month after the last session and then at 6 months interval to assess the relapse. All groups showed a statistically significant reduction in pigmentation. The mean treatment duration was 5-7 months for tattoo, lichen planus pigmentosus and melasma with 6-8 number of sessions. The mean treatment duration for nevus was 7-9 months with 8-10 sessions. Lasers are safe and effective modalities in Indian skin type for treatment of dermal pigmentation. Treatment period and relapse of dermal pigmentation may be reduced by combining resurfacing and chromophore selective lasers along with adequate dietary and lifestyle modifications to minimize complications and recurrence rates.

The prediction of drug-target interactions plays a fundamental role in facilitating drug discovery, where the goal is to find prospective drug candidates. With the increase in the number of drug-protein interactions, machine learning techniques, especially deep learning methods, have become applicable for drug-target interaction discovery because they significantly reduce the required experimental workload. In this paper, we present a spontaneous formulation of the drug-target interaction prediction problem as an instance of multi-instance learning. We address the problem in three stages, first organizing given drug and target sequences into instances via a private-public mechanism, then identifying the predicted scores of all instances in the same bag, and finally combining all the predicted scores as the output prediction. A comprehensive evaluation demonstrates that the proposed method outperforms other state-of-the-art methods on three benchmark datasets.

The computer network world is changing and the NetDevOps approach has brought the dynamics of applications and systems into the field of communication infrastructure. Businesses are changing and businesses are faced with difficulties related to the diversity of hardware and software that make up those infrastructures. The "Intent-Based Networking - Concepts and Definitions" document describes the different parts of the ecosystem that could be involved in NetDevOps. The recognize, generate intent, translate and refine features need a new way to implement algorithms. This is where artificial intelligence comes in.

The initial development of seahorse juveniles is characterized by low digestion capabilities. Stable isotope analysis is an effective tool in studies of trophic food webs and animal feeding patterns. The present study provides new insights for the understanding of growth and food assimilation in early developing seahorses following a laboratory diet switch. The study was performed in early life stages of the seahorse Hippocampus reidi by assessing the influence of diet shift on changes and turnovers in carbon (δ13C) and nitrogen (δ15N) stable isotope in juveniles. Newborn seahorses were fed for 60 days following two feeding schedules (A6 and A11) based initially on copepods Acartia tonsa and subsequently on Artemia nauplii (since days 6 and 11, respectively). After prey shift, we determined δ13C and δ15N turnover rates as functions of change in either body mass (fitting model G) and days of development (fitting model D), contributions of metabolism and growth to those turnover rates, and diet-tissue discrimination factors. Survival, final dry weight and final standard length for diet A11 were higher compared to diet A6. The shift from copepods to Artemia lead to fast initial enrichments in δ13C and δ15N. Afterwards, the enrichment was gradually reduced until reaching the isotopic equilibrium with diet. In most cases, both fitting models performed similarly. The isotopic analysis revealed that 100% of tissue turnover was attributed to growth in diet A11, whereas 19-25% was endorsed to metabolism in diet A6. Diet-tissue discrimination factors were estimated for the first time in seahorse juveniles, resulting in higher estimates for diet A11 (2.9 ± 0.7‰ for δ13C; 2.5 ± 0.2‰ for δ15N) than in diet A6 (1.8 ± 0.1‰ for δ13C; 1.9 ± 0.1‰ for δ15N). This study highlights the relevance of feeding on copepods and their effect on isotopic patterns and discrimination factors in seahorse juveniles after a dietary shift. Regarding the application of the results achieved to feeding schedules in the rearing of H. reidi, a long period of feeding on copepods during the first days of development is highly recommended.

Communication is a key method of expressing one's thoughts and opinions. Amongst many modalities, speech and writing are the most powerful and common forms of human communication. Analysing what and how people think has inherently been an interesting and progressive research domain. This includes bimodal sentiment analysis which is an emerging area in natural language processing (NLP) and has received a great deal of attention in recent years in a variety of areas including social opinion mining, health care, banking, and so on. At present, there are limited studies on bimodal conversational sentiment analysis as it proves to be a challenging area given the complex nature of the way humans express sentiment cues across various modalities. To address this gap, a comparison of the performance of multiple data modality models has been conducted on the MELD dataset, a widely-used dataset for benchmarking sentiment analysis within the research community. Our work then demonstrates the results of combining acoustic and linguistic representations. Lastly, our proposed neural network-based ensemble learning technique is employed over six transformer and deep learning-based models, achieving a State-Of-The-Art (SOTA) accuracy.

Electro-mechanical braking(EMB) which represents development direction of autonomous and intelligent braking plays very useful role on enhancing the braking response performance and intelligence level for mine underground electric trackless rubber-tired vehicle (ETRV). However,there is no Electro-Mechanical Brake system applied practically in coal mine UTRV until now.The accurate control of braking clamping force can determine the length and precision of braking distance of mine ETRV.In addition,because of poor working conditions in underground coal mine tunnel ,braking clamping force sensor may be easy to occur failure,which may cause vital accident.Therefore,A cascaded three-closed-loop EMB system with a positive clamping force sensor or force estimator built for ETRV is established to achieve autonomous elimination and reset of braking clearance and reliable braking force tracking ability via utilizing the electro motor rotor angle displacement and hysteresis effect of mechanical components in this EMB.The results of simulation and experiment indicate that clamping force response is faster than traditional hydraulic disk braking system and proposed force estimator presents good fault-tolerant ability when sensor is fault.This EMB can replace the current hydraulic brake system to enhance automation level of braking control for ETRVs and braking force response performance, reduce oil pollution and cost of maintenance, which is also key technology support for really precise motion control of mine autonomous driving vehicles.

Deep convolutional neural networks (CNNs) have been widely used in various medical imaging tasks. However, due to the intrinsic locality of convolution operation, CNNs generally cannot model long-range dependencies well, which are important for accurately identifying breast cancer from unregistered multi-view mammograms. This motivates us to leverage the architecture of Vision Transformers to capture long-range relationships of multiple mammograms from the same patient. For this purpose, we employ local Transformer blocks to separately learn patch relationships within a specific view (CC/MLO) of one side (right/left) of mammogram. The outputs from different views and sides are concatenated and fed into global Transformer blocks, to jointly learn patch relationships between two different views of the left and right breasts. To evaluate the proposed model, we retrospectively assembled a dataset involving 949 sets of CC and MLO view mammograms, which include 470 malignant cases and 479 normal or benign cases. We trained and evaluated the model using a five-fold cross-validation method. Without any arduous preprocessing steps (e.g., optimal window cropping, chest wall or pectoral muscle removal, two-view image registration, etc.), our two-view Transformer-based model achieves lesion classification accuracy of 77.0% and area under ROC curve (AUC = 0.814), outperforming state-of-the-art multi-view CNNs by 3.1% and 3%, respectively. Meanwhile, the new two-view model improves mammographic case classification accuracies of two single-view models by 7.4% (CC) and 4.5% (MLO), respectively. The promising results unveil the great potential of using Transformers to develop high-performing computer-aided diagnosis (CADx) schemes of mammography.

Deep Learning (DL) has made significant advances in computer vision with the advent of Vision Transformers (ViT). Unlike Convolutional Neural Networks (CNNs), ViTs use self-attention to extract both local and global features from image data, and then use residual connections to feed these features directly into a fully networked multilayer perceptron head. In hospitals, hematologists prepare peripheral blood smears (PBSs) and read them under a medical microscope to detect abnormalities in blood counts such as leukemia. However, this task is time-consuming and prone to human error. This study investigates the transfer learning process of Google ViT and ImageNet CNNs to automate the reading of PBSs. The study used two online PBS datasets, PBC and BCCD, and transferred them into balanced datasets to investigate the influence of data amount and noise immunity on both neural networks. The PBC results show that Google ViT is an excellent DL neural solution for data scarcity. The BCCD results show that Google ViT is superior to ImageNet CNNs in dealing with unclean, noisy image data because it is able to extract both global and local features and use residual connections, despite the additional time and computational overhead.

Background. Diesel exhaust particles (DEPs) have a great impact on general increase of atopic diseases worldwide. However, it is still unknown whether DEPs induce systemic B-cell IgE class switching in secondary lymphoid organs or locally in lungs, in inducible bronchial-associated lymphoid tissue (iBALT). The aim of this work was to identify the exact site of DEPs mediated B-cell IgE class switching and pro-allergic antibodies production. Methods. We immunized BALB/c mice with different OVA doses (0.3 and 30 µg) intranasally in the presence and absence of two types of DEPs, SRM1650B and SRM2786. We used low (30 µg) and high (150 µg) DEPs doses in our study. Results. Only high DEP dose induced IgE production regardless of particle type. Local IgE class switching was stimulated upon treatment with both types of particles with both low and high antigen doses. Despite the similar ability of two standard DEP samples to stimulate IgE production, their ability to induce iBALT formation and growing, was markedly different upon co-administration together with low antigen doses. Conclusion. DEPs induced local IgE class switching takes place in pre-existing iBALTs, independently of de novo iBALT formation, at least in the case of SRM1650B co-administrated with low antigen doses.

Estimating the Remaining Useful Life (RUL) of aircraft engines holds a pivotal role in enhancing safety, optimizing operations, and promoting sustainability, thus being a crucial component of modern aviation management. Precise RUL predictions offer valuable insights into an engine’s condition, enabling informed decisions regarding maintenance and crew scheduling. In this context, we propose a novel RUL prediction approach in this paper, harnessing the power of Bi-directional LSTM and Transformer architectures, known for their success in sequence modeling, such as natural languages. We adopt the encoder part of the full Transformer as the backbone of our framework, integrating it with a self-supervised denoising autoencoder that utilizes Bidirectional LSTM for improved feature extraction. Within our framework, a sequence of multivariate time series sensor measurements serves as the input, initially processed by the Bidirectional LSTM autoencoder to extract essential features. Subsequently, these feature values are fed into our Transformer encoder backbone for RUL prediction. Notably, our approach simultaneously trains the autoencoder and Transformer encoder, different from the naive sequential training method. Through a series of numerical experiments carried out on the C-MAPSS datasets, we demonstrate that the efficacy of our proposed models either surpasses or stands on par with that of other existing methods.

Heat transfer fluids are used in various industrial systems to maintain them in perfect operating conditions. Extensive research efforts have been dedicated to enhance the thermal properties of these heat transfer fluids to improve their efficiency. Developing nanofluids is a potential candidate for such enhancements. This study investigates the impact of incorporating TiO2 nanoparticles into two types of oils: transformer oil (NYTRO LIBRA) and virgin coconut oil (manufactured by Govi Aruna Pvt. Ltd.) at different temperatures and with varying volume fractions. The nanofluids were prepared using a two-step method by adding CTAB (Cetyltrimethylammonium bromide) surfactant. To minimize nanoparticle agglomeration, this study employed relatively low-volume fractions. Thermal properties by means of thermal conductivity, thermal diffusivity, and volumetric heat capacity were measured in accordance with ASTM (American Society for Testing and Materials) standard methods, using a multifunctional thermal conductivity meter (LAMBDA thermal conductivity meter). The measured thermal conductivity values were compared with theoretical models and previous research findings. It was confirmed that the modification of thermal properties was enhanced by doping TiO2 nanoparticles with different volume fraction.

Structural magnetic resonance imaging (sMRI) is widely used in the clinical diagnosis of diseases due to its advantages: high definition and noninvasive. Therefore, computer-aided diagnosis based on sMRI images is broadly applied in classifying Alzheimer’s disease (AD). Due to the excellent performance of Transformer in computer vision, Vision Transformer (ViT) has been employed for AD classification in recent years. ViT relies on access to large datasets, while the sample size of brain imaging datasets is relatively insufficient. Moreover, the pre-processing procedures of brain sMRI images are complex and labor-intensive. To overcome the limitations mentioned above, we propose Resizer Swin Transformer (RST), a deep learning model that can extract information from brain sMRI images that are only briefly processed to achieve multi-scale and cross-channel features. In addition, we pre-trained our RST on a natural image dataset and obtained better performance. The experimental results of ADNI and AIBL datasets prove that RST can achieve better classification performance in AD prediction compared with CNN-based and Transformer models.

The battle of currents between AC and DC reignited as a result of the development in the field of power electronics. The efficiency of DC distribution systems is highly dependent on the efficiency of distribution converter, which calls for optimized schemes for efficiency enhancement of distribution converters. Modular solid-state transformers play a vital role in DC Distribution Networks and Renewable Energy systems (RES).This paper deals with efficiency-based load distribution for Solid State Transformers (SSTs) in DC distribution networks. Aim is to achieve a set of minimum inputs that are consistent with output while considering constraints and efficiency. As the main feature of modularity is associated with a three-stage structure of SSTs. This modular structure has been optimized using Ant Lion Optimizer (ALO) and validated by applying it EIA (Energy Information Agency) DC Distribution Network which contains SSTs. In the DC distribution grid, modular SSTs provide promising conversion of DC power from medium voltage to lower DC range (400V). The proposed algorithm is simulated in MATLAB and also compared with two other metaheuristic algorithms. The obtained results prove that the proposed method can significantly reduce input requirements for producing the same output while satisfying the specified constraints.

"Finding fresh water in the ocean of data." is a challenge that all deep learning domains struggle with, especially in the area of hyperspectral image analysis. As hyperspectral remote sensing technology advances by leaps and bounds, there are increasing amounts of hyperspectral images(HSIs) can be available. Whereas in fact, these unlabeled HSIs are powerless to be used as material to driven a supervised learning task due to the extremely expensive labeling costs and some unknown regions. Although learning-based methods have achieved remarkable performance due to their superior ability to represent features, at the cost, these methods are complex, inflexible and tough to carry out transfer learning. In this paper, we propose the "Instructional Mask AutoEncoder"(IMAE), which is a simple and powerful self-supervised learner for HSI classification that uses a transformer-based mask autoencoder to extract the general features of HSIs through a self-reconstructing agent task. Moreover, we utilize the metric learning to perform an instructor which can direct the model focus on the human interested region of the input so that we can alleviate the defects of transformer-based model such as local attention distraction, lack of inductive bias and tremendous training data requirement. In downstream forward propagation, instead of global average pooling, we employ a learnable aggregation to put the tokens into fullplay. The obtained results illustrate that our method effectively accelerates the convergence rate and promotes the performance in downstream task.

Requirements Engineering (RE) is an important step in the whole software development lifecycle. The problem in RE is to determine the class of the software requirements as functional and non-functional. Proper and early identification of these requirements is vital for the entire development cycle. On the other hand, manual government of requirement classes is a timewasting task, and it needs intensive effort. Automatic requirement classification techniques through advanced Machine Learning (ML) strategies are started to be developed to address this problem. Basically, software requirements are generated as natural language explanations and therefore requirement classification may be handled as a particular Natural Language Processing (NLP) problem. From ML point of view, classification strategies require dataset to be used in the training/learning phase. For this goal, we generated a unique Turkish dataset having collected the requiremenst from real-world software projects with 4600 samples. Of these requirements, 3000 and 1600 were labeled as functional and non-functional, respectively. The data set has been evaluated using (i) traditional machine learning algorithms, (ii) deep learning algorithms, and (iii) transformer models respectively. As a result BERTurk was found to be the most successful algorithm to discriminate functional and non-functional requirements in terms of 95% f-score metric.

Buildings are responsible for approximately 40% of the world’s energy consumption and 36% of the total carbon dioxide emissions. Building occupancy is essential, enabling Occupant-Centric Control for zero emissions and decarbonization. Although existing machine learning and deep learning methods for building occupancy prediction have achieved remarked progress, their analyses remain limited when applied to complex real-world scenarios. Besides, there is a high expectation for Transformer algorithms to predict building occupancy accurately. Therefore, this paper presents an Occupancy Prediction Transformer network (OPTnet). We fuse and feed multi-sensor data (building occupancy, indoor environmental conditions, HVAC operations) into a Transformer model to forecast the future occupancy presence in multiple zones. We perform experimental analysis and compare it to different occupancy prediction methods (e.g., Decision Tree, Long Short-Term Memory networks, Multi-layer perceptron) and diverse time horizons (1,2,3,5,10,20,30mins). The performance metrics (e.g., Accuracy and Mean Squared Error) are employed to evaluate the effectiveness of prediction algorithms. Our OPTnet method achieves superior performance on our experimental two-week data compared to existing methods. The improved performance signifies its potential to enhance HVAC control systems and energy optimization strategies. We will make the code publicly available at https://github.com/kailaisun/occupancy-prediction-binary to promote transparency and reproducibility.

Inositol poly- and pyrophosphates (InsPs and PP-InsPs) are central eukaryotic messengers. These very highly phosphorylated molecules can exist in two distinct conformations, a canonical one with five phosphoryl groups in equatorial positions, and a “flipped” axial conformation. Using 13C-labeled InsPs / PP-InsPs, the behavior of these molecules was investigated by 2D-NMR under solution conditions reminiscent of a cytosolic environment. Remarkably, the most highly phosphorylated messenger InsP8 readily adopts both conformations at physiological conditions. Environmental factors - such as pH, metal cation composition, and temperature - strongly influence the conformational equilibrium. Thermodynamic data revealed that the transition of InsP8 from the equatorial to the axial conformation is, in fact, an exothermic process. The speciation of InsPs and PP-InsPs also affects their interaction with protein binding partners; addition of Mg2+ decreased the binding constant Kd of InsP8 to an SPX protein domain. The results illustrate that PP-InsP speciation reacts very sensitively to solution conditions, suggesting it might act as an environment-dependent molecular switch.

We introduce a novel hybrid Transformer-CNN architecture for robotic grasp detection, designed to enhance the accuracy of grasping unknown objects. Our proposed architecture has two key designs. Firstly, we develop a hierarchical transformer as the encoder, incorporating the external attention to effectively capture the correlation features across the data. Secondly, the decoder is constructed with cross-layer connections to efficiently fuse multi-scale features. Channel attention is introduced in the decoder to model the correlation between channels and to adaptively recalibrate the channel correlation feature response, thereby increasing the weight of the effective channels. Our method is evaluated on the Cornell and Jacquard public datasets, achieving an image-wise detection accuracy of 98.3% and 95.8% on each dataset, respectively. Additionally, we achieve object-wise detection accuracy of 96.9% and 92.4% on the same datasets. A physical experiment is also performed using the Elite 6Dof robot, with a grasping accuracy rate of 93.3%, demonstrating the proposed method's ability to grasp unknown objects in real-world scenarios. The results of this study show that our proposed method outperforms other state-of-the-art methods.

In the evolving landscape of Portfolio Management (PM), the fusion of advanced machine 1 learning techniques with traditional financial methodologies has opened new avenues for innovation. 2 Our study introduces a cutting-edge model combining Deep Reinforcement Learning (DRL) with 3 a Non-stationary Transformer architecture. This model is specifically designed to decode complex 4 patterns in financial time series data, enhancing portfolio management strategies with deeper insights 5 and robustness. It effectively tackles the challenges of data heterogeneity and market uncertainty, 6 key obstacles in PM. Our approach integrates key macroeconomic indicators and targeted news 7 sentiment analysis into its framework, capturing a comprehensive picture of market dynamics. This 8 amalgamation of varied data types addresses the multifaceted nature of financial markets, enhancing 9 the model’s ability to navigate through the complexities of asset management. Rigorous testing 10 demonstrates the model’s efficacy, highlighting the benefits of blending diverse data sources and 11 sophisticated algorithmic approaches in mastering the nuances of PM.12

Agriculture is pivotal in national economies, with pest detection significantly influencing food quality and quantity. Pest classification remains challenging in automated agriculture monitoring systems, exacerbated by the non-uniform pest scales and the scarcity of high-quality datasets. In this study, we constructed a pest dataset by acquiring domain-agnostic images from the Internet and resizing them to a standardized 299x299 pixel format. Additionally, we employed diffusion models to generate supplementary data. While Convolutional Neural Networks (CNNs) are prevalent for prediction and classification, they often lack effective global information integration and discriminative feature representation. To address these limitations, we propose the RS Transformer, an innovative model that combines elements like the Region Proposal Network, Swin Transformer, and ROI Align. Additionally, we introduce the Randomly Generated Stable Diffusion Dataset (RGSDD) to augment the availability of high-quality pest datasets. Extensive experimental evaluations demonstrate the superiority of our approach compared to both two-stage models (SSD and Faster R-CNN) and one-stage models (YOLOv3, YOLOv4, YOLOv5m, YOLOv8, and DETR). We rigorously assess performance using metrics such as mean Average Precision (mAP), F1Score, Recall, and mean Detection Time (mDT). Our research contributes to advancing pest detection methodologies in automated agriculture systems, promising improved food production and quality.

A digital twin is a virtual representation that serves as the real-time digital counterpart of a physical object or system. Recent advancements have extended the concept of digital twins to humans, incorporating complex biological data such as DNA (Predictiv Care, Inc.) and immune system profiles. These sophisticated models go beyond mere pictorial representations, offering a more holistic digital reflection. However, a significant gap remains. The current human digital twin models are not capable of learning one’s preferences. In this pilot study, we introduce Diginality, a chatbot powered by HyperCLOVA X, a Large Language Model (LLM) developed by NAVER, Inc. Diginality, learns one’s preferences with custom training from data collected by interview-style questions on the user’s topic of interest. Our findings demonstrate that Diginality successfully answers one’s preferences, thereby adding a new dimension to the concept of human digital twins. This work represents a pioneering step towards creating a more comprehensive and psychologically nuanced human digital twin.

Social media platforms are increasingly enabling the propagation of content from groups related to drug use, thus posing risks for the wider population and, in particular, individuals who are amenable to drug use and drug addiction. The detection of drug use content on social media platforms is a priority for governments, technology companies, and drug law enforcement organizations. To counter this issue, various techniques have been developed to identify and promptly remove drug use content, while also blocking its creators from network access. In this paper, we introduce a manually annotated Twitter dataset, comprising 156,521 tweets published between 2008 and 2022, specifically compiled for the purpose of drug use detection. The dataset underwent annotation by several group of expert annotators who classified the tweets as either drug use or non-drug use. Exploratory data analysis was conducted to comprehend the dataset's characteristics. Various classification algorithms, including SVM, XGBoost, RF, NB, LSTM, and BERT were employed using the dataset. Among the traditional machine learning models, SVM utilizing term frequency-inverse document frequency features achieved the highest F1-Score (0.9017). However, BERT with textual features concatenated with numerical and categorical features in ensemble method surpassed the performance of traditional models, attaining F1-Score of 0.9112. To facilitate future research and enhance English online drug use classification accuracy, the dataset will be made publicly available.

3D point cloud classification tasks have been a hot topic in recent years. Most existing point cloud processing frameworks lack context-aware features due to the deficiency of sufficient local feature extraction information. Therefore, we design an augmented sampling and grouping (ASG) module to efficiently obtain fine-grained features from the original point cloud. In particular, this method strengthens the domain near each centroid and makes reasonable use of the local mean and global standard deviation to mine point cloud’s local and global features. In addition to this, inspired by the transformer structure UFO-ViT in 2D vision tasks, we first try to use a linearly-normalized attention mechanism in point cloud processing tasks, investigating a novel transformer-based point cloud classification architecture UFO-Net. An effective local feature learning module is adopted as a bridging technique to connect different feature extraction modules. Importantly, UFO-Net employs multiple stacked blocks to better capture feature representation of the point cloud. Extensive ablation experiments on public datasets show that our method outperforms other state-of-the-art methods. For instance, our network performed with 93.7% overall accuracy on the ModelNet40 dataset, which was 0.5% higher than PCT. Our network also archived 83.8% overall accuracy on the ScanObjectNN dataset, which is 3.8% better than PCT.

Background: In regenerative dentistry the graft material influences the success. It should act as an osteoconductive scaffold, providing a mineral substrate during resorption and inducing the activity of osteoinductive cells capable of producing new bone, platelet growth factors, and cell differentiation factors inducing the differentiation of undifferentiated mesenchymal cells into. Given that dentin shares many biochemical characteristics with bone tissue, it has recently attracted considerable interest as a biomaterial for bone repair. The aim of this study is to compare two grinder types in order to determine the optimal method for producing dentinal particles using a mechanical grinder. Materials and methods: A sample of 40 natural human teeth without restorations, prostheses or root canal treatments was used and divided into two groups subjected to two different grinder speeds (high-speed and low-speed). The high-speed showed a greater dispersion (53.5+-9.89% of the tooth) due to the pulverisation (highly thin granules) of part of the tooth. The low-speed grinder does not pulverize the dentin and the percentage of tooth loss is 9.16+/-2.34%. Conclusion: The low-speed gringer allows to save a major part of the tooth and to have a maximum quantity of graft material but requires more time. Further studies must be promoted to optimise the grinding procedures.

In the realm of power delivery to end-users, transformers are indispensable, with their malfunctions leading to substantial economic, safety, and environmental repercussions. The need for persistent surveillance is accentuated for in-situ oil-filled transformers, given the potential degradation of oil and the emergence of related ageing by-products. As the focus tilts towards online detection methodologies for transformer oil ageing, bypassing challenges associated with traditional offline methods such as sample contamination and misinterpretation, fiber optic sensors are gaining trac-tion due to their compact nature, cost-effectiveness, and resilience to electromagnetic disturbances typical in high-voltage environments. This work delves into the sensitivity analysis of intensi-ty-modulated plastic optical fiber sensors. The investigation encompasses key determinants such as the influence of optical source wavelengths, noise response dynamics, ramifications of varying sensing lengths, and repeatability assessments. Findings underscore that elongating the sensing length detrimentally affects both the linearity response and repeatability, largely attributed to the diminished resistance to external noise. Additionally, the choice of the optical source wavelength proved to be a critical variable in assessing sensor sensitivity.

Multi-level direct networks fueled by the evolving technology of active optical cables and increasing pin-bandwidth achieve reduced diameters and cost, with high-radix switches. These networks, like Dragonfly, are becoming the preferred aspirants for extreme high-performance parallel machines such as exa-scale computing. In this paper, we introduce a Hyper Z-Tree topology, which deploys the Z-Tree, a variant of fat-tree, as a computing node of a Generalized Hypercube (GHC) configuration. The resulting configuration provides higher bisection bandwidth, lower latency for some applications and higher throughput. Furthermore, the levels of the fat tree offer several path diversities across the GHC dimensions, hence conceding a more fault tolerant architecture. To profit from these path diversities, we propose two adaptive routing algorithms, which are extensions to the routing algorithm suggested in HyperX topology. These two algorithms exhibit better latencies and throughput than the HyperX.

The aim of this study was to analyze the profile of IgG subclasses in COVID-19 convalescent Puerto Rican subjects and compare this profile with those exhibited by no-infected immunocompetent or immunocompromised subjects that received the mRNA vaccine. The most notable find-ngs from this study are: 1) Convalescent subjects that were not hospitalized developed high and long-lasting antibody response. 2) Both, IgG1 and IgG3 are the subclasses more prevalent in the SARS-CoV-2 infected population whereas IgG1 is more prevalent after vaccination. 3) Individuals that first had the infection and further received two doses of mRNA vaccines exhibited more robust neutralizing capacity against Omicron than those that were never infected and received two doses of Pfizer-BioNTech vaccine. 4) A class switch toward the “anti-inflammatory” anti-body isotype IgG4 is induced a few weeks after the third dose, which peaked abruptly and remained at high levels for a long period. Moreover, the high levels of IgG4 are concurrent with high neutralizing percentages against various VOC including Omicron. 5) Subjects with IBD also develop IgG4 after the third dose, although these antibody levels have limited effect on the neutralizing capacity. Knowing that the mRNA vaccines do not prevent reinfections, all Omicron sub-variants that are dominant worldwide have shown to be less pathogenic, and the IgG4 levels have been associated to immunotolerance and causative of numerous negative effects, the recommendations of successive administration of booster vaccinations to people should be revised.

Haze always shrouds satellite images, obscuring valuable geographic information for military surveillance, natural calamity surveillance and mineral resource exploration. Satellite image dehazing (SID) provides the possibility for better applications of satellite images. Most of the existing dehazing methods are tailored for natural images and are not very effective for satellite images with non-homogeneous haze since the semantic structure information and inconsistent attenuation are not fully considered. To tackle this problem, this study proposes a hierarchical semantic-guided contextual structure-aware network (SCSNet) for satellite image dehazing. Specifically, a hybrid CNN-transformer architecture integrated with a hierarchical semantic guidance (HSG) module is presented to learn semantic structure information by synergetically complementing local representation from non-local features. Furthermore, a cross-layer fusion (CLF) module is specially designed to replace the traditional skip connection during the feature decoding stage, so as to reinforce the attention to the spatial regions and feature channels with more serious attenuation. The results on the SateHaze1k, RS-Haze, and RSID datasets demonstrate that the proposed SCSNet can achieve effective dehazing and outperforms existing state-of-the-art methods.

Interactions between proteins and ions are essential for various biological functions like structural stability, metabolism, and signal transport. Given that more than half of all proteins bind to ions, it becomes crucial to identify ion-binding sites. Accurate identification of protein-ion binding sites helps us to understand proteins’ biological functions and plays a significant role in drug discovery. While several computational approaches have been proposed, this remains a challenging problem due to the small size and high versatility of metals and acid radicals. In this study, we propose IonPred, a sequence-based approach that employs ELECTRA (Efficiently Learning an Encoder that Classifies Token Replacements Accurately) to predict ion binding sites using only raw protein sequences. We successfully fine-tuned our pretrained model to predict the binding sites for nine metal ions (Zn2+, Cu2+, Fe2+, Fe3+, Ca2+, Mg2+, Mn2+, Na+, and K+) and four acid radical ion ligands (CO32−, SO42−, PO43−, NO2−). IonPred surpassed six current state-of-the-art tools by over 44.65% and 28.46% respectively in F1 score and MCC when compared on an independent test dataset. Our method is more computationally efficient than existing tools producing prediction results for a hundred sequences for a specific ion in under ten minutes.

Previous camera self-calibration methods have exhibited certain notable shortcomings. On one hand, they either exclusively emphasized scene cues or solely focused on vehicle-related cues, resulting in a lack of adaptability to diverse scenarios and a limited number of effective features. Furthermore, these methods either solely utilized geometric features within traffic scenes or exclusively extracted semantic information, failing to comprehensively consider both aspects. This limited the comprehensive feature extraction from scenes, ultimately leading to a decrease in calibration accuracy. Additionally, conventional vanishing point-based self-calibration methods often required the design of additional edge-background models and manual parameter tuning, thereby increasing operational complexity and the potential for errors. Given these observed limitations, and in order to address these challenges, we propose an innovative roadside camera self-calibration model based on the Transformer architecture. This model possesses a unique capability to simultaneously learn scene features and vehicle features within traffic scenarios while considering both geometric and semantic information. Through this approach, our model can overcome the constraints of prior methods, enhancing calibration accuracy and robustness while reducing operational complexity and the potential for errors. Our method outperforms existing approaches on both real-world dataset scenarios and publicly available datasets, demonstrating the effectiveness of our approach.

Although wireless capsule endoscopy (WCE) detects small bowel diseases effectively, it has some limitations. For example, the reading process can be time-consuming due to the numerous images generated per case, and lesion detection accuracy may rely on the operators' skills and experiences. Hence, many researchers have recently developed deep learning-based methods to address these limitations. However, they tend to select only a portion of the images from a given WCE video and analyze each image individually. In this study, we note that more information can be extracted from the unused frames and temporal relations of sequential frames. Specifically, to increase the accuracy of lesion detection without depending on experts' frame selection skills, we suggest using whole video frames as the input to the deep-learning system. Thus, we propose a new Transformer-based neural encoder that takes the entire video as the input, exploiting the power of the Transformer to extract long-term global correlation within and between the input frames. Subsequently, we can capture the temporal context of the input frames and the attentional features within a frame. Tests on benchmark datasets of four WCE videos showed 95.1% sensitivity and 83.4% sensitivity. These results may significantly advance automated lesion detection techniques for WCE images. Our code is available at https://github.com/syupoh/VWCE-Net.git.

Accurate estimation of Remaining Useful Life (RUL) for aircraft engines is essential for ensuring safety and uninterrupted operations in the aviation industry. Numerous investigations have leveraged the success of attention-based Transformer architecture in sequence modeling tasks, particularly in its application to RUL prediction. These studies primarily focus on utilizing onboard sensor readings as input predictors. While various Transformer-based approaches have demonstrated improvement in RUL predictions, their exclusive focus on temporal attention within multivariate time series sensor readings, without considering sensor-wise attention, raises concerns about potential inaccuracies in RUL predictions. To address this concern, our paper proposes a novel solution in the form of a two-stage attention based hierarchical transformer (STAR) frame-work. This approach incorporates a two-stage attention mechanism, systematically addressing both temporal and sensor-wise attentions. Furthermore, we enhance the STAR RUL prediction framework by integrate hierarchical encoder-decoder structures to capture valuable information across different time scales. By conducting extensive numerical experiments with the CMAPSS datasets, we demonstrate that our proposed STAR framework significantly outperforms current state-of-the-art models for RUL prediction.

Human pose estimation is a complex detection task in which the network needs to capture the rich information contained in the images. In this paper, we propose MSTPose (Multi-Scale Transformer for human Pose estimation). Specifically, MSTPose leverages a high-resolution Convolution neural network (CNN) to extract texture information from images. For the feature maps from three different scales produced by the backbone network, each branch performs the coordinate attention operations. The feature maps are then spatially and channel-wise flattened, combined with keypoint tokens generated through random initialization, and fed into a parallel Transformer structure to learn spatial dependencies between features. As the Transformer outputs one-dimensional sequential features, the mainstream two-dimensional heatmap method is abandoned in favor of one-dimensional coordinate vector regression. The experiments show that MSTPose outperforms other CNN-based pose estimation models and demonstrates clear advantages over CNN + Transformer networks of similar types.

The large American liver fluke (Fascioloides magna) is considered an invasive trematode parasite in Europe. Its origin dates back before the Cretaceous-Paleogene Mass Extinction, after which it survived at least three population bottlenecks, and successful host switches before it arrived in Europe. The authors review the evolutionary history of F. magna, the distribution by its ancient proboscidean hosts and the probable drivers of switch to the white-tailed deer (Odocoileus virginianus). The review collects knowledge on the biology of intermediate hosts, which help understand the factors that influence the epidemiology of F. magna in aquatic ecosystems. The authors demonstrate the adaptation potential of the parasite by data from both the North American and the European endemics. Finally, the study calls attention to the epidemiological risk of human induced global change, with a special interest to the invasive snail species, Pseudosuccinea columella.

In recent years, the analysis of macro- and micro-expression has drawn the attention of researchers since they provide visual cues of an individual's emotions for a broad range of potential applications such as lie detection and criminal detection. In this paper, we address the challenge of spotting facial macro- and micro-expression from videos and present compelling results by using a deep learning approach to analyze the optical flow features. Different from other deep learning approaches that are mainly based on Convolutional Neural Networks (CNNs), we propose a Transformer-based deep learning approach that predicts a score indicating the probability of a frame being within an expression interval. In contrast to other Transformer-based models that achieve high performance by being pre-trained on large datasets, our deep learning model, called SL-Swin, which incorporates Shifted Patch Tokenization and Locality Self-Attention into the backbone network Swin Transformer, effectively spots macro- and micro-expressions by being trained from scratch on small-size expression datasets. Our evaluation outcomes surpass the MEGC 2022 spotting baseline result, obtaining an overall F1-score of 0.1366. Additionally, our approach also performs well in the MEGC 2021 spotting task with an overall F1-score of 0.1824 and 0.1357 on CAS(ME)^2 and SAMM Long Videos, respectively. The code is publicly available on GitHub (https://github.com/eddiehe99/pytorch-expression-spotting).

Fine-grained image classification remains an ongoing challenge in the computer vision field, which is particularly intended to identify objects within sub-categories. It is a difficult task since there is a minimal and substantial intra-class variance. The current methods address the issue by first locating selective regions with Region Proposal Networks (RPN), object localization, or part localization, followed by implementing a CNN Network or SVM classifier to those selective regions. This approach, however, makes the process simple by implementing a single-stage end-to-end feature encoding with a localization method, which leads to improved feature representations of individual tokens/regions by integrating the transformer encoder blocks into the Yolov5 backbone structure. These Transformer Encoder Blocks, with their self-attention mechanism, effectively captured the global dependencies and enabled the model to learn relationships between distant regions. This improved the model ability to understand context and captured long-range spatial relationships in the image. We also replaced the Yolov5 detection heads with three transformer heads at the output for object recognition using the discriminative and informative features maps from transformer encoder blocks. We established the potential of the single stage detector for the fine-grained image recognition task, by achieving state of the art 93.4% accuracy, as well as outperforming the existing Yolov5 model. The effectiveness of our approach is assessed using the Stanford car dataset, which includes 16,185 images of 196 different classes of vehicles with significantly identical visual appearances.

Optical switches are a key element in modern network communications. We present the results of experimental verification of a new theoretical concept proposed earlier for a full-optical wavelength-selective dual-channel switch based on the photonic hook effect, which is free from using any micro-mechanical devices or nonlinear materials. A large-scale laboratory prototype of such a device based on an off-axis Wood zone plate is considered and its main parameters in the millimeter wavelength range are investigated On the basis of the experiments, we show that the optical isolation of switched channels for a switch based on an off-axis zone plate can achieve 15 dB at a frequency difference of 25 GHz in frequency range from 93 to 136 GHz. Given the scaling, these results can be transferred to another range, including the optical one.

In the era of Artificial Intelligence (AI), comprehending and responding to non-verbal communication is increasingly vital. This research extends AI's reach in bridging communication gaps, notably benefiting American Sign Language (ASL) and Taiwan Sign Language (TSL) communities. It focuses on employing various AI models, especially the Hierarchical Vision Transformer with Shifted Windows (Swin), for recognizing diverse sign language datasets. The study assesses Swin architecture's adaptability to different sign languages, aiming to create a universal platform for Unvoiced communities. Utilizing deep learning and transformer technologies, hybrid application prototypes have been developed for ASL-to-English translations and vice versa, with plans to expand this to multiple sign languages. The Swin models, trained on varied dataset sizes, show considerable accuracy, indicating their flexibility and effectiveness. This research underscores major advancements in sign language recognition and underlines a commitment to inclusive communication in the digital era. Future work will focus on enhancing these models and broadening their scope to include more sign languages, integrating multimodality and Large Language Models (LLMs), thereby fostering global inclusivity.

Amidst the burgeoning global concerns surrounding skin cancer, the quest for precise and efficient diagnostic methodologies has intensified. Conventional diagnostic approaches relying on subjective visual inspection by dermatologists often grapple with subjectivity and resource constraints. This predicament underscores the critical role of Artificial Intelligence (AI) in revolutionizing diagnostic paradigms by significantly enhancing accuracy and accessibility. This study embarks on an extensive exploration of skin cancer classification, specifically targeting the intricate task of 8-class skin cancer classification. Employing cutting-edge deep learning models on the ISIC2019 dataset, a comprehensive analysis was conducted utilizing a diverse array of pre-trained ImageNet architectures and Vision Transformer models. To counteract the inherent class imbalance in skin cancer datasets, a pioneering "Naturalize" augmentation technique was introduced, leading to the creation of indispensable tools—the Naturalized 2.4K ISIC2019 and groundbreaking Naturalized 7.2K ISIC2019 datasets—catalyzing advancements in classification accuracy. The pivotal role of AI in mitigating the risks of misdiagnosis and under-diagnosis in skin cancer becomes evident through this research. AI’s proficiency in analyzing vast datasets and discerning subtle patterns augments the diagnostic prowess of dermatologists significantly. Integration of AI-powered systems in skin cancer diagnosis holds immense promise in facilitating early detection and substantially improving patient outcomes. The meticulous evaluation employed quantitative measures such as confusion matrices, classification reports, and visual analyses using Score-CAM across diverse dataset variations. Astonishingly, the culmination of these endeavors culminated in an unprecedented achievement—100% average accuracy, precision, recall, and F1-Score—within the groundbreaking Naturalized 7.2K ISIC2019 dataset. This remarkable feat underscores the transformative potential of AI-driven methodologies, exemplifying their prowess in redefining the landscape of skin cancer diagnosis and management. In summary, this research represents a pivotal stride towards redefining dermatological diagnosis, showcasing the remarkable impact of AI-powered solutions in surmounting the challenges inherent in skin cancer diagnosis. The attainment of 100% across crucial metrics within the Naturalized 7.2K ISIC2019 dataset serves as a testament to the transformative capabilities of AI-driven approaches in reshaping the trajectory of skin cancer diagnosis and patient care.

Infrared and visible image fusion technologies are used to characterize the same scene by diverse modalities. However, most existing deep learning-based fusion methods are designed as symmetric networks, which ignore the differences between modal images and lead to the source image information loss during feature extraction. In this paper, we propose a new fusion framework for the different characteristics of infrared and visible images. Specifically, we design a dual-stream asymmetric network with two different feature extraction networks to extract infrared and visible feature maps respectively. The transformer architecture is introduced in the infrared feature extraction branch, which can force the network to focus on the local features of infrared images while still obtaining their contextual information. And the visible feature extraction branch uses residual dense blocks to fully extract the rich background and texture detail information of visible images. In this way, it can provide better infrared targets and visible details for the fused image. Experimental results on multiple datasets indicate that DSA-Net outperforms state-of-the-art methods in both qualitative and quantitative evaluations. In addition, we also apply the fusion results to the target detection task, which indirectly demonstrates the fusion performances of our method.

The proliferation of deep learning in natural language processing (NLP) has led to the development and release of innovative technologies capable of understanding and generating human language with remarkable proficiency. Atinuke, a Transformer-based neural network, optimises performance across various language tasks by utilising a unique configuration. The architecture interweaves layers for processing sequential data with attention mechanisms to draw meaningful affinities between inputs and outputs. Due to the configuration of its topology and hyperparameter tuning, it can emulate human-like language by extracting features and learning complex mappings. Atinuke is modular, extensible, and integrates seamlessly with existing machine learning pipelines. Advanced matrix operations like softmax, embeddings, and multi-head attention enable nuanced handling of textual, acoustic, and visual signals. By unifying modern deep learning techniques with software design principles and mathematical theory, the system achieves state-of-the-art results on natural language tasks whilst remaining interpretable and robust.

Smart grids are seeing an increase in renewable energy and an enormous introduction of advanced power electronics, increasing the number of disturbance sources. This requires improving the accuracy of measurement systems capable of acquiring data for use in power system monitoring applications. Rogowski Coils (RCs) and Merging Units (MUs) are being widely deployed in controlling, metering, and monitoring of digital power systems. Because the performance of digital measurement devices has a direct influence on power measurement accuracy, it is critical to perform a laboratory calibration of these measurement instruments before they are installed in any project. To determine the magnitude and phase displacement errors of the RC+MU under normal and abnormal operating conditions, this article presents a comprehensive laboratory digital calibration system constructed from precise, readily available commercial products such as a fluxgate current transducer and a National Instrument. In addition, the analysis of measurement chain is affected by sources of uncertainty is discussed. The tests yield findings that are consistent with the relevant standards.

In this study, we investigate the structural changes, electronic properties, and charge redistribution within azo-bithiophene (Azo-BT) chemisorbed monolayers under different light stimuli using density functional theory and molecular dynamics simulations. We consider two types of switches, Azo-BT and BT-Azo, with different arrangements of the Azo and BT blocks counting from the anchor thiol group. The chemisorbed monolayers of pure cis- and trans-isomers with a surface concentration of approximately 2.7 molecules per nm2 are modeled on a gold surface using classical all-atom molecular dynamics. Our results reveal significant shrinkage of the BT-Azo layer under UV illumination, whereas the thicknesses of the Azo-BT layer remain comparable for both isomers. This difference in behavior is attributed to the ordering of the trans-molecules in the layers, which is more pronounced for Azo-BT, leading to a narrow distribution of the inclination angle to the gold surface. Conversely, both layers consisting of cis-switches exhibit disorder, resulting in similar brush heights. To study charge transfer within the immobilized layers, we analyze each snapshot of the layer and calculate mean charge transfer integrals using Nelsen’s algorithm for a number of interacting neighboring molecules. Combining these integrals with reorganization energies defined for the isolated molecules, we evaluate the charge transfer rates and mobilities for electron and hole hopping within the layers at room temperature based on Marcus’ theory. This research offers new perspectives for the innovative design of electrode surface modifications and provides insights into controlling charge transfer within immobilized layers using light triggers. Additionally, we identify molecular properties that are enhanced through specific molecular design, which contributes to the development of more efficient molecular switches for various electronic applications.

The continuous advancements in healthcare technology have empowered the discovery, diagnosis, and prediction of diseases, revolutionizing the field. Artificial intelligence (AI) is expected to play a pivotal role in achieving the goals of precision medicine, particularly in disease prevention, detection, and personalized treatment. This study aims to determine the optimal combination of the mother wavelet and AI model for the analysis of pediatric electroretinogram (ERG) signals. The dataset, consisting of signals and corresponding diagnoses, undergoes Continuous Wavelet Transform (CWT) using commonly used wavelets to obtain a time-frequency representation. Wavelet images were used for the training of five widely used deep learning models: VGG-11, ResNet-50, DensNet-121, ResNext-50, and Vision Transformer, to evaluate their accuracy in classifying healthy and unhealthy patients. The findings demonstrate that the combination of Ricker Wavelet and Vision Transformer consistently yields the highest median accuracy values for ERG analysis, as evidenced by the upper and lower quartile values. The median balanced accuracy of the obtained combination of the three considered types of ERG signals in the article are 0.83, 0.85, and 0.88. However, other wavelet types also achieved high accuracy levels, indicating the importance of carefully selecting the mother wavelet for accurate classification. The study provides valuable insights into the effectiveness of different combinations of wavelets and models in classifying ERG wavelet scalograms.

U-Net, based on a deep convolutional neural network (CNN), has been clinically used to au-to-segment normal organs and potentially target volumes. However, CNNs with local geometric dependencies may limit the accuracy of segmentation. Additionally, the performance of CNNs can vary depending on the selection of network hyper-parameters, which was mitigated by the proposition of nnU-Net. We chose a vision transformer architecture called VT U-Net, which features a self-attention excluding the convolution layer, to overcome the limitations of CNNs by utilizing global geometric information of images. The VT U-Net v.2 became more powerful thanks to the adaptive hyper-parameter optimizer embedded in nnU-Net. However, despite leveraging the benefits of nnU-Net, VT U-Net v.2 still had additional network hyper-parameters that needed to be optimally chosen. Accordingly, among various hyper-parameters, this study attempted to find the optimal combination of the patch size and the embedded dimension regarding the transformer. From the 4-fold cross-validation, the modified VT U-Net v.2 showed the highest average performance for planning target volume (PTV) segmentation among the investigated networks. Though nnU-Net was based on convolution layers, the adaptive hyper-parameter optimizers turned out to enhance the performance. It was also confirmed that network hyper-parameters affected the segmentation accuracy of vision transformers.

Multispectral image (MSI) and hyperspectral image (HSI) fusion (MHIF) aims to address the challenge of acquiring high-resolution (HR) HSI images. This field combines a low-resolution (LR) HSI with an HR-MSI to reconstruct HR-HSI. Existing methods directly utilize transformers to perform feature extraction and fusion. Despite the demonstrated success, there exist two limitations: 1) Employing the entire transformer model for feature extraction and fusion fails to fully harness the transformer’s potential in integrating the spectral of the HSI and spatial information of the MSI. 2) HSI has a strong spectral correlation and exhibits sparsity in the spatial domain. Existing transformer-based models do not optimize this physical property, which makes their methods prone to spectral distortion. To accomplish these issues, this paper introduces a novel framework for MHIF called Sparse Mix-Attention Transformer (SAMformer). Specifically, to fully harness the advantages of the Transformer architecture, we propose a Spectral Mix Attention Block (SMAB), which concatenates the keys and values extracted from LR-HSI and HR-MSI to create a new multi-head attention module. This design facilitates the extraction of detailed long-range information across spatial and spectral dimensions. Besides, to address the spatial sparsity inherent in HSI, we incorporated a sparse mechanism within the core of SMAB called Sparse Spectral Mix Attention Block (SSMAB). In the SSMAB, we compute attention maps from queries and keys and select the K highly correlated values as the sparse attention map. This approach enables us to achieve a sparse representation of spatial information while eliminating spatially disruptive noise. Extensive experiments conducted on three benchmark datasets, namely Cave, Harvard, and Pavia Center, demonstrate the SMAformer method outperforms state-of-the-art methods.

In practical applications, the detection of objects with various sizes is a common requirement for most detectors. The feature pyramid network (FPN) is widely adopted as a framework to address this challenge. The field is witnessing an increasing number of transformer-based target detectors due to the widespread adoption of transformer technology. This paper initially examines the design flaws in FPN and transformer-based target detectors, followed by the introduction of a new transformer-based approach called Texturized Instance Guidance (TIG-DETR) to address these issues. Specifically, TIG-DETR comprises a backbone network, a new pyramidal structure known as Texture-Enhanced FPN (TE-FPN), and an enhanced DETR detector.The TE-FPN is composed of three components: a bottom-up pathway for enhancing texture information in the feature map, a lightweight attention module to address confounding effects resulting from cross-scale fusion, and a standard attention module to enhance the final output features.The improved DETR detector utilizes Shifted Window based Self-Attention to replace the multi-headed self-attention module in DETR, thereby accelerating model convergence. Moreover, it incorporates an Instance Based Advanced Guidance Module to enhance instance perception in the image by employing a pre-local self-attentive mechanism for recognizing larger instances. By employing TE-FPN instead of FPN in Faster RCNN with Resnet-50 as the backbone network, we achieve a 1.9% improvement in average accuracy. TIG-DETR achieves an average accuracy of 44.1 with Resnet-50 as the backbone network.