In the past decades, a significant rise in the adoption of streaming applications has changed the decision-making process for the industry and academia sectors. This movement led to the emergence of a plurality of Big Data technologies such as Apache Storm, Spark, Heron, Samza, Flink, and other systems to provide in-memory processing for real-time Big Data analysis at high throughput. Spark Streaming represents one of the most popular open-source implementations which handles an ever-increasing data ingestion and processing by using the Unified Memory Manager to manage memory occupancy between storage and processing regions dynamically, which is the focus of this study. The problem behind memory management for data-intensive stream processing pipelines is that the incoming data is faster than the downstream operators can consume. Consequently, the backpressure of Spark acts in the opposite direction of downstream operators. In such a case, the incoming data overwhelms the memory manager and provokes memory leak issues. As a result, it affects the performance of applications generating, e.g., high latency, low throughput, or even data loss. In such a case, the initial intuition motivating our work is that memory management became the critical factor in keeping processing at scale and system stability of Spark. This work provides a deep dive into Spark backpressure, evaluates its structure, presents the main characteristics to support data-intensive streaming pipelines, and investigates the current in-memory-based performance issues.

This paper addresses a method to transmit streaming data via rolling shutter camera-based optical camera communications (OCC). Since the amount of data that can be contained within one frame is limited, and the continuity of received data cannot be guaranteed due to OCC environmental variations, we introduce the concept of dividing the streaming data into several fragmented sets that are transmitted sequentially. We propose a superframe to contain sequential packets of fragmented data and corresponding indexes, so that sequential packets for streaming data can be continuously collected. When redundant frame transmission is considered, any packet lost due to OCC environmental conditions can be recovered. Experimental results show that the proposed method can be successfully used to transmit streaming data, with the number of redundant frames required to acquire all data packets based on image resolution. In addition, we describe how to identify missing packets from a network point of view to reduce the number of redundant frames needed to acquire all the data. This paper presents baseline results of communication performance when sending streaming data via a rolling shutter-based OCC.

Online streaming contents are creating greater service uncertainty, as consumers need to experience such contents before making a decision to continue to purchase them. Few studies have investigated the interaction between eWOM (online word-of-mouth) and online streaming content service characteristics in online streaming contents’ performance and explained the way this interaction can promote service characteristics’ role in service performance or remedy service uncertainty attributable to these characteristics. Thus, this paper examines the interaction between eWOM and service (webtoon) characteristics (i.e., author experience, genre (drama or fantasy), completion, transfer to pay service, and publication time (Wednesday)) on online streaming contents’ service performance measures such as publication period and gamification of contents. Author experience and genre interact with the number of reviews to affect gamification. The transfer to pay service interacts crucially with review ratings and the number of reviews to influence both publication period and gamification. Online streaming contents completion and publication time are interacting factors with review ratings that affected publication period. Service providers need to cope with service uncertainty in furthering online streaming contents service by considering service characteristics as well as customers’ responses through eWOM.

Adaptive bitrate (ABR) algorithms optimize the quality of streaming experiences for users in client-side video players especially in unreliable or slow mobile networks. Several rule-based heuristic algorithms can achieve stable performance, but they sometimes fail to adapt properly to changing network conditions. Fluctuating bandwidth may cause algorithms to default to behavior that creates a negative experience for the user. ABR algorithms can be generated with reinforcement learning, a decision-making paradigm in which an agent learns to make optimal choices through interactions with an environment. Training reinforcement learning algorithms for bitrate streaming requires building a simulator for an agent to experience interactions quickly; training an agent in the real environment is infeasible due to the long step times in real environments. This project explores using supervised learning to construct a world-model, or a learned simulator, from recorded interactions. A reinforcement learning agent trained inside of the learned model, rather than a simulator, can outperform rule-based heuristics. Furthermore, agents trained inside the learned world-model can outperform model-free agents in low sample regimes. This work highlights the potential for world-models to quickly learn simulators, and to be used to generate optimal policies.

Live video streaming has become one of the main multimedia trends in networks in recent years. Providing Quality of Service (QoS) during live transmissions becomes a challenge due to the stringent requirements for low latency and minimal interruptions. This scenario has led to a high dependence on cloud services, implying a widespread usage of Internet connections, which constrains contexts where an Internet connection is not available. Thus, alternatives such as Mobile Ad Hoc Networks (MANETs) emerge as potential communication techniques. These networks operate autonomously with mobile devices serving as nodes, without the need for coordinating centralized components. However, these characteristics lead to challenges to live-video streaming, such as dynamic node topologies or periods of disconnection. Considering these constraints, this paper investigates the application of Artificial Intelligence (AI)-based classification techniques to provide adaptive streaming in MANETs. For this, a software-driven architecture is proposed to route stream in offline MANETs, predicting the stability of individual links and compressing video frames accordingly. The proposal has been implemented and assessed in a laboratory context, analyzing the model performance and QoS metrics. As a result, the model is implemented in a decision forest algorithm, which provides 95.9% of accuracy. Also, obtained latency values become assumable for video streaming, manifesting a reliable response for routing and node movements.

The electrokinetics methods have a great potential to characterize hydrogeological processes in geological media, especially in complex hydrosystems such as fractured formations. In this work, we conceptualize fractured media as a bunch of parallel capillary fractures following the fractal size distribution. This conceptualization permits to obtain analytical models for both the electrical conductivity and the electrokinetic coupling in water saturated fractured media. We explore two different approaches to express the electrokinetic coupling. First, we express the streaming potential coupling coefficient as a function of the zeta potential and then we obtain the effective charge density in terms of macroscopic hydraulic and electrokinetic parameters of porous media. We show that when the surface electrical conductivity is negligible, the proposed models reduces to the previously proposed one based on a bundle of cylindrical capillaries. This model opens up a wide range of applications to monitor the water flow in fractured media.

Acoustic focusing of particle flow in microfluidics has been shown to be an efficient tool for particle separation for various chemical and biomedical applications. The mechanism behind the method is the selective effect of the acoustic radiation force on distinct particles. In this way, they can be selectively focused and separated. The technique can also be applied under stationary conditions, i.e., in the absence of fluid flows. In this study, the manipulation of self-propelled particles, such as Janus particles, in an acoustofluidic setup is investigated. In experiments with self-propelled Janus particles and passive beads, we explore the interplay between self-propulsion and the acoustic radiation force. Our results demonstrate unusual and potentially useful effects such as selective trapping, escape and assisted escape in binary mixtures of active and passive particles. We also analyze various aspects related to the behavior of Janus particles in acoustic traps in the presence and absence of flows.

Social Business Intelligence (SBI) enables companies to capture strategic information from public social networks. Contrary to traditional Business Intelligence (BI), SBI has to face the high dynamicity of both the social network contents and the company analytical requests, as well as the enormous amount of noisy data. Effective exploitation of these continuous sources of data requires efficient processing of the streamed data to be semantically shaped into insightful facts. In this paper, we propose a multidimensional formalism to represent and evaluate social indicators directly from fact streams derived in turn from social network data. This formalism relies on two main aspects: the semantic representation of facts via Linked Open Data and the support of OLAP-like multidimensional analysis models. Contrary to traditional BI formalisms, we start the process by modeling the required social indicators according to the strategic goals of the company. From these specifications, all the required fact streams are modeled and deployed to trace the indicators. The main advantages of this approach are the easy definition of on-demand social indicators, and the treatment of changing dimensions and metrics through streamed facts. We demonstrate its usefulness by introducing a real scenario user case in the automotive sector.

Live streaming conferences increase the participation of a diverse audience, help defray travel costs and overcome problems related to travel restrictions. In this article, we lay out tips for implementing live-streaming in scientific meetings. We also cover legal, ethical, and technical aspects implicated with live-streaming scientific talks. To write this article, we leveraged knowledge from our experience in organizing the symposium “Deciphering the Denisovans,” presented at the 88th Annual Meeting of the American Association of Physical Anthropology (AAPA) in Cleveland, OH, in 2019, as well as literature on the topic.

Sleep postures monitoring systems in the hospital aim at transforming sensing signals into quantitative data to characterize the sleep behaviors of the patient. However, a home-care sleep posture monitoring system needs to be user friendly. In this paper, we present iSleePost - a user-friendly home-care intelligent sleep posture monitoring system. We address the labor-intensive labeling issue of traditional machine learning approaches in the training phase. Our proposed mobile health (mHealth) system leverages the communications and computation capabilities of mobile phones for provisioning a continuous sleep posture monitoring service. Our experiments show that iSleePost can achieve 90 percent accuracy in recognizing sleep postures. More importantly, iSleePost demonstrates that an easily-wear wrist sensor can accurately quantify sleep postures.

With the introduction of HTTP/3, whose transport is no longer the traditional TCP protocol but the novel QUIC protocol, research for solutions to the unfairness of Adaptive Streaming over HTTP (HAS) has become more challenging. That is, because of different transport layers, the HTTP/3 may not be available for some networks and the clients have to use HTTP/2 for their HAS applications instead. Therefore, the scenario that HAS over HTTP/3 (HAS/3) compete against HTTP/2 (HAS/2) must be considered seriously. However, there have been a shortage of investigations on the performance and the origin of the unfairness in such a cross-protocol scenario in order to produce proper solutions. Therefore, this paper provides a performance evaluation and root-cause analysis of the cross-protocol unfairness between HAS/3 and HAS/2. It is concluded that, due to differences in the congestion control mechanisms of QUIC and TCP, HAS/3 clients obtain larger congestion windows, thus requesting higher video bitrates than HAS/2. As the problem lies in the transport layer, existing client-side ABR-based solutions for the unfairness from the application layer may perform suboptimally for the cross-protocol case.

HTTP/2 video streaming has caught a lot of attentions in the development of multimedia technologies over the last few years. In HTTP/2, the server push mechanism allows the server to deliver more video segments to the client within a single request in order to deal with the requests explosion problem. As a result, recent research efforts have been focusing on utilizing such a feature to enhance the streaming experience while reducing the request-related overhead. However, current works only optimize the performance of a single client, without necessary concerns of possible influences on other clients in the same network. When multiple streaming clients compete for a shared bandwidth in HTTP/1.1, they are likely to suffer from unfairness, which is defined as the inequality in their bitrate selections. For HTTP/1.1, existing works have proven that the network-assisted solutions are effective in solving the unfairness problem. However, the feasibility of utilizing such an approach for the HTTP/2 server push has not been investigated. Therefore, in this paper, a novel proxy-based framework is proposed to overcome the unfairness problem in adaptive streaming over HTTP/2 with the server push. Experimental results confirm the outperformance of the proposed framework in ensuring the fairness, assisting the clients to avoid rebuffering events and lower bitrate degradation amplitude, while maintaining the mechanism of the server push feature.

In recent years, vision-centric perception has played a crucial role in autonomous driving tasks, encompassing functions such as 3D detection, map construction, and motion forecasting. However, the deployment of vision-centric approaches in practical scenarios is hindered by substantial latency, often deviating significantly from the outcomes achieved through offline training. This disparity arises from the fact that conventional benchmarks for autonomous driving perception predominantly conduct offline evaluations, thereby largely overlooking the latency concerns prevalent in real-world deployment. While a few benchmarks have been proposed to address this limitation by introducing effective evaluation methods for online perception, they do not adequately consider the intricacies introduced by the complexity of input information streams. To address this gap, we propose the Autonomous-driving Streaming I/O (ASIO) benchmark, aiming to assess the streaming inputs characteristics and online performance of vision-centric perception in autonomous driving. To facilitate this evaluation across diverse streaming inputs, we initially establish a dataset based on the CARLA Leaderboard. In alignment with real-world deployment considerations, we further develop evaluation metrics based on information complexity specifically tailored for streaming inputs and streaming performance. Experimental results indicate significant variations in model performance and ranking under different major camera deployments, underscoring the necessity of thoroughly accounting for the influences of model latency and streaming inputs characteristics during real-world deployment. To enhance streaming performance consistently across distinct streaming inputs features, we introduce a backbone switcher based on the identified streaming inputs characteristics. Experimental validation demonstrates its efficacy in perpetually improving streaming performance across varying streaming inputs features.

Protective coatings, in recent years also from nanocomposite formulations, are commonly applied onto architectural stone and stone artefacts, mainly to prevent absorption into the porous stone structure of condensed water and dissolved atmospheric pollutants. While standard protocols are available to assess a coating’s performance, understanding the response of the coating-stone system is a complex task, due to the interplay of various factors determining the overall behaviour. Characterization techniques allowing to correlate the extent and nature of surface modification upon treatment with the most relevant physical properties (i.e water absorption and surface wettability) are thus of great interest. Electrokinetic analysis based on streaming current measurements, thanks to its sensitivity towards even minor changes in the surface chemical composition, may fulfil such requirement. Indeed, by involving the interaction with a testing aqueous electrolyte solution, this technique allows to probe not only the outer surface but also the outermost layer of the pore network, which plays a crucial role in the interaction of the stone with condensed atmospheric water. In this work a correlation was found between the extent of surface modification, as determined by streaming current measurements, surface wettability and capillary water absorption of 6 coating-lithotype combinations (3 lithotypes and 2 nanocomposites).

The Nigerian media have traversed through all manners of leadership— military, democratic—finally settling into democratic governance. Experience from previous regimes exposed them to the vagaries of power and how to cope with them. The coming of the internet with its social media handles threw the journalists of these media into confusion as the citizens have taken the reigns of news/information peddling from under them, turning them into agents of confirmation and authenticity of information. The objective is to interrogate how online media/information/news streaming has taken the audience away from the traditional media by being on the ‘spot’ at all hours with their avalanche of “Breaking News.” Deploying survey method (opinion poll, OPL), and relying on purposive sampling technique, the authors purposively selected WhatsApp Group Platforms (WGP), as the most suitable of the new/social media with access to all manners of news sources. Findings reveal that audiences currently resort to the traditional media to confirm the authenticity of news and information carried online in a sort-of-when-in-doubt-watch-the television; listen to radio or read the newspaper/magazine. It concludes that online news streaming has become the coveted bride of present day information and news seekers albeit a most unreliable one at that.

With end-to-end encryption for video streaming services becoming more popular, network administrators face new challenges in preserving network performance and user experience. Video ads may cause traffic congestion and poor Quality of Experience. Because of the natural variation in user interests and network situations, traditional algorithms for increasing QoE may face limitations. To solve this problem, we suggest a novel method that uses user facial emotion recognition to deduce QoE and study the effect of ads. We use open-access Face Emotion Recognition (FER) datasets and extract facial emotion information from actual observers to train machine learning models. Participants were requested to watch ad videos and provide feedback, which will be used for comparison, training, testing, and validation of our suggested technique. Our tests show that our approach beats the ITU-T P.1203 standard in terms of accuracy by 37.1%. Our method provides a hopeful answer to the problem of increasing user engagement and experience in video streaming services.

This study examines the influences of live streaming servicescape on Chinese consumers' luxury purchase intention. Interestingly, for the sample without luxury purchase experience, the mediating effect of the perceived value of luxury goods is significant but effect of consumer trust is not. For the sample with luxury purchase experience, the result of mediating effect is just the opposite. The interaction between conspicuous consumption and live streaming servicescape plays a certain role in regulating the perceived value of luxury goods. These results show that luxury brands can adopt innovation in the live streaming servicescape for different types of consumers to promote live streaming marketing. This study enriches the servicescape theory of live streaming.

The falling cost of cameras, the advancement of AI based computer vision algorithms, and powerful hardware accelerators for deep learning have enabled wide-spread deployment of surveillance cameras with the ability to automatically analyze streaming video feeds to detect events of interest. While streaming video analytics is currently largely done in the cloud, edge computing has emerged as a pivotal component due to its advantages of low latency, reduced bandwidth, and enhanced privacy. However, a distinct gap persists between the state-of-the-art computer vision algorithms, and successful practical implementation of edge-based streaming video analytics systems. This paper presents a comprehensive review of more than 30 research papers published over the last 6 years on edge video analytics systems. The papers are analyzed across 17 distinct dimensions. Unlike prior reviews, we examine each system holistically, identifying their strengths and weaknesses in diverse implementations. Our findings suggest that certain critical topics necessary for the practical realization of edge video analytics systems are not sufficiently addressed in current research. Based on these observations, we propose research trajectories across short, medium, and long term horizons. Additionally, we explore trending topics in other computing areas that can significantly impact the field of edge video analytics.

In this paper, we discuss the most significant application opportunities and outline the challenges in performing a real-time and energy-efficient management of the distributed resources available at mobile devices and Internet-to-Data Center. We also present an energy-efficient adaptive scheduler for Vehicular Fog Computing (VFC) that operates at the edge of a vehicular network, connected to the served Vehicular Clients (VCs) through an Infrastructure-to-Vehicular (I2V) over multiple Foglets (Fls). The scheduler optimizes the energy by leveraging the heterogeneity of Fls, where the Fl provider shapes the system workload by maximizing the task admission rate over data transfer and computation. The presented scheduling algorithm demonstrates that the resulting adaptive scheduler allows scalable and distributed implementation.

While current video quality assessment research predominantly revolves around resolutions of 4K and beyond, targeted at Ultra High-Definition (UHD) displays, effective video quality for mobile video streaming remains primarily within the range of 480p to 1080p. In this study, we conducted a comparative analysis of the Quality of Experience (QoE) for widely implemented video codecs on mobile devices, specifically Advanced Video Coding (AVC), its successor High-Efficiency Video Coding (HEVC), and Google's VP9. Our choice of 720p video sequences from a newly developed database, all with identical bitrates, aimed to maintain a manageable subjective assessment duration, capped at 35-40 minutes. To mimic real-time network conditions, we generated stimuli by streaming original video clips over a controlled emulated setup, subjecting them to eight different packet loss scenarios. We evaluated the quality and structural similarity of the distorted video clips using objective metrics, including Video Quality Metric (VQM), Peak Signal-to-Noise Ratio (PSNR), Video Multi-Method Assessment Fusion (VMAF), and Multi-Scale Structural Similarity Index (MS-SSIM). Subsequently, we collected subjective ratings through a custom mobile application developed for Android devices. Our findings revealed that VMAF accurately represents the degradation in video quality compared to other metrics. Moreover, in most cases, HEVC exhibits an advantage over both AVC and VP9 under low packet loss scenarios. However, it is noteworthy that in our test cases, AVC outperformed HEVC and VP9 in scenarios with high packet loss, based on both subjective and objective assessments. Our observations further indicate that user preferences for the presented content contribute to video quality ratings, emphasizing the importance of additional factors that influence the perceived video quality of end-users.

Dynamic adaptive video streaming over HTTP (DASH) plays a crucial role in video transmission across networks. Traditional adaptive bitrate (ABR) algorithms adjust the quality of video segments based on network conditions and buffer occupancy. However, these algorithms rely on fixed rules within a complex environment, making it challenging to achieve optimal decisions considering the overall context. In this paper, we propose a novel Deep Reinforcement Learning-based approach for streaming DASH, focusing on maintaining consistent perceived video quality throughout the streaming session to enhance user experience. Our approach optimizes the Quality of Experience (QoE) by dynamically controlling the quality distance factor between consecutive video segments. We evaluate this approach through a simulation model that encompasses diverse wireless network environments and various video sequences. Additionally, we compare our proposed approach with state-of-the-art methods. The experimental results demonstrate significant improvements in QoE, ensuring users enjoy stable, high-quality video streaming sessions.

(1) Background: Twitch.tv is a live video content website. As of 2022, Twitch users are generally adolescents and young adults, with estimates of the percentage of users aged 16-24 between 22.3% and 41%, predominantly males with estimates ranging from 65% to 78.36%. In recent years, “slotstream” content has become increasingly popular, where streamers gamble online while users watch them. (2) Methods: from July 2022 to November 2022, we researched articles related to Twitch, live streaming, gambling, casino, slot, gambling online, modeling, social media influencers, conditioning, and celebrities, searching for relevant studies in the databases LexisNexis Academic, Business Source Complete, PubMed, Web of Science, Freedom Collection, Health & Medical Collection, Elsevier Journal, Springer, APA PsycARTICLES, Wiley, and other single journals. (3) Results: we took into consideration Gambling Disorder, Online Gambling Disorder, and Internet Gaming Disorder on the one hand, and consumer components such as persuasive communication and influencer-audience relationship on the other; we then hypothesized that the presence of these variables within the slotstream format is positively correlated with the development of pathological gambling, especially in an adolescent audience. (4) Conclusion: we assume that there is a positive correlation between watching slotstream content and the probability of developing both pathological and non-pathological gambling behavior.

The human mind is multimodal. Yet most behavioral studies rely on century-old measures of behavior—task accuracy and latency (response time). Multimodal and multisensory analysis of human behavior creates a better understanding of how the mind works. The problem is that designing and implementing these experiments is technically complex and costly. This paper introduces versatile and economical means of developing multimodal-multisensory human experiments. We provide an experimental design framework that automatically integrates and synchronizes measures including electroencephalogram (EEG), galvanic skin response (GSR), eye-tracking, virtual reality (VR), body movement, mouse/cursor motion and response time. Unlike proprietary systems (e.g., iMotions), our system is free and open-source; it integrates PsychoPy, Unity and Lab Streaming Layer (LSL). The system embeds LSL inside PsychoPy/Unity for the synchronization of multiple sensory signals—gaze motion, electroencephalogram (EEG), galvanic skin response (GSR), mouse/cursor movement, and body motion—with low-cost consumer-grade devices in a simple behavioral task designed by PsychoPy and a virtual reality environment designed by Unity. This tutorial shows a step-by-step process by which a complex multimodal-multisensory experiment can be designed and implemented in a few hours. When conducting the experiment, all of the data synchronization and recoding of the data to disk will be done automatically.

The sPHENIX experiment is a state-of-the-art jet and heavy flavor physics detector which successfully recorded its first Au + Au collision data at 200 GeV at RHIC. sPHENIX will provide heavy flavor physics measurements covering an unexplored kinematic region and unprecedented precision at RHIC to probe the parton energy loss mechanism, parton transport coefficients in quark-gluon plasma, and the hadronization process under various medium conditions. At the center of sPHENIX, the Monolithic-Active-Pixel-Sensor (MAPS) based VerTeX detector (MVTX) is a high-precision silicon pixel detector. The MVTX provides excellent position resolution and the capability of operating in continuous streaming readout mode, allowing precise vertex determination and recording a large data sample, both of which are particularly crucial for heavy flavor physics measurements. In this work, we will show the general performance of heavy-flavor hadron reconstruction. In addition, we will discuss the commissioning experience with sPHENIX. Finally, we will provide the projection of b-hadron and jet observables and discuss the estimated constraints on theoretical models.

Continual learning, a crucial facet of machine learning, involves the perpetual acquisition of valuable insights from incoming data, sans the necessity for full dataset access. Esteemed as a fundamental goal in artificial intelligence, continual learning grapples with an enduring challenge—catastrophic forgetting. A proficient model must exhibit adaptability for new data assimilation and robustness to retain existing knowledge. Class-incremental learning (CIL) aids the gradual integration of knowledge from newly introduced classes, forming a universal classifier. However, directly training the model with fresh class instances triggers a problem—forgetting distinguishing features of prior classes, causing a performance decline. Addressing such issues in machine learning, this survey aims to delineate significant challenges, outcomes, and recent advancements, including our contributions to CIL techniques, especially in image classification.