Preprint
Article

This version is not peer-reviewed.

Evaluation and Optimization of Intelligent Recommendation System Performance with Cloud Resource Automation Compatibility

A peer-reviewed version of this preprint was published in:
Applied and Computational Engineering 2024, 87(1), 228-233. https://doi.org/10.54254/2755-2721/87/20241620

Submitted:

25 July 2024

Posted:

26 July 2024

You are already at the latest version

Abstract
This paper comprehensively explores the integration of cloud computing and advanced recommendation systems, emphasizing their pivotal roles in enhancing user experiences and operational efficiencies across digital platforms. It reviews the evolution of recommendation algorithms, highlighting their application in diverse domains such as e-commerce and media. The study evaluates the performance of advanced models like UniLLMRec against traditional counterparts using datasets from news and e-commerce domains. Additionally, the paper discusses the infrastructure architecture of cloud computing, demonstrating its capability to support scalable and efficient data processing. Through experimental insights and methodology, the research underscores the transformative impact of cloud technologies on optimizing recommendation system performance, thereby advancing digital engagement and competitiveness.
Keywords: 
;  ;  ;  

1. Introduction

With the rapid advancement of digital transformation and continuous innovation in cloud technology, cloud computing has become an indispensable infrastructure across business, government, and personal services. The cloud computing market is segmented into Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service [1] (SaaS), each playing a distinct role and driving growth. IaaS, as the foundation, offers virtualized computing resources, storage, and network services, providing enterprises with a flexible and scalable platform for application deployment. Cloud platforms facilitate centralized data management and analysis, enabling precise user behavior analysis, real-time recommendation strategy adjustments, and enhancing system intelligence and user satisfaction.
This paper examines how cloud computing can enhance the performance and effectiveness of recommendation systems, thus improving user experiences and enterprise competitiveness.

3. Methodology

3.1. Experimental design

1. Data set
The experiment used two datasets related to detailed information about news recommendations and film and television reviews, respectively - MIND and Amazon Review. The former contains News articles and user behavior logs from the Microsoft News website; The latter is collected from Amazon's e-commerce platform and includes user reviews, ratings, and product information.
2. Evaluate indicators
Regarding evaluation indicators, we mainly focus on the performance of Recall and Re-ranking tasks. Indicators such as Recall, Normalized Discounted Cumulative Gain (NDCG) [11], and Intra-List Average Distance (ILAD) were used to evaluate the model's performance in the recommendation task.

3.2. Model Comparison

The UniLLMRec framework is also compared to a series of baseline models; These include Popularity-based recommendation (Pop), Factorization Machines (FM), Deep FM, NRMS, SASRec, and LLM-Ranker.
Pop: Rank an item based on its overall user popularity in the user base and recommend the most popular item to the user.
Pros: Simple, easy to implement, and effective for widely popular content.
Disadvantages: Lack of personalization, consideration of user-specific preferences, and inability to satisfy users with specific tastes.
FM: The ability to use factorization parameters to estimate interactions between variables and can handle problems with high sparsity. Because it can combine auxiliary information to overcome the difficulties of cold start and sparse data in a recommendation system, it is a very practical recommendation model
Deep FM: Combines a shallow factorization model with a deep neural network, leveraging both strengths to improve the model's predictive power. This makes it excellent at dealing with complex interactions and sparsity in recommendation systems, especially in scenarios like [12] CTR prediction.
Advantages: The interaction between features can be learned automatically without manually designing the feature interaction. In addition, due to its profound learning nature, Deep FM scales well to large-scale data sets and can adapt to changing data distributions.
NRMS uses a multi-head self-attention mechanism to enhance the performance of the news recommendation system. The model is divided into two main parts: news encoder and user encoder. News encoders use multi-head self-attention to learn the representation of words in news articles. In contrast, user encoders utilize the exact mechanism to capture behavioral patterns and preferences in a user's reading history. In this way, the model can understand and match user interests and relevant news content more accurately.
SASRec is a sequence-based recommendation system that employs a self-attention mechanism to assign weights to past items dynamically in each time step. Its adaptive nature prioritizes long-term dependencies in dense data sets and focuses on recent activity in sparse data sets, contributing to its superior performance.
LLM-Ranker takes advantage of the rich semantic and contextual understanding of LLMS, such as GPT or BERT, to improve ranking tasks in search and recommendation systems, which makes the model more efficient at handling complex user queries and diverse content.

3.3. Performance Comparison

From the direct comparison of the performance of UniLLMRec and traditional recommendation model in MIND and Amazon Review data sets and two indicators, respectively, whether GPT-3.5 or GPT-4 is used as a backbone, UniLLMRec can outperform many traditional models (especially the one with GPT-4 as the backbone) when the proportion of training sets is small, which indicates the advantage of UniLLMRec's zero sample learning cost, and also reflects the effectiveness and relevance of its retrieval and recommendation items.
Figure 3. Performance Comparison of Recall and NDCG value on MIND and Amazon datasets.
Figure 3. Performance Comparison of Recall and NDCG value on MIND and Amazon datasets.
Preprints 113316 g001

3.4. Cloud Computing Deployment

When cloud computing is introduced into the experimental design of a recommendation system, the performance and scalability of the system can be significantly improved. By leveraging the elastic computing resources and efficient storage services provided by cloud computing platforms, we can more efficiently process large-scale data sets, such as MIND and Amazon Review data. During the experiment, the elastic resource characteristics of the cloud computing platform can also automatically adjust the computing resources according to the real-time load, ensuring that the recommendation system can maintain stable performance at peak times. To sum up, the introduction of cloud computing technology can not only optimize the operational efficiency and performance of the recommendation system but also improve the security and reliability of the system, providing a broader and controllable platform for the research and experiment of recommendation algorithms.

3.5. Experimental Conclusion

Although UniLLMRec can complete the entire recommendation process in most cases, the researchers also found some problems during the experiment, such as even if the output format is clearly defined in the prompt template, LLM sometimes does not output items according to the instructions, resulting in the items not being correctly indexed (intention recognition problem); In the user interest modeling stage, LLM can capture and summarize user interest, but in the leaf node retrieval and diversity perception rearrangement stage, there is a risk of including examples in the wrong prompt words into the retrieval process (illusion problem).
The researchers made an interesting observation when comparing GPT-3.5 and GPT-4 on the Amazon dataset. When GPT-3.5 and GPT-4 reach the wrong child node, GPT-3.5 will usually continue to complete the subsequent process. At the same time, GPT-4 may proactively give a hint that all candidate answers do not meet the requirements (e.g., "Based on the user's interest in UFC and combat sports," None of the Character & Series subcategories provided are relevant "). This suggests GPT-4 is more accurate than GPT-3.5 in capturing user preferences.

4. Conclusions

With the rapid development of information technology, the issue of network security has increasingly become a focal point of global attention. This paper examines the current landscape and challenges of network security, explores the application of deep learning and artificial intelligence in defense strategies, and proposes future-oriented approaches. The continual evolution of cyber threats presents new challenges to traditional cybersecurity defenses. Signature-based methods are inadequate against novel and unidentified network attacks, necessitating the development of advanced defense technologies. As an advanced machine learning technology, deep learning has made significant strides in fields like image recognition and natural language processing.This paper proposes an integrated model of deep learning and artificial intelligence for network security defense, forecasting future trends in defense strategies. Future network security defenses will be more intelligent, automated, and adaptable to evolving network environments. As technology advances, new defense technologies will emerge, bolstering network security.
In conclusion, deep learning and artificial intelligence hold immense potential for enhancing network security defenses. Continued optimization and advancement of these technologies will help establish a more secure and reliable digital environment, supporting the growth of the digital economy. Addressing cyber security challenges requires collaborative efforts from governments, enterprises, academia, and other stakeholders to safeguard cyberspace's security and stability."
This revision improves grammar, coherence, and logical flow while maintaining the original content's meaning and emphasis on the application of deep learning and artificial intelligence in network security.

References

  1. Hoque, M.S., Mukit, M.A. and Bikas, M.A.N., 2012. An implementation of an intrusion detection system using a genetic algorithm. arXiv preprint arXiv:1204.1336.
  2. Bace, R.G. and Mell, P., 2001. Intrusion detection systems.
  3. Ahmad, Z., Shahid Khan, A., Wai Shiang, C., Abdullah, J. and Ahmad, F., 2021. Network intrusion detection system: A systematic study of machine learning and deep learning approaches. Transactions on Emerging Telecommunications Technologies, 32(1), p.e4150. [CrossRef]
  4. Zhan, T., Shi, C., Shi, Y., Li, H., & Lin, Y. (2024). Optimization Techniques for Sentiment Analysis Based on LLM (GPT-3)—arXiv preprint arXiv:2405.09770.
  5. Li, Huixiang, et al. "AI Face Recognition and Processing Technology Based on GPU Computing." Journal of Theory and Practice of Engineering Science 4.05 (2024): 9-16. [CrossRef]
  6. Yuan, J., Lin, Y., Shi, Y., Yang, T., & Li, A. (2024). Applications of Artificial Intelligence Generative Adversarial Techniques in the Financial Sector. Academic Journal of Sociology and Management, 2(3), 59-66.
  7. Guo, L., Li, Z., Qian, K., Ding, W., & Chen, Z. (2024). Bank Credit Risk Early Warning Model Based on Machine Learning Decision Trees. Journal of Economic Theory and Business Management, 1(3), 24-30.
  8. Sun, Y., Cui, Y., Hu, J., & Jia, W. (2018). Relation classification using coarse and fine-grained networks with SDP supervised key words selection. In Knowledge Science, Engineering and Management: 11th International Conference, KSEM 2018, Changchun, China, August 17–19, 2018, Proceedings, Part I 11 (pp. 514-522). Springer International Publishing.
  9. Ma, H. (2021, September). Automatic positioning system of medical service robot based on binocular vision. In 2021 3rd International Symposium on Robotics & Intelligent Manufacturing Technology (ISRIMT) (pp. 52-55). IEEE.
  10. Li, Zihan, et al. "Robot Navigation and Map Construction Based on SLAM Technology." (2024). [CrossRef]
  11. Fan, C., Ding, W., Qian, K., Tan, H., & Li, Z. (2024). Cueing Flight Object Trajectory and Safety Prediction Based on SLAM Technology. Journal of Theory and Practice of Engineering Science, 4(05), 1-8. [CrossRef]
  12. Sarkis, R. A., Goksen, Y., Mu, Y., Rosner, B., & Lee, J. W. (2018). Cognitive and fatigue side effects of anti-epileptic drugs: an analysis of phase III add-on trials. Journal of neurology, 265(9), 2137-2142. [CrossRef]
  13. Liu, B. (2023). Based on intelligent advertising recommendation and abnormal advertising monitoring system in the field of machine learning. International Journal of Computer Science and Information Technology, 1(1), 17-23.
  14. Wu, B., Xu, J., Zhang, Y., Liu, B., Gong, Y., & Huang, J. (2024). Integration of computer networks and artificial neural networks for an AI-based network operator. arXiv preprint arXiv:2407.01541.
  15. Liang, P., Song, B., Zhan, X., Chen, Z., & Yuan, J. (2024). Automating the training and deployment of models in MLOps by integrating systems with machine learning. Applied and Computational Engineering, 67, 1-7.
  16. Allman, R., Mu, Y., Dite, G. S., Spaeth, E., Hopper, J. L., & Rosner, B. A. (2023). Validation of a breast cancer risk prediction model based on the key risk factors: family history, mammographic density and polygenic risk. Breast Cancer Research and Treatment, 198(2), 335-347.
  17. Ding, W., Tan, H., Zhou, H., Li, Z., & Fan, C. Immediate Traffic Flow Monitoring and Management Based on Multimodal Data in Cloud Computing.
  18. Lin, Y., Li, A., Li, H., Shi, Y., & Zhan, X. (2024). GPU-Optimized Image Processing and Generation Based on Deep Learning and Computer Vision. Journal of Artificial Intelligence General Science (JAIGS) ISSN: 3006-4023, 5(1), 39-49. [CrossRef]
  19. Yang, Z., Li, L., Lin, K., Wang, J., Lin, C. C., Liu, Z., & Wang, L. (2023). The dawn of lmms: Preliminary explorations with gpt-4v (ision). arXiv preprint arXiv:2309.17421, 9(1), 1.
  20. Sha, X. (2024). Research on financial fraud algorithm based on federal learning and big data technology. arXiv preprint arXiv:2405.03992.
  21. Zhan, X., Shi, C., Li, L., Xu, K., & Zheng, H. (2024). Aspect category sentiment analysis based on multiple attention mechanisms and pre-trained models. Applied and Computational Engineering, 71, 21-26. [CrossRef]
  22. Liu, B., Zhao, X., Hu, H., Lin, Q., & Huang, J. (2023). Detection of Esophageal Cancer Lesions Based on CBAM Faster R-CNN. Journal of Theory and Practice of Engineering Science, 3(12), 36-42. [CrossRef]
  23. Liu, B., Yu, L., Che, C., Lin, Q., Hu, H., & Zhao, X. (2024). Integration and performance analysis of artificial intelligence and computer vision based on deep learning algorithms. Applied and Computational Engineering, 64, 36-41. [CrossRef]
  24. Li, A., Yang, T., Zhan, X., Shi, Y., & Li, H. (2024). Utilizing Data Science and AI for Customer Churn Prediction in Marketing. Journal of Theory and Practice of Engineering Science, 4(05), 72-79. [CrossRef]
  25. Wu, B., Gong, Y., Zheng, H., Zhang, Y., Huang, J., & Xu, J. (2024). Enterprise cloud resource optimization and management based on cloud operations. Applied and Computational Engineering, 67, 8-14. [CrossRef]
  26. Zhang, Y., Liu, B., Gong, Y., Huang, J., Xu, J., & Wan, W. (2024). Application of machine learning optimization in cloud computing resource scheduling and management. Applied and Computational Engineering, 64, 9-14. [CrossRef]
  27. Huang, J., Zhang, Y., Xu, J., Wu, B., Liu, B., & Gong, Y. Implementation of Seamless Assistance with Google Assistant Leveraging Cloud Computing. [CrossRef]
  28. Yang, T., Xin, Q., Zhan, X., Zhuang, S., & Li, H. (2024). ENHANCING FINANCIAL SERVICES THROUGH BIG DATA AND AI-DRIVEN CUSTOMER INSIGHTS AND RISK ANALYSIS. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 53-62. [CrossRef]
  29. Zhan, X., Ling, Z., Xu, Z., Guo, L., & Zhuang, S. (2024). Driving Efficiency and Risk Management in Finance through AI and RPA. Unique Endeavor in Business & Social Sciences, 3(1), 189-197.
  30. Li, H., Wang, S. X., Shang, F., Niu, K., & Song, R. (2024). Applications of large language models in cloud computing: An empirical study using real-world data. International Journal of Innovative Research in Computer Science & Technology, 12(4), 59-69. [CrossRef]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.
Prerpints.org logo

Preprints.org is a free preprint server supported by MDPI in Basel, Switzerland.

Subscribe

© 2026 MDPI (Basel, Switzerland) unless otherwise stated

Accessibility

Disclaimer

Terms of Use

Privacy Policy

Privacy Settings