Junkun Peng
ABSTRACT
Nowadays, the surge of Internet contents and the need for high Quality of Experience (QoE) put the backbone network under unprecedented pressure. The emerging edge caching solutions help ease the pressure by caching contents closer to users. However, these solutions suffer from two challenges: 1) a low hit ratio due to edges’ high density and small coverages. 2) unbalanced edges’ workloads caused by dynamic requests and heterogeneous edge capacities. In this paper, we formulate a typical cooperative edge caching problem and propose the MagNet, a decentralized and cooperative edge caching system to address these two challenges. The proposed MagNet system consists of two innovative mechanisms: 1) the Automatic Content Congregating (ACC), which utilizes a neural embedding algorithm to capture underlying patterns of historical traces to cluster contents into some types. The ACC then can guide requests to their optimal edges according to their types so that contents congregate automatically in different edges by type. This process forms a virtuous cycle between edges and requests, driving a high hit ratio. 2) the Mutual Assistance Group (MAG), which lets idle edges share overloaded edges’ workloads by forming temporary groups promptly. To evaluate the performance of MagNet, we conduct experiments to compare it with classical, Machine Learning (ML)-based and cooperative caching solutions using the real-world trace. The results show that the MagNet can improve the hit ratio from 40% and 60% to 75% for non-cooperative and cooperative solutions, respectively, and significantly improve the balance of edges’ workloads.
- Akamai. 2021. Media Delivery Network Map. https://www.akamai.com/visualizations/media-delivery-network-mapGoogle Scholar
- Oren Barkan and Noam Koenigstein. 2016. Item2vec: neural item embedding for collaborative filtering. In 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP). IEEE, 1–6.Google ScholarCross Ref
- Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2016. Enriching Word Vectors with Subword Information. arXiv preprint arXiv:1607.04606(2016).Google Scholar
- Pedro Casas, Alessandro D’Alconzo, Pierdomenico Fiadino, Arian Bär, and Alessandro Finamore. 2014. On the analysis of QoE-based performance degradation in YouTube traffic. In 10th International Conference on Network and Service Management (CNSM) and Workshop. IEEE, 1–9.Google ScholarCross Ref
- Joonho Choi, Abu Sayeem Reaz, and Biswanath Mukherjee. 2012. A Survey of User Behavior in VoD Service and Bandwidth-Saving Multicast Streaming Schemes. IEEE Communications Surveys Tutorials 14, 1 (2012), 156–169.Google ScholarCross Ref
- Cisco. 2020. Cisco Annual Internet Report (2018–2023) White Paper. https://www.cisco.com/c/en/us/solutions/collateral/executive-perspectives/annual-internet-report/white-paper-c11-741490.htmlGoogle Scholar
- Xun Fan, Ethan Katz-Bassett, and John Heidemann. 2015. Assessing affinity between users and CDN sites. In International Workshop on Traffic Monitoring and Analysis. Springer, 95–110.Google ScholarCross Ref
- Google. 2021. Google Cloud CDN Locations. https://cloud.google.com/cdn/docs/locationsGoogle Scholar
- James Gosling. 1997. The feel of Java. Computer 30, 6 (1997), 53–57.Google ScholarDigital Library
- Palash Goyal and Emilio Ferrara. 2018. Graph embedding techniques, applications, and performance: A survey. Knowledge-Based Systems 151 (2018), 78–94.Google ScholarCross Ref
- Yu Guan, Xinggong Zhang, and Zongming Guo. 2019. CACA: Learning-Based Content-Aware Cache Admission for Video Content in Edge Caching. In Proceedings of the 27th ACM International Conference on Multimedia. ACM, 456–464.Google ScholarDigital Library
- David Guthrie, Ben Allison, Wei Liu, Louise Guthrie, and Yorick Wilks. 2006. A closer look at skip-gram modelling.. In LREC, Vol. 6. Citeseer, 1222–1225.Google Scholar
- Song Jiang and Xiaodong Zhang. 2002. LIRS: An efficient low inter-reference recency set replacement policy to improve buffer cache performance. ACM SIGMETRICS Performance Evaluation Review 30, 1 (2002), 31–42.Google ScholarDigital Library
- Wei Jiang, Gang Feng, Shuang Qin, Tak Shing Peter Yum, and Guohong Cao. 2019. Multi-agent reinforcement learning for efficient content caching in mobile D2D networks. IEEE Transactions on Wireless Communications 18, 3(2019), 1610–1622.Google ScholarDigital Library
- HR Johnson and JA Larson. 1979. Data management for microcomputers. In 1979 Compcon Fall. IEEE, 191–192.Google Scholar
- Armand Joulin, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Hérve Jégou, and Tomas Mikolov. 2016. FastText.zip: Compressing text classification models. arXiv preprint arXiv:1612.03651(2016).Google Scholar
- Naoki Kobayashi and Akinori Yonezawa. 1994. Type-theoretic foundations for concurrent object-oriented programing. ACM SIGPLAN Notices 29, 10 (1994), 31–45.Google ScholarDigital Library
- K Kumaran and E Sasikala. 2021. Learning based Latency Minimization Techniques in Mobile Edge Computing (MEC) systems: A Comprehensive Survey. In 2021 International Conference on System, Computation, Automation and Networking (ICSCAN). IEEE, 1–6.Google ScholarCross Ref
- Ali Larbi, Louiza Bouallouche-Medjkoune, and Djamil Aissani. 2018. Improving cache effectiveness based on cooperative cache management in MANETs. Wireless Personal Communications 98, 3 (2018), 2497–2519.Google ScholarDigital Library
- Anatole Lécuyer, Fabien Lotte, Richard B Reilly, Robert Leeb, Michitaka Hirose, and Mel Slater. 2008. Brain-computer interfaces, virtual reality, and videogames. Computer 41, 10 (2008), 66–72.Google ScholarDigital Library
- Donghee Lee, Jongmoo Choi, Jong-Hun Kim, Sam H Noh, Sang Lyul Min, Yookun Cho, and Chong Sang Kim. 1999. On the existence of a spectrum of policies that subsumes the least recently used (LRU) and least frequently used (LFU) policies. In Proceedings of the 1999 ACM SIGMETRICS international conference on Measurement and modeling of computer systems. 134–143.Google ScholarDigital Library
- Chia-Feng Lin, Muh-Chyi Leu, Chih-Wei Chang, and Shyan-Ming Yuan. 2011. The study and methods for cloud based CDN. In 2011 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery. IEEE, 469–475.Google ScholarDigital Library
- Yuyi Mao, Changsheng You, Jun Zhang, Kaibin Huang, and Khaled B. Letaief. 2017. A Survey on Mobile Edge Computing: The Communication Perspective. IEEE Communications Surveys Tutorials 19, 4 (2017), 2322–2358.Google ScholarCross Ref
- Nimrod Megiddo and Dharmendra S Modha. 2003. ARC: A Self-Tuning, Low Overhead Replacement Cache. In Fast, Vol. 3. USENIX Association, 115–130.Google Scholar
- Georgios Papaioannou and Iordanis Koutsopoulos. 2019. Tile-based caching optimization for 360 videos. In Proceedings of the Twentieth ACM International Symposium on Mobile Ad Hoc Networking and Computing. ACM, 171–180.Google ScholarDigital Library
- Quoc-Viet Pham, Fang Fang, Vu Nguyen Ha, Md Jalil Piran, Mai Le, Long Bao Le, Won-Joo Hwang, and Zhiguo Ding. 2020. A survey of multi-access edge computing in 5G and beyond: Fundamentals, technology integration, and state-of-the-art. IEEE Access 8(2020), 116974–117017.Google ScholarCross Ref
- Stefan Podlipnig and Laszlo Böszörmenyi. 2003. A Survey of Web Cache Replacement Strategies. ACM Comput. Surv. 35, 4 (2003), 374–398.Google ScholarDigital Library
- Buvaneswari A Ramanan, Lawrence M Drabeck, Mark Haner, Nachi Nithi, Thierry E Klein, and Chitra Sawkar. 2013. Cacheability analysis of HTTP traffic in an operational LTE network. In 2013 Wireless Telecommunications Symposium (WTS). IEEE, 1–8.Google ScholarCross Ref
- Liana V. Rodriguez, Farzana Yusuf, Steven Lyons, Eysler Paz, Raju Rangaswami, Jason Liu, Ming Zhao, and Giri Narasimhan. 2021. Learning Cache Replacement with CACHEUS. In 19th USENIX Conference on File and Storage Technologies (FAST 21). USENIX Association, 341–354.Google Scholar
- Mahadev Satyanarayanan. 2017. The emergence of edge computing. Computer 50, 1 (2017), 30–39.Google ScholarDigital Library
- Karthikeyan Shanmugam, Negin Golrezaei, Alexandros G Dimakis, Andreas F Molisch, and Giuseppe Caire. 2013. Femtocaching: Wireless content delivery through distributed caching helpers. IEEE Transactions on Information Theory 59, 12 (2013), 8402–8413.Google ScholarDigital Library
- Ao-Jan Su, David R Choffnes, Aleksandar Kuzmanovic, and Fabian E Bustamante. 2009. Drafting behind Akamai: Inferring network conditions based on CDN redirections. IEEE/ACM transactions on networking 17, 6 (2009), 1752–1765.Google Scholar
- Xiaoyuan Su and Taghi M Khoshgoftaar. 2009. A survey of collaborative filtering techniques. Advances in artificial intelligence 2009 (2009).Google Scholar
- Anthony Tang and Omid Fakourfar. 2017. Watching 360 videos together. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 4501–4506.Google ScholarDigital Library
- Hao Tian, Xiaolong Xu, Tingyu Lin, Yong Cheng, Cheng Qian, Lei Ren, and Muhammad Bilal. 2021. DIMA: distributed cooperative microservice caching for internet of things in edge computing by deep reinforcement learning. World Wide Web (2021), 1–24.Google Scholar
- Anh-Tien Tran, Demeke Shumeye Lakew, The-Vi Nguyen, Van-Dat Tuong, Thanh Phung Truong, Nhu-Ngoc Dao, and Sungrae Cho. 2021. Hit Ratio and Latency Optimization for Caching Systems: A Survey. In 2021 International Conference on Information Networking (ICOIN). IEEE, 577–581.Google ScholarCross Ref
- Emeka E. Ugwuanyi, Saptarshi Ghosh, Muddesar Iqbal, Tasos Dagiuklas, Shahid Mumtaz, and Anwer Al-Dulaimi. 2019. Co-Operative and Hybrid Replacement Caching for Multi-Access Mobile Edge Computing. In 2019 European Conference on Networks and Communications (EuCNC). IEEE, 394–399.Google Scholar
- Uptime. 2021. Uptime Institute Global Data Center Survey 2021. https://uptimeinstitute.com/Google Scholar
- Linh Van Ma, Van Quan Nguyen, Jaehyung Park, and Jinsul Kim. 2018. NFV-Based Mobile Edge Computing for Lowering Latency of 4K Video Streaming. In 2018 Tenth International Conference on Ubiquitous and Future Networks (ICUFN). IEEE, 670–673.Google ScholarCross Ref
- Giuseppe Vietri, Liana V. Rodriguez, Wendy A. Martinez, Steven Lyons, Jason Liu, Raju Rangaswami, Ming Zhao, and Giri Narasimhan. 2018. Driving Cache Replacement with ML-based LeCaR. In 10th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 18). USENIX Association.Google ScholarDigital Library
- Fangxin Wang, Feng Wang, Jiangchuan Liu, Ryan Shea, and Lifeng Sun. 2020. Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach. In IEEE INFOCOM 2020. 2499–2508.Google ScholarDigital Library
- Xinhua. 2021. China reports expansion in 5G network coverage. http://english.www.gov.cn/statecouncil/ministries/202107/18/content_WS60f424d4c6d0df57f98dd302.htmlGoogle Scholar
- Chen Zhong, M Cenk Gursoy, and Senem Velipasalar. 2018. A deep reinforcement learning-based framework for content caching. In 2018 52nd Annual Conference on Information Sciences and Systems (CISS). IEEE, 1–6.Google ScholarCross Ref
- Hao Zhu, Yang Cao, Wei Wang, Tao Jiang, and Shi Jin. 2018. Deep reinforcement learning for mobile edge caching: Review, new features, and open issues. IEEE Network 32, 6 (2018), 50–57.Google ScholarCross Ref
- Tongyu Zong, Chen Li, Yuanyuan Lei, Guangyu Li, Houwei Cao, and Yong Liu. 2021. Cocktail Edge Caching: Ride Dynamic Trends of Content Popularity with Ensemble Learning. In IEEE INFOCOM 2021. IEEE, 1–10.Google Scholar
Index Terms
- MagNet: Cooperative Edge Caching by Automatic Content Congregating
Index terms have been assigned to the content through auto-classification.
Recommendations
Scalable Delivery of Dynamic Content Using a Cooperative Edge Cache Grid
In recent years, edge computing has emerged as a popular mechanism to deliver dynamic Web content to clients. However, many existing edge cache networks have not been able to harness the full potential of edge computing technology. In this paper, we ...
Cooperative Caching for Chip Multiprocessors
This paper presents CMP Cooperative Caching, a unified framework to manage a CMP's aggregate on-chip cache resources. Cooperative caching combines the strengths of private and shared cache organizations by forming an aggregate "shared" cache through ...
Cooperative Caching for GPUs
The rise of general-purpose computing on GPUs has influenced architectural innovation on them. The introduction of an on-chip cache hierarchy is one such innovation. High L1 miss rates on GPUs, however, indicate inefficient cache usage due to myriad ...
Comments