Efficient Edge Computing: A Survey of High-Throughput Concurrent Processing Strategies for Graph Data

Weirong Xiu; Md Gapar Md Johar; Mohammed Hazim Alkawaz; Chen Bian

doi:10.54097/ceym1sxx

Authors

Weirong Xiu
Md Gapar Md Johar
Mohammed Hazim Alkawaz
Chen Bian

DOI:

https://doi.org/10.54097/ceym1sxx

Keywords:

Edge computing, Graph data, High throughput, Concurrent processing

Abstract

This paper reviews the strategies for high-throughput concurrent processing of graph data in edge computing environments. As information technology rapidly advances, particularly in areas such as the Internet of Things (IoT), smart cities, and autonomous driving, the need for real-time and efficient data processing continues to grow. Edge computing is a distributed computing paradigm that can process data at or near its origin, thereby reducing network latency, improving application performance, and reducing the load on central data centers. The discussion includes the application of edge computing in graph data processing, highlighting parallel computing models such as the Bulk Synchronous Parallel (BSP) model and other parallel optimization techniques like data partitioning and task scheduling. The paper also addresses specific challenges of parallel processing in edge computing, such as resource constraints, data communication delays, and strategies for security and privacy protection. Despite the significant potential edge computing has demonstrated in processing graph data, numerous challenges remain. Future research directions involve the development of new resource optimization algorithms, low-latency communication protocols, and technologies to enhance data security, aiming to achieve more efficient and secure graph data processing. This paper provides clear directions and a foundation for the efficient implementation of graph data processing in edge computing environments, positioning edge computing to play an increasingly significant role in real-time data analysis and intelligent applications.

References

Wang, S., Cao, J., Wang, H., & Jin, Q. (2020). "Graph Processing on Edge Computing Platforms: A Survey". IEEE Access, 8, 57045-57063.

Satyanarayanan, M. (2017). "The Emergence of Edge Computing". Computer, 50(1), 30-39.

Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016). "Edge Computing: Vision and Challenges". IEEE Internet of Things Journal, 3(5), 637-646.

Chen, M., & Ran, X. (2019). "Deep Learning With Edge Computing: A Review". Proceedings of the IEEE, 107(8), 1655-1674.

Jeong, E., Kim, H., & Park, S. (2020). "Efficient Distributed Graph Processing under Edge Computing Environment". IEEE Transactions on Parallel and Distributed Systems, 31(2), 423-437.

Gupta, H., Vahid Dastjerdi, A., Ghosh, S. K., & Buyya, R. (2017). "iFogSim: A Toolkit for Modeling and Simulation of Resource Management Techniques in the Internet of Things, Edge and Fog Computing Environments". Software: Practice and Experience, 47(9), 1275-1296.

Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019). "Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing". Proceedings of the IEEE, 107(8), 1738-1762.

Yang, L., Cao, J., Yuan, Y., Li, T., Han, A., & Luo, M. (2023). "Real-time Data Processing at the Edge: Opportunities and Challenges". IEEE Network, 37(2), 112-120.

Sahni, Y., Cao, J., & Zhang, S. (2019). "Edge Mesh: A New Paradigm to Enable Distributed Intelligence in Internet of Things". IEEE Access, 7, 82527-82539.

Khan, L., Yaqoob, I., Hashem, I. A. T., Inayat, Z., Mahmoud Ali, W. K., Alam, M., & Shiraz, M. (2019). "Edge Computing: A Survey". Future Generation Computer Systems, 97, 219-235.

Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019). Edge intelligence: paving the last mile of artificial intelligence with edge computing. Proceedings of the IEEE.

Yang, H., Pan, H., & Ma, L. (2023). A review on software-defined content delivery network: A novel combination of CDN and SDN. IEEE Access.

Wang, L., et al. (2014). Big data bench: A big data benchmark suite from internet services. 2014 IEEE 20th International Symposium on High-Performance Computer Architecture (HPCA). IEEE.

Wang, P., Yao, C., Zheng, Z., Sun, G., & Song, L. (2019). Joint task assignment, transmission, and computing resource allocation in multi-layer mobile edge computing systems. IEEE Internet of Things Journal.

Sahni, Y., Cao, J., & Yang, L. (2019). Data-aware task allocation for achieving low latency in collaborative edge computing. IEEE Internet of Things Journal.

Ren, J., He, Y., Huang, G., Yu, G., Cai, Y., & Zhang, Z. (2019). An edge-computing-based architecture for mobile augmented reality. IEEE Network.

Ning, Z., Kong, X., Xia, F., Hou, W., & Wang, X. (2019). Green and sustainable cloud of things: Enabling collaborative edge computing. IEEE Communications Magazine, 57(1), 72-78.

Low, Y. (2013). GraphLab: A distributed abstraction for large-scale machine learning [Dissertation]. University of California, Berkeley.

Ren, S. Q., He, K. M., Girshick, R., & Sun, J. (2017). Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), 1137–1149.

Luong, M. T., Pham, H., & Manning, C. D. (2015). Effective approaches to attention-based neural machine translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (pp. 1412–1421). Association for Computational Linguistics.

Wu, Y. H., Schuster, M., Chen, Z. F., et al. (2016). Google’s neural machine translation system: Bridging the gap between human and machine translation. arXiv:1609.08144.

Hinton, G., Deng, L., Yu, D., Dahl, G. E., Mohamed, A. R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T. N., & Kingsbury, B. (2012). Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine, 29(6), 82–97.

Sanchez-Gonzalez, A., Heess, N., Springenberg, J. T., Merel, J., Riedmiller, M., Hadsell, R., & Battaglia, P. (2018). Graph networks as learnable physics engines for inference and control. In Proceedings of the 35th International Conference on Machine Learning (pp. 4470–4479). PMLR.

Battaglia, P. W., Pascanu, R., Lai, M., Rezende, D. J., & Kavukcuoglu, K. (2016). Interaction networks for learning about objects, relations, and physics. In Proceedings of the 30th International Conference on Neural Information Processing Systems (pp. 4509–4517). NIPS.

Hamilton, W. L., Ying, R., & Leskovec, J. (2017). Representation learning on graphs: Methods and applications. IEEE Data Engineering Bulletin, 40(1), 52–74.

Brandes, U., Gaertler, M., & Wagner, D. (2003). Experiments on graph clustering algorithms. In Proceedings of the 11th European Symposium on Algorithms (pp. 568–579). Springer.

Fout, A., Byrd, J., Shariat, B., & Ben-Hur, A. (2017). Protein interface prediction using graph convolutional networks. In Proceedings of the 31st International Conference on Neural Information Processing Systems (pp. 6533–6542). NIPS.

Jeong, C., Jang, S., Park, E., & Choi, S. (2020). A context-aware citation recommendation model with BERT and graph convolutional networks. Scientometrics, 124(3), 1907–1922.

Malewicz, G., Austern, M. H., Bik, A. J. C., et al. (2010). Pregel: A system for large-scale graph processing. In Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data (pp. 135-146). ACM.

Valiant, L. G. (1990). A bridging model for parallel computing. Communications of the ACM, 33(8), 103-111.

Avery, C. (2011). Giraph: Large-scale graph processing infrastructure on hadoop. Proceedings of the Hadoop Summit, 11(3), 5-9.

Neo4j, Inc. (2022). Neo4j graph database platform. Retrieved from https://neo4j.com/

Salihoglu, S., & Widom, J. (2013). GPS: A graph processing system. In Proceedings of the 25th International Conference on Scientific and Statistical Database Management, 22.

Seo, S., Yoon, E. J., Kim, J., et al. (2010). Hama: An efficient matrix computation with the MapReduce framework. In Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science (pp. 721-726).

Zhou, C., Gao, J., Sun, B., et al. (2014). MOCgraph: Scalable distributed graph processing using message online computing. VLDB Endowment, 8(4), 377-388.

Yan, D., Cheng, J., Lu, Y., et al. (2014). Blogel: A block-centric framework for distributed computing on real-world graphs. VLDB Endowment, 7(14), 1981-1992.

Quamar, A., Deshpande, A., & Lin, J. (2016). NScale: neighborhood centric large-scale graph analytics in the cloud. The VLDB Journal, 25(2), 125-150.

Low, Y., Gonzalez, J. E., Kyrola, A., et al. (2014). GraphLab: A new framework for parallel machine learning. Computer Science, 1408.2041.

Low, Y., Bickson, D., Gonzalez, J., et al. (2012). Distributed GraphLab: A framework for machine learning and data mining in the cloud. VLDB Endowment, 5(8), 716-727.

Xie, C., Chen, R., Guan, H., et al. (2015). Sync or async: time to fuse for distributed graph-parallel computing. ACM SIGPLAN Notices, 50(8), 194-204.

Gonzalez, J. E., Xin, R. S., Dave, A., et al. (2014). GraphX: Graph processing in a distributed dataflow framework. In Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (pp. 599-613).

Stutz, P., Strebel, D., Bernstein, A., et al. (2016). Signal/Collect. Semantic Web, 7(2), 139-166.

Zhang, Y., Gao, Q., Gao, L., et al. (2014). Maiter: An asynchronous graph processing framework for delta-based accumulative iterative computing. IEEE Transactions on Parallel and Distributed Systems, 25(8), 2091-2100.

Ding, X., Chen, R., & Chen, H. (2015). Hybrid computing mode in distributed graph computing framework. Journal of Chinese Computer Systems, 36(4), 665-670.

Jing, N., Xue, J., Qu, Z., et al. (2014). SpecGraph: A distributed graph processing system for dynamic result based on concurrent speculative execution. Journal of Computer Research and Development, (S1), 155-160.

Shao, B., Wang, H., & Li, Y. (2013). Trinity: A distributed graph engine on a memory cloud. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data (pp. 505-516).