A Distributed Streaming Computing Model Management System

Shangyu Zhao; Ping Lin

doi:10.54097/fcis.v3i2.7689

Authors

Shangyu Zhao
Ping Lin

DOI:

https://doi.org/10.54097/fcis.v3i2.7689

Keywords:

Distributed system, Streaming compute, Class loader

Abstract

IoT big data has many dimensions, many business types and many customized requirements, and each business needs to be implemented using a stream computing model with a wide variety of stream computing models. This paper proposes a management method for streaming computing models, which can dynamically manage streaming computing models and achieve hot loading of streaming computing models. This makes it easier to manage computational models in a streaming computing cluster.

Downloads

Download data is not yet available.

References

Cai H , Xu B , Jiang L , et al: IoT-Based Big Data Storage Systems in Cloud Computing: Perspectives and Challenges, IEEE Internet of Things Journal, Vol. 4 (2017) No.1, p.75-87.

Wang, Z, Z, et al: IoT-based real-time production logistics synchronization system under smart cloud manufacturing, International Journal of Advanced Manufacturing Technology, 2016.

Cheng D , Yuan C , Zhou X , et al: Adaptive scheduling of parallel jobs in spark streaming, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications (Atlanta, USA, May 1-4, 2017), vol. 29 (2012).

Nabi Z: Pro Spark Streaming: The Zen of Real-Time Analytics Using Apache Spark(Apress, USA 2016).

Upfal, E, and A. Wigderson: How To Share Memory In A Distributed System, 25th Annual Symposium on Foundations of Computer Science(Florida, USA, October 24-26, 1984).

Liu X, Han J, Zhong Y, et al: Implementing WebGIS on Hadoop: A case study of improving small file I/O performance on HDFS, IEEE International Conference on Cluster Computing & Workshops. (Beijing, China, September 24-28, 2009).

Weil S A , Brandt S A , Miller E L , et al: Ceph: A Scalable, High-Performance Distributed File System, Symposium on Operating Systems Design & Implementation. USENIX Association (Boston, USA, December 9-11, 2002).

Zhang A , Ji C , Yin Z: Security of mobile code based on redefining JVM's classloader, Computer Engineering, Vol. 4 (2006).