Zhai R, Li Z Z, Hou G Y,et al. Research on Optical Network of Intelligent Computing Center based on Ethernet Lossless Networking[J]. Study on Optical Communications, 2024(5):240028.
Zhai R, Li Z Z, Hou G Y,et al. Research on Optical Network of Intelligent Computing Center based on Ethernet Lossless Networking[J]. Study on Optical Communications, 2024(5):240028. DOI: 10.13756/j.gtxyj.2024.240028.
Research on Optical Network of Intelligent Computing Center based on Ethernet Lossless Networking
Artificial Intelligence Generated Content(AIGC)has set off the artificial intelligence revolution. The network connection of the Intelligent Computing Center(ICC)has also developed in the direction of ultra-high bandwidth
intelligent lossless
and computing network convergence. Therefore
the optical network of the ICC needs to reduce the inter-card communication time in order to improve the efficiency of data access.
【Methods】
2
The paper addresses the networking architecture of optical networks for ICC scenarios to realize a lossless network with large bandwidth
low latency and high Central Processor Unit (CPU) efficiency
which can satisfy the demand of large model training and reasoning in ICC. This paper analyzes in detail the traffic distribution characteristics of the ICC and the communication flow characteristics under the AI large model training networking scenario. It also conducts in-depth research on the technologies such as Ethernet lossless network based on Remote Direct Memory Access(RDMA) technology and optoelectronic co-encapsulation. Finally it carries out the networking practice and latency test under the ICC scenario.
【Results】
2
The RDMA over Converged Ethernet(RoCE)-based transport scheme proposed in this paper has the capabilities of priority-based flow control
displaying congestion notification
enhanced transport selection and data center bridge capability switching protocols
which can realize lossless transmission based on Ethernet protocols in data centers. The test results in this paper show that the transmission delay using the RoCE protocol is approximately stable at around 1 μs and significantly outperforms the Internet Wide Area RDMA Protocol(iWARP).
【Conclusion】
2
In this paper
based on the traffic characterization in the intelligent computing scenario
we have studied the key characteristics of the lossless Ethernet network in the ICC
and used the RDMA technology to realize the enhancement of the transmission efficiency of the optical switching network in the scenario of the ICC. We have also put forward a lossless Ethernet network scheme under the large model inference scenario of the ICC
and explored the feasible direction for the application of the RDMA technology in the intelligent computing scenario. The proposed scheme explores a feasible direction for the application of RDMA technology in the smart computing scenario.
关键词
长距直接内存访问以太无损网络智算中心光交换
Keywords
RDMAEthernet lossless networkICCoptical switching
references
Bulloch G, Seth I, Lee C H A. ChatGPT in Surgical Research and Practice: a Threat to Academic Integrity, Authorship, and Divergent Thinking[J]. ANZ Journal of Surgery, 2023, 93(9): 2270-2271.
RFC 4297-2005, Remote Direct Memory Access (RDMA) over IP Problem Statement[S].
Buyya R, Cortes T, Jin H. High Performance Mass Storage and Parallel I/O: Technologies and Applications[M]. USA: Wiley-ieee Press, 2002.
Jin P, Huang C C. Sandwich Tree: a New Datacenter Network based on Passive Optical Devices[J]. Optical Switching and Networking, 2017, 25: 133-148.
刘爱军. 面向数据中心的光网络架构及资源优化机制研究[D]. 北京: 北京邮电大学, 2019.
Liu A J. Research on Optical Network Architectures and Resource Optimization Mechanisms for Data Centers[D]. Beijing, China: Beijing University of Posts and Telecommunications, 2019.
Rezaei N, Koohi S. Flat Ball: Dynamic Topology for Energy Management of Optical Interconnection Networks in Data Centers[J]. Optical Switching and Networking, 2023, 48: 100730.
Huang Z W. Research on Scheduling Strategy of Elephant Flow Load Balancing in Data Center Network based on SDN[J]. Journal of Chongqing University of Science and Technology (Natural Sciences Edition), 2023, 25(2): 76-81.
Liu T. Research on Big Data and Cloud Efficiency with High Performance Interconnect[J]. Telecom Engineering Technics and Standardization, 2015, 28(2): 74-77.
Zhao J H, Guo L. Intelligent Lossless Network: Optimization Strategy of Data Center Network Performance[J]. China Telecommunications Trade, 2021(S01): 67-72.
Bian L Y, Zeng Y P, Cai Y, et al. Opportunities and Challenges of Optoelectronic Co-packaging Technology in the Era of Big Data[J]. Laser and Optoelectronics Progress, 2024, 61(11): 0900006.
Fast Optical Switching for Computing-Power Interconnects
Analysis of blocking performance of the multi-wavelength optical switching without optical buffer
Optical burst switching
DWDM all optical networks and the applications of the fiber Bragg grating in DWDM networks
Related Author
ZONG Yichen
GUO Wenkui
WANG Xiaolong
WANG Fu
YIN Lin
罗风光
曹明翠
张劲松
Related Institution
National Key Laboratory of Information Photonics and Optical Communication, Beijing University of Posts and Telecommunications
Key Laboratory of Arithmetic Internet and Information Security, Shandong Province Computing Center (National Supercomputing Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences)
Shandong Provincial Basic Science Research Center (Computer Science), Shandong Provincial Key Laboratory of Computer Network