
浏览全部资源
扫码关注微信
中国联合网络通信有限公司山东省分公司,济南 250002
翟锐,博士,E-mail:zhair@chinaunicom.cn
纸质出版日期:2024-10-10,
收稿日期:2024-02-06,
修回日期:2024-03-21,
移动端阅览
翟锐,李壮志,侯广营,等. 基于以太无损网络的智算中心光网络架构研究[J]. 光通信研究,2024(5):240028.
Zhai R, Li Z Z, Hou G Y,et al. Research on Optical Network of Intelligent Computing Center based on Ethernet Lossless Networking[J]. Study on Optical Communications, 2024(5):240028.
翟锐,李壮志,侯广营,等. 基于以太无损网络的智算中心光网络架构研究[J]. 光通信研究,2024(5):240028. DOI: 10.13756/j.gtxyj.2024.240028.
Zhai R, Li Z Z, Hou G Y,et al. Research on Optical Network of Intelligent Computing Center based on Ethernet Lossless Networking[J]. Study on Optical Communications, 2024(5):240028. DOI: 10.13756/j.gtxyj.2024.240028.
【目的】
2
近年来,生成式人工智能(AIGC)掀起了人工智能革命,智算中心(ICC)的网络联接也随之向超高带宽、智能无损和算网融合等方向发展,因此ICC光网络需要降低卡间通信时间,以提升数据访问效率。
【方法】
2
文章针对ICC场景光网络的组网架构进行了研究,实现了大带宽、低时延和中央处理器(CPU)效率高的无损网络,满足了ICC的大模型训练和推理需求。文章详细分析了ICC的流量分布特征和人工智能(AI)大模型训练组网场景下的通信流特征,深入研究了基于远程直接内存访问(RDMA)的以太无损传输方案的ICC组网架构,并最终在ICC场景下进行了组网实践和时延测试。
【结果】
2
文章提出的基于以太网的RDMA(RoCE)传输方案具备基于优先级的流控制、显示拥塞通知、增强传输选择和数据中心桥能力交换协议(DCBX)等能力,可实现数据中心内基于以太协议的无损传输。测试结果显示,使用RoCE协议的传输时延大约稳定在1 μs,并且显著优于互联网广域RDMA协议(iWARP)。
【结论】
2
文章基于智算场景下的流量特征分析,深入研究了ICC的无损以太网络关键特性,利用RDMA技术实现了ICC场景下光交换网络传输效率的提升,并提出了一种在ICC大模型推理场景下的无损以太网络方案,为RDMA技术在智算场景下的应用探索出了可行的方向。
【Objective】
2
In recent years
Artificial Intelligence Generated Content(AIGC)has set off the artificial intelligence revolution. The network connection of the Intelligent Computing Center(ICC)has also developed in the direction of ultra-high bandwidth
intelligent lossless
and computing network convergence. Therefore
the optical network of the ICC needs to reduce the inter-card communication time in order to improve the efficiency of data access.
【Methods】
2
The paper addresses the networking architecture of optical networks for ICC scenarios to realize a lossless network with large bandwidth
low latency and high Central Processor Unit (CPU) efficiency
which can satisfy the demand of large model training and reasoning in ICC. This paper analyzes in detail the traffic distribution characteristics of the ICC and the communication flow characteristics under the AI large model training networking scenario. It also conducts in-depth research on the technologies such as Ethernet lossless network based on Remote Direct Memory Access(RDMA) technology and optoelectronic co-encapsulation. Finally it carries out the networking practice and latency test under the ICC scenario.
【Results】
2
The RDMA over Converged Ethernet(RoCE)-based transport scheme proposed in this paper has the capabilities of priority-based flow control
displaying congestion notification
enhanced transport selection and data center bridge capability switching protocols
which can realize lossless transmission based on Ethernet protocols in data centers. The test results in this paper show that the transmission delay using the RoCE protocol is approximately stable at around 1 μs and significantly outperforms the Internet Wide Area RDMA Protocol(iWARP).
【Conclusion】
2
In this paper
based on the traffic characterization in the intelligent computing scenario
we have studied the key characteristics of the lossless Ethernet network in the ICC
and used the RDMA technology to realize the enhancement of the transmission efficiency of the optical switching network in the scenario of the ICC. We have also put forward a lossless Ethernet network scheme under the large model inference scenario of the ICC
and explored the feasible direction for the application of the RDMA technology in the intelligent computing scenario. The proposed scheme explores a feasible direction for the application of RDMA technology in the smart computing scenario.
长距直接内存访问以太无损网络智算中心光交换
RDMAEthernet lossless networkICCoptical switching
Bulloch G, Seth I, Lee C H A. ChatGPT in Surgical Research and Practice: a Threat to Academic Integrity, Authorship, and Divergent Thinking[J]. ANZ Journal of Surgery, 2023, 93(9): 2270-2271.
RFC 4297-2005, Remote Direct Memory Access (RDMA) over IP Problem Statement[S].
Buyya R, Cortes T, Jin H. High Performance Mass Storage and Parallel I/O: Technologies and Applications[M]. USA: Wiley-ieee Press, 2002.
Jin P, Huang C C. Sandwich Tree: a New Datacenter Network based on Passive Optical Devices[J]. Optical Switching and Networking, 2017, 25: 133-148.
刘爱军. 面向数据中心的光网络架构及资源优化机制研究[D]. 北京: 北京邮电大学, 2019.
Liu A J. Research on Optical Network Architectures and Resource Optimization Mechanisms for Data Centers[D]. Beijing, China: Beijing University of Posts and Telecommunications, 2019.
Rezaei N, Koohi S. Flat Ball: Dynamic Topology for Energy Management of Optical Interconnection Networks in Data Centers[J]. Optical Switching and Networking, 2023, 48: 100730.
黄宗伟. 基于SDN的数据中心网络大象流负载均衡调度策略研究[J]. 重庆科技学院学报(自然科学版), 2023, 25(2): 76-81.
Huang Z W. Research on Scheduling Strategy of Elephant Flow Load Balancing in Data Center Network based on SDN[J]. Journal of Chongqing University of Science and Technology (Natural Sciences Edition), 2023, 25(2): 76-81.
刘通. 支持RDMA的高速网络对大数据与云计算平台效率的影响[J]. 电信工程技术与标准化, 2015, 28(2): 74-77.
Liu T. Research on Big Data and Cloud Efficiency with High Performance Interconnect[J]. Telecom Engineering Technics and Standardization, 2015, 28(2): 74-77.
赵精华, 郭亮. 智能无损网络:数据中心网络性能优化策略[J]. 中国电信业, 2021(S01): 67-72.
Zhao J H, Guo L. Intelligent Lossless Network: Optimization Strategy of Data Center Network Performance[J]. China Telecommunications Trade, 2021(S01): 67-72.
熊青松, 张武平, 陈晋敏. 用于以太网的40 Gbit/s CFP光模块设计[J]. 光通信研究, 2012(4): 49-51.
Xiong Q S, Zhang W P, Chen J M. Design of 40 Gbit/s CFP Optical Modules for Ethernet[J]. Study on Optical Communications, 2012(4): 49-51.
郭宝增. 硅基光电器件研究进展[J]. 半导体技术, 1999, 24(1): 19-24.
Guo B Z. Research Development of Silicon-based Optoelectronic Devices[J]. Semiconductor Technology, 1999, 24(1): 19-24.
卞玲艳, 曾艳萍, 蔡莹, 等. 大数据时代光电共封技术的机遇与挑战[J]. 激光与光电子学进展, 2024, 61(9): 0900006.
Bian L Y, Zeng Y P, Cai Y, et al. Opportunities and Challenges of Optoelectronic Co-packaging Technology in the Era of Big Data[J]. Laser and Optoelectronics Progress, 2024, 61(11): 0900006.
0
浏览量
0
下载量
0
CSCD
0
CNKI被引量
关联资源
相关文章
相关作者
相关机构
鄂公网安备 42011202002092号