HuatuoGPT-II by CUHK-Shenzhen and SRIBD Surpasses National Pharmacist Licensure Exam Benchmarks
In a recent milestone, the jointly developed second-generation HuatuoGPT (HuatuoGPT-II) by the Shenzhen Research Institute of Big Data (SRIBD) in collaboration with The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen) has achieved a triumphant feat by successfully navigating the 2023 Chinese National Pharmacist Licensure Examination. This success follows the model's outstanding performance across a spectrum of medical qualification exams, marking it as the first publicly acknowledged medical LLM in China to achieve this feat. Notably, it has demonstrated particularly promising results in various Chinese medical contexts, surpassing even the renowned GPT-4.
This milestone not only illustrates the robust capabilities of HuatuoGPT in the medical realm but also signifies the immense potential AI holds in healthcare industry. As of 20th November, hundreds of thousands of users have interacted with HuatuoGPT, leading the way in both domestic and international circles.
Access from:https://www.huatuogpt.cn/。(Please notice that it is not suggested to utilize the results for any potential diagnosis or treatment. It is only designed to facilitate users' understanding of the boundaries of AI models' capabilities)
The team from Shenzhen Institute of Big Data(CUHK-Shenzhen) ranks fourteenth globally among universities
[1] Zhihong Chen, Feng Jiang, Junying Chen, Tiannan Wang, Fei Yu, Guiming Chen, Hongbo Zhang, Juhao Liang, Chen Zhang, Zhiyi Zhang, Jianquan Li, Xiang Wan, Benyou Wang, Haizhou Li. Phoenix: Democratizing ChatGPT across Languages. https://arxiv.org/abs/2304.10453
[2] Hongbo Zhang, Junying Chen, Feng Jiang, Fei Yu, Zhihong Chen, Jianquan Li, Guiming Chen, Xiangbo Wu, Zhiyi Zhang, Qingying Xiao, Xiang Wan, Benyou Wang, Haizhou Li. HuatuoGPT, towards Taming Language Model to Be a Doctor. Findings of EMNLP 2023.
[3] Huang Huang, Fei Yu, Jianqing Zhu, Xuening Sun, Hao Cheng, Dingjie Song, Zhihong Chen, Abdulmohsen Alharthi, Bang An, Ziche Liu, Zhiyi Zhang, Junying Chen, Jianquan Li, Benyou Wang, Lian Zhang, Ruoyu Sun, Xiang Wan, Haizhou Li, Jinchao Xu. AceGPT, Localizing Large Language Models in Arabic. https://arxiv.org/abs/2309.12053
[4] Xidong Wang, Guiming Hardy Chen, Dingjie Song, Zhiyi Zhang, Zhihong Chen, Qingying Xiao, Feng Jiang, Jianquan Li, Xiang Wan, Benyou Wang, Haizhou Li. CMB: A Comprehensive Medical Benchmark in Chinese. https://arxiv.org/abs/2308.08833