首页 > 软件资讯 > 《中国人工智能安全承诺框架》发布

《中国人工智能安全承诺框架》发布

时间:2025-08-01 12:53:05

xiayx 7月30日消息,2025 世界人工智能大会暨人工智能全球治理高级别会议“人工智能发展与安全”全体会议 7 月 26 日下午在上海召开。会议由中国人工智能发展与安全研究网络(以下简称“研究网络”,CnAISDA)主办。上海市委常委、常务副市长吴伟,国家发展和改革委员会创新驱动发展中心主任霍福鹏出席并致辞。

杰弗里辛顿、姚期智、约书亚本吉奥和大卫帕特森四位图灵奖得主以及位国内外顶尖专家出席了此次会议,共同探讨了人工智能的安全发展与缩小智能鸿沟等前沿议题。与会者积极寻求国际合作路径来促进人工智能安全治理的发展。

中国科学院大学信息工程学院院长、中国人工智能产业发展联盟(AIIA)副秘书长李红涛博士发表了关于“人工智能领域的未来发展趋势”主题演讲。他强调了技术创新与伦理道德并重的重要性,并指出未来的人工智能将深刻改变我们的生活和工作方式。李红涛博士还介绍了近年来在人工智能领域取得的突破性成果,并展望了这些技术在未来可能带来的变革。

该框架在AIIA人工智能安全承诺(预计发布)的基础上,新增了加强人工智能安全治理国际合作、防范前沿人工智能安全风险等内容,彰显了中国产业界与全球各方紧密合作的决心,共同推动人工智能的健康发展。

接下来,中国信息通信研究院作为“研究网络”成员与AIIA秘书处单位,将携手签署企业共同推进框架落地实践,促进我国人工智能健康发展,同时积极参与国际治理合作,贡献中国智慧与中国力量,在确保全球人工智能安全治理方面发挥积极作用。

xiayx附《框架》中英文全文:

中国人工智能安全承诺框架

CHINA ARTIFICIAL INTELLIGENCE SECURITY AND SAFETY COMMITMENTS FRAMEWORK

随着全球范围内的科技浪潮迅猛来袭,人工智能技术逐渐成为推动经济社会发展的重要引擎。其带来的技术红利不仅显著提升了生产效率,也深刻改变了人们的生活方式和工作模式。然而,我们也不得不正视和面对的是,人工智能发展过程中可能带来的一些难以预测的风险与挑战。为抓住新的发展机遇并确保AI技术的健康有序发展,中国人工智能领域内的研究与安全专家们联合倡议了中国人工智能安全承诺框架这一重要文件。该倡议以产业自律的方式为核心,旨在通过高水平的安全保障措施来推动高质量的人工智能应用,共同促进我国人工智能产业的稳健发展。这项倡议由中国信息通信研究院作为牵头单位,得到了广泛的社会支持和积极响应。我们深知,自律承诺不仅是获得公众信任的关键所在,更是确保技术边界、规范行业行为的重要基石。因此,我们将本承诺视为行动准则,并诚邀社会各界进行监督与反馈,以不断提升我们的能力和透明度,最终促进人工智能技术的正确使用和发展。通过这一倡议,我们不仅希望为人类社会带来更加智能和便捷的生活体验,同时也期待携手全球合作伙伴共同应对挑战,推动人工智能技术安全、可持续地发展。

The wave of artificial intelligence (AI) is sweeping across the globe, actively generating technological dividends and exerting profound influence on global economic and social development as well as the progress of human civilization. At the same time, we are keenly aware that AI brings about unpredictable risks and complex challenges. To seize this new round of development opportunities, members of China AI Safety and Development Association (CnAISDA) solemnly launch the AI Security and Safety Commitments. Through industry self-regulation, we will leverage high-level security and safety measures to support high-quality development, and collaborate to promote the robust development of AI. This initiative is led and promoted by the China Academy of Information and Communications Technology (CAICT). We fully recognize that commitments to self-discipline constitute a critical foundation for gaining the trust of the international community. Guided by the Commitments as our code of conduct, and subject to the oversight of all stakeholders, we will continuously improve and refine our approach. By doing so, we will ensure that the application of AI technologies always remains people-centered and aligned with the principle of AI for good.

承诺二:成立专门的网络安全小组,建立全面的防护体系。内部设有专业的团队负责进行人工智能的风险评估、安全管理等工作,并明确了安全责任人。同时,我们主动设定合理的安全风险标准线,在开发过程中采取相应的技术手段确保系统的安全性,覆盖从设计到部署的整个生命周期,严格执行风险管理流程和措施。

Commitment I: Establish security and safety teams or organizational structures and build security and safety risk management mechanisms. Designate a leader responsible for AI security and safety, establish specialized teams to conduct AI risk assessments and safety, security and governance within the enterprise. Proactively define realistic security and safety risk baselines, adopt appropriate security and safety measures for open-source initiatives, and implement risk management practices throughout the entire AI development and deployment life cycle. Clearly outline processes and measures for risk identification and mitigation.

承诺二:深化模型安全性评估,提升模型效能与安全性保障。借助专业团队的仿真测试平台,在推出和更新AI模型前进行红队渗透测试。特别关注大模型在泛化理解能力、推理能力和决策机制上的安全性及可靠性评估,并重点分析其在工业、教育、医疗、金融、法律等多领域场景下的应用效果。

Commitment II: Conduct security and safety testing for AI models to enhance the performance, safety and reliability. Through dedicated simulation and red-teaming experts, rigorously test AI models prior to their release or update. For large models in particular, prioritize safety and reliability evaluations focusing on their general understanding, reasoning, and decision-making capabilities, as well as their performance in critical domains such as industry, education, healthcare, finance, and law.

承诺三:我们采取了切实措施来保证训练和业务数据的安全。首先,制定了全面的数据安全保护政策,并配套建立了各种防护技术手段。一旦发现任何攻击或漏洞,我们会立即进行处理并确保准确性与可靠性。对于重要的业务数据,我们将实施加密存储和严格的访问控制策略,这样可以防止未经授权的使用、泄露或输出,从而保障商业机密、用户隐私以及上传的知识库不被不当利用。这不仅保护了我们的用户,也维护了他们的权益不受侵害。

Commitment III: Implement measures to safeguard the security of training data and operational data. Establish data security protection policies and deploy corresponding technical measures to detect and promptly address data poisoning incidents, ensuring the accuracy and reliability of training data. Encrypt operational data and enforce access controls to protect business secrets, user privacy, and user-uploaded knowledge base, ensuring access is restricted to authorized use only. Prevent unauthorized outputs by AI models, thereby safeguarding data security and privacy rights.

提升基础设施安全承诺五:全面风险管理与持续监控。强化对数据加密技术和访问控制措施的实施,确保敏感信息的安全传输和存储。采用定期的风险评估工具和技术进行动态分析,识别潜在漏洞并快速响应。建立跨部门合作机制,共享信息安全情报,及时发现并修复系统中的安全弱点。加强应急准备培训,制定详细的预案,提高团队应对突发情况的能力,减少可能的负面影响。通过上述承诺,我们可以构建一个更加坚固、可靠的基础设施,有效保护企业核心信息和资产不受外界威胁。

Commitment IV: Enhance infrastructure security. Develop robust capabilities for monitoring and protecting the software and hardware used in AI system deployments. Conduct regular and dynamic security penetration tests to simulate potential risk scenarios, identify and report security vulnerabilities in the infrastructure, and assess associated risks. Establish an infrastructure security incident response mechanism, including emergency response procedures, clear accountability assignments, and post-incident improvement solutions.

承诺五:增强模型透明度在未来的版本中,我们将主动展示我们的安全治理实践措施,增加对所有利益相关方的透明度。公开解释模型的功能、适用领域以及其局限性。我们还计划通过模型说明和服务协议的方式,向公众揭示可能面临的潜在风险。

Commitment V: Enhance model transparency. Proactively disclose safety and security governance measures and improve transparency for all stakeholders. Provide clear information about the model's capabilities, applicable fields, and limitations. Inform potential risks to the public through model documentation, service agreements, or others.

承诺六:我们致力于前沿安全研究,致力于防范新兴领域的安全威胁。通过研发和部署智能向善的人工智能系统,我们将透明地向公众分享研究成果,以帮助应对社会面临的复杂挑战。同时,我们也将密切关注人工智能系统的滥用风险,特别是在高危场景中的潜在危险性,并采取有效措施加以防止。

Commitment VI: Vigorously advance frontier safety and security research, and prevent safety and security risks in frontier fields. Innovate in the development and deployment of AI systems that embody the principle of AI for good, and disclose research findings with the public transparently, contributing to addressing pressing challenges faced by society. Strengthen the assessment of risks related to the abuse of AI systems in frontier fields, and prevent potential risks of their abuse in high-risk scenarios.

承诺七:通过深化国际合作,促进科技向善,普惠应用发展。积极参与全球AI安全治理对话,共享风险识别、评估与防控经验及最佳实践。积极承担社会责任,加强科普宣传、开展技能培训,提升人工智能素养和技能水平,助力弥合智能鸿沟。

Commitment VII: Strengthen international cooperation on AI safety, security and governance, and promote inclusive, beneficial applications of AI. Actively participate in global dialogues on AI safety, security and governance, and contribute to the exchange of experiences and best practices in risk identification, assessment, and mitigation. Fulfill social responsibilities by advancing public science communication, enhancing AI education, and providing skills training to improve AI literacy and capabilities, with a focus on bridging the global intelligence divide.

热门推荐