• 中文核心期刊要目总览
  • 中国科技核心期刊
  • 中国科学引文数据库(CSCD)
  • 中国科技论文与引文数据库(CSTPCD)
  • 中国学术期刊文摘数据库(CSAD)
  • 中国学术期刊(网络版)(CNKI)
  • 中文科技期刊数据库
  • 万方数据知识服务平台
  • 中国超星期刊域出版平台
  • 国家科技学术期刊开放平台
  • 荷兰文摘与引文数据库(SCOPUS)
  • 日本科学技术振兴机构数据库(JST)

可驱动的泛化人头神经辐射场

Drivable generalized NeRF-based head model

  • 摘要: 近年来,随着计算机视觉领域的快速发展,数字人的概念引起社会各界的广泛关注,高保真的人体、人头和人手的建模都得到了深入的研究。本文关注头部建模,基于神经辐射场提出一种可泛化的人头模型。具体来说,我们结合人脸识别网络和三维面部表情数据库FaceWarehouse分别参数化身份和表情语义,并将这两者作为条件输入构建人头神经辐射场,从而提高人头模型的表达能力,同时确保渲染结果的身份和表情的可编辑性;然后,通过结合体渲染与神经渲染,我们将人头的三维表示快速呈现到二维平面上,生成人头的高保真图像。得益于精心设计的损失函数和神经辐射场良好的隐式表示能力,我们的模型不仅可以独立编辑身份和表情,而且支持自由地修改渲染结果的虚拟相机位置。我们的模型具有优秀的多视角一致性,在新视角合成、驱动等方面应用广泛。

     

    Abstract: In recent years, the concept of digital human has attracted widespread attention from all walks of life, and the modelling of high-fidelity human bodies, heads, and hands has been intensively studied. This paper focuses on head modelling and proposes a generic head parametric model based on neural radiance fields. Specifically, we first use face recognition networks and 3D facial expression database FaceWarehouse to parameterize identity and expression semantics, respectively, and use both as conditional inputs to build a neural radiance field for the human head, thereby improving the head model’s representation ability while ensuring editing capabilities for the identity and expression of the rendered results; then, through a combination of volume rendering and neural rendering, the 3D representation of the head is rapidly rendered into the 2D plane, producing a high-fidelity image of the human head. Thanks to the well-designed loss functions and good implicit representation of the neural radiance field, our model can not only edit the identity and expression independently, but also freely modify the virtual camera position of the rendering results. It has excellent multi-view consistency, and has many applications in novel view synthesis, pose driving and more.

     

/

返回文章
返回