论文笔记-sign language recognition and translation

paper list to read:

  • BABEL: Bodies, Action and Behavior with English Labels, CVPR2021
  • Fingerspelling Detection in American Sign Language, CVPR2021
  • American Sign Language fingerspelling recognition in the wild. SLT2018
  • Fingerspelling recognition in the wild with iterative visual attention. ICCV2019

Fingerspelling Detection

手指拼写的作用:

  • 专有名词
  • 技术术语
  • 缩写等没有对应手势的词汇
  • 也用于强调和方便

手指拼写占ASL的 12%-35%. 这个比例比大部分手语词汇量都要大。

Fingerspelling is used for multiple purposes, including for words that do not have their own signs (such as many proper nouns, technical terms, and abbreviations) [39] but also sometimes for emphasis or expediency. Fingerspelling accounts for 12% to 35% of ASL, where it is used more than in other sign languages [40].

手指拼写对应的字母与翻译出来的英语是单调对齐的。这有点类似于翻译中的直接音译。

手指拼写的检测对于下游手语识别任务有显著提升作用。

作者

Xie Pan

发布于

2021-07-11

更新于

2021-07-11

许可协议

评论