论文笔记-sign language recognition and translation

paper list to read:

• BABEL: Bodies, Action and Behavior with English Labels, CVPR2021
• Fingerspelling Detection in American Sign Language, CVPR2021
• American Sign Language fingerspelling recognition in the wild. SLT2018
• Fingerspelling recognition in the wild with iterative visual attention. ICCV2019

Fingerspelling Detection

手指拼写的作用：

• 专有名词
• 技术术语
• 缩写等没有对应手势的词汇
• 也用于强调和方便

手指拼写占ASL的 12%-35%. 这个比例比大部分手语词汇量都要大。

Fingerspelling is used for multiple purposes, including for words that do not have their own signs (such as many proper nouns, technical terms, and abbreviations) [39] but also sometimes for emphasis or expediency. Fingerspelling accounts for 12% to 35% of ASL, where it is used more than in other sign languages [40].

手指拼写对应的字母与翻译出来的英语是单调对齐的。这有点类似于翻译中的直接音译。

手指拼写的检测对于下游手语识别任务有显著提升作用。