研究生学术报告预告登记(开题、中期、答辩)

       为加强研究生学术交流活动,推进学术创新,特开通“研究生学术报告预告区”。我校研究生和教师可以在预告区及时发布和了解有关研究生学术报告的信息,届时参加。也可就某学术报告展开专题讨论与交流。

报告人: 金钢
学号: 1017227001
学院: 海洋学院
报告类型: 其他学术报告
日期: 13 November 2019
时间: 3:00 PM
地点: 卫津路校区第八教学楼307会议室
导师: 翟京生
题目: Transforming Neural Sign Language Translation
内容提要:

Current natural language processing research is primarily focused on spoken languages,e.g.,English,Mandarin,German,etc.With the Advent of the smart speaker and voice-activated digital assistants,There is a renewed focus on speech recognition.However,such language technology inherently excludes deaf and mute users,thereby Motivating the importance of sign language recognition/translation

research.Existing sign language translation(SLT)methods typi-Cally treat the problem as one of video captioning and just extract 。The features directly from the whole image or just the dominant hand.However,in reality,important linguistic information is conTained in the facial expression and non-dominant hand’sgestures.

Existing approaches also only make use of RNNs,which may fail to Sufciently model long range dependencies.To address this gap,we Propose a model consisting of a three-stream 3D-CNN to capture The local spatiotemporal features of signing and a Transformer to Decode the sentence from the spatiotemporal features.We conduct

Experiments on a large scale benchmark dataset to investigate the Efectiveness of our proposed local features and decoder for signLanguage translation.

图片:
登记人: 金钢
登记时间: Friday, 26 March 2021, 11:02 AM