An Endeavor of Bringing Neuroscience and Computer Science in Speech and Language Research

Topic: 
An Endeavor of Bringing Neuroscience and Computer Science in Speech and Language Research
Date & Time: 
Wednesday, November 29, 2017 - 16:00 to 17:30
Speaker: 
Xing Tian, Assistant Professor of Neural and Cognitive Sciences & Zheng Zhang, Professor of Computer Science
Location: 
Room 210, NYU Shanghai | 1555 Century Avenue, Pudong New Area, Shanghai

Abstract:

We introduce our recent awarded research proposal that aims to bring speech and language research in neuroscience and computer science. Current artificial intelligence (AI), especially in nature language processing (NLP) is heavily relying on extracting statistical regularity of texts or sounds to mimic human linguistic behavior, but largely independent from the true cognitive processes in our brain. To achieve the “Strong AI" that closely resembles our human intelligence, computer science models need to approximate cognitive processes. We approach this problem from two aspects (representation and computation) in five levels of analysis in linguistic research (lexical/semantics, syntax, syntax semantics interaction, speech, and neural disorder and network). We hope this endeavor provides benefits in both disciplines – 1) to update AI models by integrating cognitive neuroscience mechanisms and 2) to advance understanding of neural mechanisms by the inspiration from computer science. We present a study at the semantic level as an example. Different computer science models can generate distinct semantic spaces from text corpus to represent the meaning of words. However, which model is closer to the true semantic representation in our brain? We evaluate computer semantic models by a neural measure of semantic distance – N400. Preliminary results of correlation between the semantic distance generated by computer science models and neural measures have a clear dynamics and spatial distribution, suggesting the possible connection of semantic representation across disciplines.


NYU Shanghai STEM seminar series is a weekly seminar series on every Wednesday. Please see below schedule of STEM seminar series in 2017 Fall Semester.

  • October 11: Gerard Ben Arous, Professor of Mathematics
  • October 18: Gus Xia, Assistant Professor of Computer Science
  • October 25: Brad Weslake, Associate Professor of Philosophy
  • November 1: William Glover, Assistant Professor of Chemistry
  • November 8: Roberto Fernandez, Daniel Kious and Weijun Xu, NYU Shanghai
  • November 15: Tim Byrnes, Assistant Professor of Physics
  • November 29: Xing Tian, Assistant Professor of Neural and Cognitive Sciences & Zheng Zhang, Professor of Computer Science
  • December 6: Yves Le Jan, Visiting Professor of Mathematics
Location & Details: 

To our visitors

  • RSVP may be required for this event.  Please check event details
  • Visitors will need to present a photo ID at the entrance
  • There is no public parking on campus
  • Entrance only through the South Lobby (1555 Century Avenue) 
  • Taxi card
  • Metro: Century Avenue Station, Metro Lines 2/4/6/9 Exit 6 in location B
  • Bus: Century Avenue at Pudian Road, Bus Lines 169/987