W19: The Second Grand-Challenge and Workshop on Human Multimodal Language (Challenge-HML)

AmirAli Bagher Zadeh, Louis-Philippe Morency, Paul Pu Liang, Soujanya Poria, Ying Shen

Description Schedule External Website
Live Session: Jul 10 (13:00-21:40 GMT)
The Second Grand-Challenge and Workshop on Human Multimodal Language promotes the growth of modeling multimodal language (language, vision, acoustic) as a fundamental research area in NLP.

Time (PDT) Event Speakers
10 Jul, 6:00 AM-6:10 AM Opening Remarks Amir Zadeh
10 Jul, 6:10 AM-6:50 AM Keynote for Second Grand-Challenge and Workshop on Multimodal Language Ruslan Salakhutdinov
10 Jul, 6:50 AM-7:05 AM QA For Keynote Ruslan Salakhutdinov
10 Jul, 7:05 AM-7:20 AM AI Sensing for Robotics using Deep Learning based Visual and Language Modeling yuvaram singh
10 Jul, 7:20 AM-7:35 AM Multilogue-Net: A Context-Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation Aman Shenoy
10 Jul, 7:35 AM-7:50 AM A Multi-modal Approach to Fine-grained Opinion Mining on Video Reviews Edison Marrese-Taylor
10 Jul, 7:50 AM-8:05 AM Leveraging Multimodal Behavioral Analytics for Automated Job Interview Performance Assessment and Feedback Anumeha Agrawal
10 Jul, 8:05 AM-8:25 AM QA Session 1 - Yuvaram, Aman, Edison, Anumeha
10 Jul, 8:25 AM-8:40 AM Break 1
10 Jul, 8:40 AM-9:20 AM Keynote for Second Grand-Challenge and Workshop on Multimodal Language Rada Mihalcea
10 Jul, 9:20 AM-9:35 AM QA For Keynote Rada Mihalcea
10 Jul, 9:35 AM-9:50 AM Exploring Weaknesses of {VQA} Models through Attribution Driven Insights Shaunak Halbe
10 Jul, 9:50 AM-10:05 AM Unsupervised Online Grounding of Natural Language during Human-Robot Interactions Oliver Roesler
10 Jul, 10:05 AM-10:20 AM A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis Jean-Benoit Delbrouck
10 Jul, 10:20 AM-10:35 AM QA Session 2 - Shaunak, Oliver, Jean-Benoit
10 Jul, 10:35 AM-10:50 AM Break 2
10 Jul, 10:50 AM-11:30 AM Keynote for Second Grand-Challenge and Workshop on Multimodal Language Yejin Choi
10 Jul, 11:30 AM-11:45 AM QA For Keynote Yejin Choi
10 Jul, 11:45 AM-12:30 PM Break 3
10 Jul, 12:30 PM-12:45 PM Low Rank Fusion based Transformers for Multimodal Sequences Saurav Sahay
10 Jul, 12:45 PM-1:00 PM Audio-Visual Understanding of Passenger Intents for In-Cabin Conversational Agents Eda Okur
10 Jul, 1:00 PM-1:15 PM Cross-Modal Data Programming Enables Rapid Medical Machine Learning Jared Dunnmon
10 Jul, 1:15 PM-1:30 PM What Gives the Answer Away? Question Answering Bias Analysis on Video QA Datasets Jed Yang
10 Jul, 1:30 PM-1:45 PM QA Session 3 - Saurav, Eda, Jared, Jed
10 Jul, 1:45 PM-2:25 PM Keynote for Second Grand-Challenge and Workshop on Multimodal Language M. Ehsan Hoque
10 Jul, 2:25 PM-2:40 PM QA For Keynote Ehsan Hoque
10 Jul, 2:40 PM-2:50 PM Closing Remarks Amir Zadeh
You can open the livestream video and in a separate window.

Pre-recorded Talks