EP 3859560 A2 20210804 - METHOD AND APPARATUS FOR VISUAL QUESTION ANSWERING, COMPUTER DEVICE AND MEDIUM
Title (en)
METHOD AND APPARATUS FOR VISUAL QUESTION ANSWERING, COMPUTER DEVICE AND MEDIUM
Title (de)
VERFAHREN UND VORRICHTUNG ZUR VISUELLEN FRAGEBEANTWORTUNG, COMPUTERGERÄT UND MEDIUM
Title (fr)
PROCEDE ET APPAREIL POUR LA REPONSE VISUELLE A DES QUESTIONS, DISPOSITIF INFORMATIQUE ET SUPPORT
Publication
Application
Priority
CN 202010616632 A 20200630
Abstract (en)
The present disclosure provides a method for visual question answering, which relates to a field of computer vision and natural language processing. The method includes: acquiring an input image and an input question; constructing a Visual Graph based on the input image, wherein the Visual Graph comprises a Node Feature and an Edge Feature; updating the Node Feature by using the Node Feature and the Edge Feature to obtain an updated Visual Graph; determining a question feature based on the input question; fusing the updated Visual Graph and the question feature to obtain a fused feature; and generating a predicted answer for the input image and the input question based on the fused feature. The present disclosure further provides an apparatus for visual question answering, a computer device and a non-transitory computer-readable storage medium.
IPC 8 full level
G06F 16/532 (2019.01); G06F 16/9032 (2019.01)
CPC (source: CN EP KR US)
G06F 16/532 (2019.01 - CN EP KR US); G06F 16/58 (2019.01 - EP); G06F 16/583 (2019.01 - CN KR US); G06F 16/90332 (2019.01 - EP KR US); G06F 18/213 (2023.01 - KR); G06F 18/22 (2023.01 - CN KR); G06F 18/253 (2023.01 - EP KR US); G06F 40/279 (2020.01 - US); G06F 40/30 (2020.01 - CN EP KR); G06N 3/04 (2013.01 - US); G06N 3/044 (2023.01 - EP KR); G06N 3/045 (2023.01 - CN EP KR); G06N 3/08 (2013.01 - CN KR); G06N 3/088 (2013.01 - US); G06N 5/022 (2013.01 - EP KR); G06N 5/045 (2013.01 - CN KR); G06V 10/25 (2022.01 - EP KR US); G06V 10/40 (2022.01 - CN); G06V 10/454 (2022.01 - EP KR US); G06V 10/764 (2022.01 - EP KR US); G06V 10/806 (2022.01 - EP KR US); G06V 10/82 (2022.01 - EP KR US); G06V 20/00 (2022.01 - CN); G06V 20/62 (2022.01 - KR); G06V 2201/07 (2022.01 - KR US)
Designated contracting state (EPC)
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated extension state (EPC)
BA ME
DOCDB simple family (publication)
EP 3859560 A2 20210804; EP 3859560 A3 20211020; CN 111782840 A 20201016; CN 111782840 B 20230822; JP 2022013644 A 20220118; JP 7196218 B2 20221226; KR 20220002065 A 20220106; US 11768876 B2 20230926; US 2021406468 A1 20211230
DOCDB simple family (application)
EP 21165274 A 20210326; CN 202010616632 A 20200630; JP 2021035343 A 20210305; KR 20210026421 A 20210226; US 202117161466 A 20210128