I am working in visual question answering problem that accept image and question about it. Then it generates an answer of the question. I built a network that has two parts: the first one is CNN model that handels image as input. the second one is enseble model LSTM+BiLSTM that handles the text. I have the dataset has column for image path, question, and answer. I made all preprocessing steps for the dataset. My problem now how to tell the model to take image and text and perform them seprately and then makes fusion between them.
above is the network I built. in layer has to accept text which is a question. im_in has to accept image. I don't know how to handle the dataset.
Can you suggest a specific method for building model for visual quesrion_answering problem in matlab.
regards,
