I am trying to extract the SHAP values of VisualBert for "vqa" tasks. On SHAP official documentation there are examples for only text classification . but i don`t know how to extract SHAP values for visualBert. Can anyone help?
I tried pipeline method to for SHAP values like: `
bert_tokenizer = BertTokenizerFast.from_pretrained("bert-base-uncased")
visualbert_vqa = VisualBertForQuestionAnswering.from_pretrained("uclanlp/visualbert-vqa")
from transformers import pipeline
pipe = pipeline("visual-question-answering", model=visualbert_vqa, tokenizer=bert_tokenizer)
` But there was an error: "The model 'VisualBertForQuestionAnswering' is not supported for visual-question-answering. Supported models are ['ViltForQuestionAnswering']."
Is there any other method to get the SHAP values of visualBert on any task. Thanks in advance.
