GPT-4 Vision Prompt Injection
blog.roboflow.com/gpt-4-vision-prompt-injection/?utm_campaign=Newsletter+%235+%2810%2F19%2F2023+-+%5Bsupervision-0.16.0%5D%29&utm_content=Newsletter+-+10%2F19%2F2023+-+%5Bsupervision-0.16.0%5D&utm_medium=email_action&utm_source=email
1 Users
0 Comments
1 Highlights
0 Notes
Tags
Top Highlights
Vision Prompt Injection is a brand new problem. The situation is made even more difficult by the fact that GPT-4 Vision is not open-source and we don't quite know how text and vision input affect each other. I tried techniques based on adding additional instructions in the text part and ordering the LLM to ignore potential instructions contained in the image. It seems to improve the model's behavior, at least to some extent.
Ready to highlight and find good content?
Glasp is a social web highlighter that people can highlight and organize quotes and thoughts from the web, and access other like-minded people’s learning.