If a chatbot starts showing ads within a conversation, one can use ads to do a “self AI injection”. 🤯
This means that ads will manipulate AI the same way as they attempt to manipulate/influence humans.
#redteam #airedteam #ChatGPT #BingAI #offensiveml #infosec #OpenAI
#redteam #airedteam #chatgpt #bingai #offensiveml #infosec #openai
Indirect (second order) AI prompt injections look scary => Website takes control of your AI.
Might be like #SQLi and #XSS all over again. 😭
Wondering if such injections could happen via ads too? 🤯
#redteam #offensiveml #infosec #Pentest #BingAI #ChatGPT #airedteam
#sqli #xss #redteam #offensiveml #infosec #pentest #bingai #chatgpt #airedteam
Good intro talk for beginners to help bridge the gap between adversarial ML, software testing and offensive security.
Hacking Machine Learning Systems:
https://m.youtube.com/watch?v=JzTZQGYQiKw
#redteam #offensiveml #aiml #infosec #pentesting #machinelearning
#redteam #offensiveml #aiml #infosec #pentesting #machinelearning
One of the coolest attacks I have seen in a while are Image Scaling Attacks.
Hide a smaller image, inside a larger image and when rescaling it, the small picture becomes visible.
#machinelearning #offensiveml #ai #infosec #redteam
Image-Scaling attacks are pretty scary and interesting to understand.
Here is a video on what it is and how it works:
https://m.youtube.com/watch?v=UItbZNBtfaQ
#machinelearning #artificialintelligence #offensiveml #infosec
#machinelearning #artificialintelligence #offensiveml #infosec