I thought of @bhaggart when I scan the article, "AI as Agency without Intelligence: on ChatGPT, large language models, and other generative models". [HT Grady]
//Other than that, Mrs. Lincoln, how was the play?// [HT Grady]
//“It also highlights the limitations of these LLMs, such as their #brittleness, #unreliability, and the occasional #inability to make elementary #logical inferences or deal with simple #mathematics.”// https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4358789

However, there are cases when systems fail to adapt effectively when pushed just beyond their limits. These systems face what Woods and Branlat call decompensation: they exhaust their ability to keep up with the demands placed on them, and their performance falls sharply off of a cliff. This behavior is the opposite of resilience, and researchers call it brittleness.

https://surfingcomplexity.blog/2022/12/28/southwest-airlines-a-case-study-in-brittleness/

#design
#systemdesign
#brittleness
#resilience