“Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease,” they added. “We term this condition Model Autophagy Disorder (MAD).”
Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.
People in this thread seem really eager to jump to any “aha, AIs aren’t intelligent after all” conclusions they can grab hold of. This experiment isn’t analogous to anything that we put real people or animals through and seems like a relatively straightforward thing to correct for in future AI training.