I think it illustrates that the AI tends to write tests where it already anticipates and tries to fix potential issues, which absolutely goes against the use of tests!

LLMs just generate “statistically probable” text, all it’s doing is generating text that looks like how you’d write tests, they may or may not actually test anything.