The info-sphere today is already a highly delusional place and news can be often contradictory, even from day to day especially by outlets like BCC who is more focused on setting global narratives, not being a reporter of facts as best understood at the moment. No wonder AI would be confused, most readers are confused when navigating every statement made by experts or anonymous officials on every subject. Seems like this study really measured an AI models ability to vomit out the same text in different words and avoiding using any outside context be it accurate or hallucination.
The info-sphere today is already a highly delusional place and news can be often contradictory, even from day to day especially by outlets like BCC who is more focused on setting global narratives, not being a reporter of facts as best understood at the moment. No wonder AI would be confused, most readers are confused when navigating every statement made by experts or anonymous officials on every subject. Seems like this study really measured an AI models ability to vomit out the same text in different words and avoiding using any outside context be it accurate or hallucination.