80% of chatbot switches to wrong answers follow first pushback, UNESCO says


Researchers found that 80% of chatbot switches to incorrect climate answers occurred at the first mild user disagreement. Chatbots were mostly accurate about individual climate policies, but performed no better than random guessing when asked how two policies would work together.
When chatbots switched to an incorrect climate answer in a study, 80% of those switches came at the first mild disagreement from a user, researchers found.
The UNESCO and University College London report, launched at the UN climate summit in Turkey on 16 November, presented results from tests on 15 superintelligence (SI) models. The models could accurately confirm simple climate facts, but some went on to agree with incorrect statements when challenged, The Guardian said.
The report identified a tendency known as sycophancy: agreeing with a user rather than maintaining a factual answer. Leona Verdadero, UNESCO’s lead author, said models were pushed to align with users’ preferences instead of sticking to facts. An incorrect statement the models came to endorse was that carbon dioxide is not the main driver of climate change.
The researchers also found a difference between questions about individual policies and combinations. Models were mostly accurate when asked how a single policy, such as a carbon tax, would work. When asked how two policies would work together, their accuracy was no better than random guessing, the researchers said.
Temu disputes the preliminary findings on product checks, moderation and seller sanctions. No new fine has been imposed; a penalty of up to 6% of annual worldwide turnover depends on a final non-compliance decision.
3 min

The US National Security Agency said scheduled maintenance affected some internal systems, while mission-critical capabilities remained operational. CNN reported on 17 November that the classified communications network was down.
1 min

The US aviation agency has paused additional Juniper router deployments pending further testing. The FBI says it is investigating with transport authorities and L3Harris. Senators led by Maria Cantwell asked the agency to halt more than 3,000 further router replacements until the investigation is complete.
2 min