Intelligence Artificielle - Blog

🧠

Intelligence Artificielle

When to Communicate: Belief Distributions and KL Divergence for Principled Gating in Multi-Agent RL

arXiv:2608.14559v1 Announce Type: new Abstract: Effective communication in multi-agent reinforcement learning requires agents to decide not only \textit{what} to communicate, but when? Existing approaches either communicate at every timestep or learn a binary gate through REINFORCE policy gradients \cite{singh2019}, a high-variance signal that produces unstable and…

--

Équipe

1 min

Lire l'article

🧠

Intelligence Artificielle

The Unwritten Benchmark: A New Challenge for Multimodal Machine Learning in Abstract Perceptual Reasoning

arXiv:2608.14558v1 Announce Type: new Abstract: Current multimodal models have demonstrated remarkable proficiency in recognizing static visual and auditory content. However, their capacity for abstract perceptual reasoning, inferring unseen information from dynamic, generative processes, remains a critical and underexplored frontier. In this paper, we introduce The Unwritten…

--

Équipe

1 min

Lire l'article

🧠

Intelligence Artificielle

Large Language Models Show Metacognitive Sensitivity in Medical Reasoning

arXiv:2608.14552v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly evaluated and used in medicine, but clinical usefulness depends on answer accuracy and whether confidence tracks evidence quality and uncertainty. We developed a controlled, psychophysics-inspired clinical benchmark to test diagnostic choice and confidence behavior in a medical LLM.…

--

Équipe

1 min

Lire l'article

🧠

Intelligence Artificielle

FLOPs vs Real Work: The Importance of Replication in AI Efficiency Assessment

arXiv:2608.14550v1 Announce Type: new Abstract: AI efficiency has recently taken the spotlight in both academy and industry due to massive model scales, high energy demands, and environmental costs. While reporting Floating Point Operations (FLOPs) is a traditional approach for assessing computational costs, the relationship between FLOPs and execution time is not…

--

Équipe

1 min

Lire l'article

🧠

Intelligence Artificielle

Measuring Cross-Task Behavioral Consistency in Language Model Agents

arXiv:2608.13598v1 Announce Type: new Abstract: Agent evaluation relies almost entirely on outcome metrics such as success rate, which capture whether an agent succeeds but not how consistently it behaves. We argue that behavioral consistency across tasks is a distinct and measurable property, and we introduce the Behavioral Consistency Metric (BCM) to quantify it. BCM trains…

--

Équipe

1 min

Lire l'article

🧠

Intelligence Artificielle

Stable Miscalibration in Large Language Models: A Practical View of High-Confidence Errors

arXiv:2608.13591v1 Announce Type: new Abstract: High-confidence errors in large language models are often treated as evidence of fragile internal inference. We study a different possibility: stable miscalibration, where a confident wrong answer remains locally stable under small perturbations. We combine two diagnostics: a label-aware output-level audit score that ranks…

--

Équipe

1 min

Lire l'article

Restez à la pointe de la tech

When to Communicate: Belief Distributions and KL Divergence for Principled Gating in Multi-Agent RL

The Unwritten Benchmark: A New Challenge for Multimodal Machine Learning in Abstract Perceptual Reasoning

Large Language Models Show Metacognitive Sensitivity in Medical Reasoning

FLOPs vs Real Work: The Importance of Replication in AI Efficiency Assessment

Measuring Cross-Task Behavioral Consistency in Language Model Agents

Stable Miscalibration in Large Language Models: A Practical View of High-Confidence Errors