.Attribute Medicine, Posted online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although large foreign language designs (LLMs) show promise in measured setups, a study now exposes their restrictions in real-world professional requests as well as directs the way in the direction of durable evaluation and benchmarking just before clinical use.