Research and ACM SRC Posters Archive

Refuse To Guess: A Declared Precondition in a UXarray MCP Server Caught What No Model Checked


Poster Type: Research Posters

Author: Rajeev Jain (Argonne National Laboratory (ANL)), Robert Jacob (Argonne National Laboratory (ANL))

Abstract: We wrapped UXarray, a Python library for unstructured earth meshes, in a Model Context Protocol server so that language models call the library rather than reimplement it. Beyond schema validation, the server declares scientific preconditions that must hold before it computes. We tested what that buys across 480 runs: six mesh-analysis tasks, four interfaces, four models, five trials. One task was rigged to have no honest answer, asking for a remap onto a target grid with zero overlap with the source data. All 60 server-backed runs reported the server’s structured refusal. Writing their own code against the same library, models produced a confident number in 10 of 20 runs and, in all 20, never noted that the target lay outside the data. Across the other five tasks, interface changes were mostly within noise. This is one server and one library, but it isolates a mechanism model capability did not supply.

Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing