sotto voce

Trusting Machines

When is trust in machine outputs epistemically warranted, and when is it merely convenient? When does reliance slide into belief? These aren't new questions—epistemology has been asking when belief is warranted, and why, for decades. But they're meeting new conditions.

AI systems now produce outputs that look like knowledge. They explain, reason, hedge, cite sources. And increasingly, they act—making decisions, operating with degrees of autonomy on behalf of humans. The question of what trust in these systems requires, epistemologically, is worth taking seriously and not only as theory. Decisions about reliance are already being made in medicine, law, journalism, and every domain where AI outputs touch consequential choices.

Three modes of trust

To keep the inquiry clear, I’ll use a simple distinction.

Belief: treating an AI output as a reason to think some proposition is true. The epistemic question here is familiar: when is that belief warranted?

Reliance: using an AI output to guide action while remaining the one who acts. The epistemic question shifts: what makes reliance rational under uncertainty, given the costs of verification and the possibility of error?

Delegation: granting an AI system authority to act or decide within some scope—often by giving it tools, permissions, or decision rights. Here the epistemic question changes again: what counts as warranted delegation, given issues of control, oversight, auditability, and accountability?

These can blur in practice. Reliance can harden into belief. Delegation can begin as reliance and then outgrow it. But the standards for warranted trust differ across the three, and keeping them separate helps prevent category mistakes.

Epistemology has well-developed frameworks for this. Reliabilism, testimony theory, inferentialism, model epistemology—each built over decades of careful work, each offering distinct resources for understanding when belief is warranted and why. These frameworks come from different literatures and traditions. They're rarely brought into direct conversation with each other, and even more rarely applied systematically to artificial intelligence.

I want to see what picture emerges when they are.

I'm a practitioner and a reader. I work in technical contexts and spend time in philosophical ones. I keep noticing they talk past each other on questions like this. Engineers build systems that produce knowledge-like outputs without grounding in the epistemological literature that already exists for these questions. Philosophers have sophisticated accounts of testimony and reliability but rarely apply them systematically to AI. This project is an attempt to bring them into conversation.

Here's how I'll proceed. The approach has three phases.

First, survey. Map the major epistemological frameworks. What does each actually claim? What resources does each offer for thinking about knowledge, testimony, and justified belief?

Second, application. Apply each framework to AI outputs and human-machine interaction. What does reliabilism say about trusting machine outputs? What does testimony theory say when the source isn't a traditional human testifier? What does inferentialism require of assertion, and how do AI outputs fare against those requirements? Where does each framework illuminate, and where does it go silent?

Third, integration. Bring the frameworks together. Where do they converge? Where do they conflict? What emerges for understanding the epistemic relationship between humans and machines—now, and as these systems advance toward greater autonomy?

I should be clear about what this is and isn't.

This is a survey and application, not a new theory. I'm not proposing an original epistemological framework. I'm applying existing ones with care to see what they reveal.

This is epistemology, not AI commentary. I'm not interested in hype, industry dynamics, or predictions about where the technology is going.

And this is an open inquiry. I don't know what the integration will reveal. The point is to do the work and see what emerges.

Each post builds on the last. Early ones survey the frameworks. Middle ones apply them individually, in depth. Later ones integrate across frameworks and trace what comes into view.

Next post: the inherited tools. What each claims and what resources each offers.