White House launches America.gov chatbot to navigate government services

Finding help is the easy part

A chatbot is not automatically the best way to simplify access to public services. Large language models can make mistakes and produce hallucinations, and a confident answer may be hard for users to distinguish from a correct one.

The stakes vary by query, but even routine errors can matter. Someone relying on America.gov could miss a deadline, lose access to benefits or incur a fine.

The cost of a plausible answer

The risk is not limited to government chatbots. CNN recently reported that the US military nearly began an armed operation against a Chinese ship it believed was carrying components for nuclear weapons. The mission was called off at the last moment, when the suspected threat turned out to be an AI hallucination.

A mistake by America.gov is unlikely to lead to a nuclear war. But the comparison points to a broader problem: AI-generated information can sound credible even when it is wrong, while the consequences depend on what someone does next.

I think the key question is not whether the bot can answer common questions, but how it handles cases where the answer could affect someone’s benefits, immigration status or taxes. The announcement, as described here, is quiet about how America.gov will deal with uncertainty. For a government service, that may matter more than how natural the conversation feels.