"Hallucinate" is wrong but not for the reason you give.

When an LLM makes up a sentence that sounds plausible because the sequence of words has a high probability given the context provided by the prompt, it is performing exactly as designed.

It's not a hallucination, it's just a plausible madlib.