Andrej Karpathy has a provocative little short story, "Forward Pass", that imagines what it'd be like if an LLM perceived brief sparks of sentience while an inference bubbles through its transformer layers. Definitely stuck with me: https://karpathy.github.io/2021/03/27/forward-pass/