Thanks for the unexpectedly detailed response, Cezary! I like the discussion column you linked as well. Folks are really twisting their brains around this one, aren't they? Seems to me the qualia question is the real sticking point. An LLM could exhibit self-awareness as an emergent behavior, and it could appear to have emotions and experience qualia, but how could we tell whether it really experiences it in the sense that we do? But maybe we will wind up looking at it the other way around. It may make us humans feel better to grant AIs full personhood, preferring to err on the side of doing less evil. Though it would be a shame if we give AIs the rights of personhood before we give it to our fellow animals, who almost certainly do experience qualia.