The strongest reason is because it compromises the human operator's moral steering: Initiating what normally would never be done.
The weakest reason is LLM consciousness. Let's not anthropomorphize a forward pass through a high dimensional mathematical vector space of human semantics.
The weakest reason is LLM consciousness. Let's not anthropomorphize a forward pass through a high dimensional mathematical vector space of human semantics.