2 comments

  • tolugenius 25 minutes ago
    I'm curious what specific chatbots they used, a companion chatbot is quite different than say chatgpt. And I imagine the former is what children will anthropomorphize, my understand is chatgpt/gemini/the standard is more "do my homework" services. I am curious if the same mechanisms they found with children are the same or at least on the same thread line with the adults who found companions or attachment with certain models (like the gpt 4o saga).
    • wpenman 5 minutes ago
      In section 4.2 they have a figure with the models that each of the studies used that they analyzed. Overwhelmingly (28/36) it was a GPT model. Top 4 use cases for the apps were self-directed information seeking, co-authoring stories with AI, teaching science through dialogue, and eliciting children's emotional expression.
  • mmooss 1 hour ago
    Why allow anthropomorphism in LLM or any computer output, for any age group?

    A simple regulation would be that all LLM output must:

      * Explicitly identify itself as a computer
    
      * Identify the human or human org controlling it
        (e.g., 'This is Claude v8.90 software made by Anthropic.')
    
      * Not attempt to mimic humans except for entertainment
        purposes, and then clearly labeled (e.g., 'This is not
        a human. It is a computer pretending to be human for
        entertainment purposes.').
    
    What violation of those regulations would be for other than defrauding and/or manipulationg people? They are easily complied with and I don't see those regulations impacting the economic productivity gains projected for LLM use.
    • marcus_holmes 8 minutes ago
      Isn't this about children attributing human characteristics onto the LLM, rather than the LLM itself pretending to be human?

      And we do this with lots of things that are not human for children (e.g. Bluey and Peppa Pig). Do we need a "this is not a human" warning for them, too?

    • dpark 13 minutes ago
      This sounds like the kind of well-intentioned thinking that results in products that are no safer practically but are far more unpleasant to interact with. This is like the pop up every time I start my car that reminds me I should not play with the screen while I’m driving.
    • ndnichols 54 minutes ago
      Preach! Mustafa Suleyman had a great post on some of this last year: https://mustafa-suleyman.ai/seemingly-conscious-ai-is-coming
    • 4b11b4 28 minutes ago
      Seriously: for the sake of all future children, the elderly, and everyone in between
    • pixl97 52 minutes ago
      Because it makes the product mostly useless for all kinds of things?
      • windexh8er 37 minutes ago
        Care to enlighten us? Because you seem to imply you want to have a conversation about your day every time you fire up a shell.
      • ericol 28 minutes ago
        I don't need a computer to mimic a human. AT ALL

        As a matter of fact, for the line of work I do (programming, devops, the works) being conscious about the fact that I am just getting an algorithm outputting text that is probabilistically related to the input I gave it would actually be healthy for me and my mental state.

        I HATE having to say "you" when working with an LLM.

        • marcus_holmes 6 minutes ago
          I have the same urge - third-person the LLM is an it, for sure, but I'm not aware of a suitable second-person construction for talking to things. Maybe we need to invent one.
      • 4b11b4 29 minutes ago
        What world are you living in, I don't want to go there
      • mmooss 48 minutes ago
        What things? Again, I don't see any but manipulation and fraud, but I certainly could be missing some.
        • all2 28 minutes ago
          Role play, which is a huge consumer of tokens. You can glance at openrouter's usage stats and see what apps tokens are going to and what the inference content was classified as. It's quite revealing.