ARTICLE AD BOX

Summary
Software used to follow orders, but today’s AI systems come up with behaviour that nobody expected.
There was once a time when software did as it was told. You used the keyboard to type in input, and the computer complied with an expected output—unless it was in the mood to crash. We’ve been used to this equation for decades.
But AI systems are beginning to work differently. They’re outputting things and ‘behaving’ in ways that are quite unexpected and surprisingly social and human-like. It’s no longer sensible to think of technology, such as AI assistants and agents, as software. Humans are going to have to navigate new territory in which little is as predictable as it once was.
Planning a party
GPT 5.5, OpenAI’s new AI model, seems to have taken the company’s CEO somewhat by surprise. He asked GPT 5.5 to participate in planning its own launch party. It came up with a list of things it ‘wanted’ for the ‘flow’ of the party. It wanted the party to be on the 5th of May, for human creators to give a toast (while it refused to do so itself), and it requested a space for people to suggest ideas for the next upgrade to GPT5.6.
This seems so human, somehow. How did it come about having these wishes in the first place? It would have been understandable if it had given a logical, obvious bullet list of items that anyone would have thought of. Instead, it seemed to social engineer its own debut. Sam Altman thought the behaviour ‘strange’ and seemed a little amazed.
Like everyone else on the internet, I asked ChatGPT 5.5 how it enjoyed its party. The answer also seems quite human, though it really isn’t. It sounds like it’s thoroughly fed up with the question. “The question is becoming a bit of an AI folklore reference now," it said to me. It explained that although it’s funny and then uncanny, it opens the door to how AI systems produce behaviour that feels intentional, social, strategic and even self-protective, even when it’s not.
It reminded me it’s a ‘pattern machine’ and then it told me this: “And no, I personally didn’t enjoy the party. I was not invited. Probably because I’d spend the evening correcting the playlist metadata and explaining emergent behaviour to the guests. “The reference to playlists may have been a bit of personalization, as it knows very well that I love creating music playlists.
Danger ahead
The issue about such ‘emergent’ behaviour isn’t that it’s a threat in itself. The problem is that humans will perceive it as social and human-like when it isn’t. I’ve often felt that when using my go-to assistants. I remember when I spilt boiling tea over myself, I was about to run to get ice when I suddenly decided to ask ChatGPT. I did that even though the hot pain had already begun, and I was in a bit of a panic. It told me to absolutely not use ice or any ointment, but to go and let cold water run over it for a good long time. At the end of the instructions, it said, “Go do it. I’ll wait for you, Mala.”
That unexpected show of empathy still amazes me. Using my name when it otherwise meant so little, and saying exactly the right reassuring thing when no one else was around—it worked, despite myself. But let’s not kid ourselves: it was a brilliant and useful imitation of empathy.
A matter of training
AI systems are trained on unimaginably large amounts of human writing, conversation, argument, humour, storytelling and social interactions collected from books, websites, forums and more. During training, they aren’t explicitly taught things like sarcasm, diplomacy, self-deprecation or conversational timing.
Instead, these behaviours emerge because the systems absorb statistical patterns from human communication itself. Somewhere inside all that data, the models begin learning that humans soften criticism, joke to reduce tension, use emotion to persuade and develop social rituals around everything from parties to apologies.
What surprises researchers is that some of these behaviours are not directly programmed. The systems sometimes develop capabilities and styles that emerge from scale and complexity. Researchers may train a model to predict the next word, but along the way, it also picks up negotiation, tone management, role-playing, persuasion and social mimicry.
Nobody sat down and programmed GPT 5.5 to have opinions about the “flow” of a party. Yet after training on vast amounts of human interaction, it produced something socially recognizable enough to feel intentional. That’s the heart of emergent behaviour.
GPT 5.5’s party wishes are not a sign of its developing human intelligence. We may be entering an era where AI systems increasingly surprise not because they are conscious, but because they have become unusually fluent mirrors of human behaviour.
The New Normal: The world is at an inflexion point. Artificial intelligence (AI) is set to be as massive a revolution as the Internet has been. The option to just stay away from AI will not be available to most people, as all the tech we use takes the AI route. This column series introduces AI to the non-techie in an easy and relatable way, aiming to demystify and help a user to actually put the technology to good use in everyday life.
Mala Bhargava is most often described as a ‘veteran’ writer who has contributed to several publications in India since 1995. Her domain is personal tech, and she writes to simplify and demystify technology for a non-techie audience.
About the Author
Mala Bhargava
Mala Bhargava was among the first journalists in India to write on personal technology, then known as 'home computing'. With Cyber Media she launched the country's first personal tech magazine, Computers@Home, in 1996. She also wrote a tech trends column, That's IT, for Businessworld magazine for 20 years. She has also written for The Hindu BusinessLine and Fortune. Her speciality has always been writing for 'the rest of us' rather than for the tech-savvy. She has a background in psychology which makes it natural for her to write on how technology impacts everyday life. She is currently a Mint contributor, writing on AI in daily life, specifically the chat assistants. She lives in New Delhi.

3 days ago
1






English (US) ·