'Self-aware' robots can learn complex tasks by watching humans. Is that a good thing?

TL;DR
Scientists have developed robots that can learn complex tasks by observing humans, adapting to changing conditions. This advancement marks a significant step in robotics, potentially transforming everyday tasks.
Key points
- Scientists use machine learning for robot task learning
- Robots can adapt to changing conditions
- Self-aware robots can perform complex household tasks
- Investment in robotics has reached billions of dollars

Scientists have used machine learning to help robots learn how to do new tasks even in changing conditions. Malte Mueller/Getty Images
Malte Mueller/Getty Images
Imagine a robot that could do your laundry, make your bed, cook your dinner, or stock the dairy section at your local grocery store. Humans have long been able to teach robots how to do individual tasks — but instructing them on these more sophisticated jobs has been an elusive goal, despite billions of dollars invested into robotics.
Science
People like extroverted robots — but they relate to the neurotic ones
Now, a team of scientists in Switzerland has made progress in the quest to invent helpful robots that can act on complex instruction from humans. The development raises questions about whether this kind of technology could someday learn not only to help humans, but to also become capable of harming them.
Inventing the personal barista
For years, robotics scientist Sthithpragya Gupta has been dreaming about the things his robot might do. "I personally want the robot to make me a coffee," says Gupta. He and his colleagues at École Polytechnique Fédérale de Lausanne — an engineering school in Switzerland — keep late hours at their lab in the Swiss Alps. "There's a lot of coffee consumption," says Gupta.
Word of the week
A play about the revolt of human workers — not machines — gave us the word 'robot'
"If I could just say 'a little bit of sugar, a bit more creamer,' stuff like that," he says. "That would be a dream come true."
A problem that robotics scientists and engineers like Gupta have long battled is that robots cannot do tasks beyond those they are specifically programmed for. Gupta uses a tennis example to explain the issue. Robots may be able to learn how to hit a backhand shot, he explains. They can backhand that ball perfectly again, and again, and again. But if conditions change — say, their opponent moves, or the light changes — it all falls apart. Humans have no problem adjusting to these kinds of changes. Teaching a robot how to adapt, though, is much more difficult.
"It's very difficult to transfer this behavior from humans to robots," says Gupta.
The Indicator from Planet Money
It's actually really hard to make a robot, guys
Until now, he hopes. Gupta and his colleagues have published a paper in the journal Science Robotics demonstrating a new way of teaching robots using machine learning, a type of artificial intelligence. The approach relies on kinematic intelligence — a robot's built-in awareness of how its own body can move safely through space.
In a video demonstrating their technology, robots with a single arm attached to a base watch as a human instructor tosses a ball into a small container. The robots then pick up the ball and copy the instructor's behavior, adjusting for their own position and accommodating their non-human bodies. Robots are then capable of transferring these skills and knowledge to other robots.
"It could be a turning point," says Robert Platt, who studies engineering and robotics at Northeastern University. Platt, who called the work a "breakthrough," noted that the field of robotics is not in widespread agreement about the path forward to creating effective robots through machine learning — but that most agree the problem these researchers are tackling is a critical one. "More people may do this in the future," he said.
Platt was hesitant to forecast any particular timeline for robots becoming widespread household accessories. "We're at a point of very fast change," he notes. " Part of the reason why I hesitate to make predictions — look what happened with large language models," he says, referring to generative AI chatbots such as ChatGPT or Claude that have been widely adopted. "We were a long way away and then all of a sudden — we weren't."
A fine line between self-awareness and consciousness
If a robot can self-correct and teach others, does that make it self-aware?
" It looks like this robot is capable of doing some very impressive feats of learning," says Susan Schneider, who studies artificial intelligence at Florida Atlantic University. "But that doesn't mean something has full-blown consciousness or inner awareness in the sense that biological beings have it."
Schneider points out that a critical distinction between robots and humans is feeling. "Consciousness is the felt quality of experience," she says. "When you sip your morning espresso shot, when you see the richness of the sunset, when you have a headache, it feels like something from the inside to be you."
But this lack of consciousness poses new questions about ethics. "It immediately raises alarm bells in any AI safety researcher's mind," says Schneider. Later versions of this kind of technology, she says, could potentially be weaponized against humans.
Researchers have taken care to include safety protocols to ensure that robots aren't able to hurt people. Even they acknowledge, however, that future development of this technology will need guardrails. " I think really soon we should have regulatory frameworks on who operates a robot and how," says Gupta.
Humans are at an inflection point with robotics, says Susan Schneider. "It's a very exciting time," she says, "and we just don't know where it's headed."
Q&A
How do robots learn complex tasks by watching humans?
Robots use machine learning techniques to observe and mimic human actions, allowing them to adapt to various tasks and environments.
What are some examples of tasks that self-aware robots can perform?
Self-aware robots can perform tasks such as doing laundry, making beds, cooking, and stocking grocery store shelves.
What challenges have scientists faced in teaching robots complex tasks?
Despite significant investment, teaching robots sophisticated tasks has been challenging due to their need for adaptability in dynamic environments.
What impact could self-aware robots have on everyday life?
Self-aware robots could significantly change daily routines by automating household chores and enhancing efficiency in various industries.








