Robot Technology News
ROBO SPACE
Humans and AI: Do they work better together or alone?
illustration only
Humans and AI: Do they work better together or alone?
by Staff Writers for MIT News
Boston MA (SPX) Oct 29, 2024

The potential of human-AI collaboration has captured our imagination: a future where human creativity and AI's analytical power combine to make critical decisions and solve complex problems. But new research from the MIT Center for Collective Intelligence (CCI) suggests this vision may be much more nuanced than we once thought.

Published in Nature Human Behaviour, "When Combinations of Humans and AI Are Useful" is the first large-scale meta-analysis conducted to better understand when human-AI combinations are useful in task completion, and when they are not. Surprisingly, the research has found that combining humans and AI to complete decision-making tasks often fell short; but human-AI teams showed much potential working in combination to perform creative tasks.

The research, conducted by MIT doctoral student and CCI affiliate Michelle Vaccaro, and MIT Sloan School of Management professors Abdullah Almaatouq and Thomas Malone, arrives at a time marked by both excitement and uncertainty about AI's impact on the workforce. Instead of focusing on job displacement predictions, Malone said that he and the team wanted to explore questions they believe deserve more attention: When do humans and AI work together most effectively? And how can organizations create guidelines and guardrails to ensure these partnerships succeed?

The researchers conducted a meta-analysis of 370 results on AI and human combinations in a variety of tasks from 106 different experiments published in relevant academic journals and conference proceedings between January 2020 and June 2023. All the studies compared three different ways of performing tasks: a.) human-only systems b.) AI-only systems, and c.) human-AI collaborations. The overall goal of the meta-analysis was to understand the underlying trends revealed by the combination of the studies.

Test Outcomes
The researchers found that on average, human-AI teams performed better than humans working alone, but didn't surpass the capabilities of AI systems operating on their own.

Importantly, they did not find "human-AI synergy," which means that the average human-AI systems performed worse than the best of humans alone or AI alone on the performance metrics studied. This suggests that using either humans alone or AI systems alone would have been more effective than the human-AI collaborations studied.

"There's a prevailing assumption that integrating AI into a process will always help performance - but we show that that isn't true," said Vaccaro. "In some cases, it's beneficial to leave some tasks solely for humans, and some tasks solely for AI."

The team also identified factors affecting how well humans and AI work together. For instance, for decision-making tasks like classifying deep fakes, forecasting demand, and diagnosing medical cases, human-AI teams often underperformed against AI alone.

However, for many creative tasks, such as summarizing social media posts, answering questions in a chat, or generating new content and imagery, these collaborations were often better than the best of humans or AI working independently.

"Even though AI in recent years has mostly been used to support decision-making by analyzing large amounts of data, some of the most promising opportunities for human-AI combinations now are in supporting the creation of new content, such as text, images, music, and video," said Malone.

The team theorized that this advantage in creative endeavors stems from their dual nature: While these tasks require human talents like creativity, knowledge, and insight, they also involve repetitive work where AI excels. Designing an image, for instance, requires both artistic inspiration - where humans excel - and detailed execution - where AI often shines. In a similar vein, writing and generating many kinds of text documents requires human knowledge and insight, but also involves routine, and automated processes such as filling in boilerplate text.

"There is a lot of potential in combining humans and AI, but we need to think more critically about it," said Vaccaro. "The effectiveness is not necessarily about the baseline performance of either of them, but about how they work together and complement each other."

Optimizing collaboration
The research team believes its findings provide guidance and lessons for organizations looking to bring AI into their workplaces more effectively. For starters, Vaccaro emphasized the importance of assessing whether humans and AI are truly outperforming either humans or AI working independently.

"Many organizations may be overestimating the effectiveness of their current systems," she added. "They need to get a pulse on how well they're working.

Next, they need to evaluate where AI can help workers. The study indicates that AI can be particularly helpful in creative tasks, so organizations should explore what kinds of creative work could be ripe for the insertion of AI.

Finally, organizations need to set clear guidelines and establish robust guardrails for AI usage. They might, for example, devise processes that leverage complementary strengths. "Let AI handle the background research, pattern recognition, predictions, and data analysis, while harnessing human skills to spot nuances and apply contextual understanding," Malone suggested. In other words: "Let humans do what they do best."

Malone concluded: "As we continue to explore the potential of these collaborations, it's clear that the future lies not just in replacing humans with AI, but also in finding innovative ways for them to work together effectively."

Research Report:When Combinations of Humans and AI Are Useful

Related Links
MIT Sloan School of Management
All about the robots on Earth and beyond!

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
ROBO SPACE
CrewMate vehicle shows potential in aiding solar field workers with PV panel installations
Los Angeles CA (SPX) Oct 28, 2024
CrewMate, a semi-autonomous lift-assist vehicle created by Moog Construction, has completed a successful field trial near Niagara Falls, N.Y., showcasing its ability to support solar field workers in installing photovoltaic (PV) panels. Buffalo-based Montante Solar, specializing in the design and construction of solar projects, coordinated this trial with Moog Construction on a solar site located on a former landfill. The site's rugged terrain, with slopes up to 10 percent, provided a solid test for Cre ... read more

ROBO SPACE
US drone maker says China sanctions to hit supply chain

Israel army says drone that hit southern city was launched from Yemen

Firm showcases world's largest unmanned cargo drone

Ukraine drone attack kills one in occupied city: Moscow

ROBO SPACE
To tackle plastic scourge, Philippines makes companies pay

Seeking our future in the deep past

Amazon results beat expectations, powered by cloud

New 3D printed metal alloy enhances durability for space exploration

ROBO SPACE
KAIST develops flexible LED mask with 340 percent increase in deep skin elasticity

New magnetism insights aim to advance quantum computing and superconductors

Quantum simulator could help uncover materials for high-performance electronics

TelePIX demonstrates space-based AI Processor TetraPLEX in successful in-orbit test

ROBO SPACE
Germany to bury nuclear waste but toxic dispute unresolved

Framatome to Supply Nuclear Fuel for Hungary's Paks VVER Reactors

Czech body rejects EDF, Westinghouse nuke deal complaints

Czech body halts nuclear deal after EDF, Westinghouse cry foul

ROBO SPACE
Ex-US Marine sentenced to seven years for white supremacist plot

Iraq says killed top Islamic State group figure

Iraqi strikes killed senior Islamic State group leader: US

Colombian leader 'nervous' about threats to UN nature talks in Cali

ROBO SPACE
EU greenhouse gas emissions saw 'huge' drop in 2023

Trees and power lines flattened as Cyclone Dana hits India

Carbon cuts 'miles short' of 2030 goal: UN

World on deadline for carbon-cutting 'quantum leap': UN

ROBO SPACE
Exploring the cost and feasibility of battery-electric ships

Big increase of zinc battery lifespan could boost energy storage

EU's extra tariffs of up to 35.3% on Chinese EVs angers Beijing

Fusion energy could play a major role in the global response to climate change

ROBO SPACE
China delivers scientific payloads from reusable satellite Shijian-19 to users

China to launch 14th manned mission to Tiangong Space Station

China sets ambitious space science development goals through 2050

China successfully retrieves first reusable test satellite Shijian-19

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.