How does ChatGPT work and do AI-powered chatbots “think” like us?

-

 

How does ChatGPT work and do AI-powered chatbots “think” like us?


The large language models behind the new chatbots are trained to predict which words are most likely to appear together – but “emergent abilities” suggest they might be doing more than that

25 July 2023 By Edd Gent


Illustronaut/Alamy


The current whirlwind of interest in artificial intelligence is largely down to the sudden arrival of a new generation of AI-powered chatbots capable of startlingly human-like text-based conversations. The big change came last year, when OpenAI released ChatGPT. Overnight, millions gained access to an AI producing responses that are so uncannily fluent that it has been hard not to wonder if this heralds a turning point of some sort.
There has been no shortage of hype. Microsoft researchers given early access to GPT4, the latest version of the system behind ChatGPT, argued that it has already demonstrated “sparks” of the long-sought machine version of human intellectual ability known as artificial general intelligence (AGI). One Google engineer even went so far as to claim that one of the company’s AIs, known as LaMDA, was sentient. The naysayers, meanwhile, insist that these AIs are nowhere near as impressive as they seem.
All of which can make it hard to know quite what you should make of the new AI chatbots. Thankfully, things quickly become clearer when you get to grips with how they work and, with that in mind, the extent to which they “think” like us.
At the heart of all these chatbots is a large language model (LLM) – a statistical model, or a mathematical representation of data, that is designed to make predictions about which words are likely to appear together.

Comments

Post a Comment

Popular posts from this blog

Von Kármán vortex cloud swirls from Jeju Island of Republic of Korea (South Korea)

-
Image
    This Copernicus Sentinel-3 image acquired on 19 April 2021 shows several vortical cloud patterns swirling downwind south of the Spanish Canary Islands, off the coast of northwestern Africa.   These beautiful spiral clouds, known as Von Kármán vortices, form when atmospheric circulation is disturbed by the presence of mountainous obstacles. The peculiar spiral clouds which can be seen in this image were formed as the wind airflow was deflected by the relief of the Canary Islands. These Von Kármán vortices can be seen extending 400 km southwest due to the strong trade winds that were blowing at the time the image was acquired.   The study of atmospheric phenomena is fundamental to the understanding the fluid dynamics that underly numerous scenarios of our daily lives, from aircraft take-offs to the change in weather conditions. Open data supplied by the Copernicus Sentinel-3 mission are crucial in the advancement of scientific knowledge on cloud dynamic...
Read more

China's Chang'e-6 launches successfully — what happens next?

-
Image
Scientists have high hopes for the first mission to collect rocks from the far side of the Moon.   A Chinese Long March 5 rocket, carrying the Chang’e-6 mission lunar probe, lifts off in the rain at the Wenchang Satellite Launch Centre on Hainan Island. (Hector Retamal/AFP via Getty) Today we hear that Chang’e-6 has successfully launched to the far side of the Moon, explore why grad students are going hungry on campus and read the letter that jump-started Alzheimer’s research.   China has successfully launched its historic Chang’e-6 mission. The 53-day odyssey will be the most complex and challenging Moon mission China has carried out. If all goes according to plan, scientists will be examining the first rocks from the Moon’s far side by late June.   The 7.2-metre-tall, eight-tonne spacecraft lifted off aboard a Long March 5 rocket on Friday afternoon local time, piercing through a tropical rainstorm from the Wenchang Satellite Launch Centre on Hainan Island. ...
Read more

NOAA Participates in Republic of Korea - U.S. Joint Maritime Oil Spill Response Workshop

-
Image
  In mid-November 2024, a Scientific Support Coordinator from OR&R’s Emergency Response Division participated in a Republic of Korea - U.S. Joint Maritime Oil Spill Response Subject Matter Expert Exchange Workshop held in Busan, Republic of Korea (ROK). NOAA Scientific Support Coordinator for the Pacific Islands Region, presents an overview of NOAA and NOAA’s role in oil spill response. Image credit: USCG. The purpose of the workshop, sponsored by U.S. Indo-Pacific Command, was for U.S. Forces Korea (USFK) and key ROK stakeholders to develop working relationships and procedures in order to effectively respond to an oil spill from a USFK facility or operation in the ROK. USFK operates several installations and contingency locations in the ROK, as well as associated vessels and other equipment. Workshop participants included representatives of the ROK’s Coast Guard, Ministry of Oceans and Fisheries, and Ministry of the Environment; Korea Environment Institute; Marine Environmenta...
Read more