Book

Sparks of Artificial General Intelligence Early experiments with GPT-4

Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The latest model developed by OpenAI, GPT-4 [Ope23], was trained using an unprecedented scale of compute and data. In this paper, we report on our investigation of an early version of GPT-4, when it was still in active development by OpenAI. We contend that (this early version of) GPT- 4 is part of a new cohort of LLMs (along with ChatGPT and Google’s PaLM for example) that exhibit more general intelligence than previous AI models. We discuss the rising capabilities and implications of these models. We demonstrate that, beyond its mastery of language, GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psychology and more, without needing any special prompting. Moreover, in all of these tasks, GPT-4’s performance is strikingly close to human-level performance, and often vastly surpasses prior models such as ChatGPT. Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. In our exploration of GPT-4, we put special emphasis on discovering its limitations, and we discuss the challenges ahead for advancing towards deeper and more comprehensive versions of AGI, including the possible need for pursuing a new paradigm that moves beyond next-word prediction. We conclude with reflections on societal influences of the recent technological leap and future research directions.

Related Books

A new era of generative AI for everyone Book

a new era of generative ai for everyone, The technology underpinning ChatGPT will transform work and reinvent business

View →

Building a Second Brain: A Proven Method to Organize Your Digital Life and Unlock Your Creative Potential Book

“One of my favorite books of the year. It completely reshaped how I think about information and how and why I take notes.” —Daniel Pink, bestselling author of Drive A revolutionary approach to enhancing productivity, creating flow, and vast

View →

NIRI ARTIFICIAL INTELLIGENCE IN INVESTOR RELATIONS Book

The Think Tank on AI in IR convened a group of volunteer thought leaders in the fall of 2019 to begin their work. Guided by an outside advisor, they undertook a foresight process to examine the evolving dynamics of the effect of AI on the I

View →

[MCKINSEY]ARTIFICIAL INTELLIGENCE THE NEXT DIGITAL FRONTIER Book

The McKinsey Global Institute's research on Artificial Intelligence highlights the promise and potential of AI to boost profits and transform industries. The report also notes that while AI technologies have advanced significantly in recent years, adoption remains in its infancy. The paper provides case studies of digital natives and responses from their survey, which show early evidence that AI implemented at scale delivers attractive returns. Additionally, the report discusses the challenges associated with the widespread adoption of AI, including making the business case for investment and ensuring algorithmic transparency and accountability.

View →