Skip to main content

Advanced Search

Projected result for your current search: 0

Search Operators:

You can use operators in your search query to narrow down your results even more. Click on the search operator to see an explanation of how it works.
Finds documents with exactly this word group, in exactly this word order and spelling (e.g. "employer branding").
Finds documents with both search terms (e.g. sales AND bonus).
Finds documents with one or the other search term (e.g. porsche OR volkswagen).
Finds documents with all search terms. Blank space is understood as AND (e.g. man robot production).
Finds documents with no appearance of the word behind NOT (e.g. ford NOT "harrison ford").
Finds documents where the search term is mentioned at least "n" times."n" may be any number (e.g. COUNT(gear)>8).
Finds documents with both search terms in any word order, permitting "n" words as a maximum distance between them. Best choose between 15 and 30 (e.g. NEAR(recruit, professionals, 20)).
Finds documents with the search term in word versions or composites. The asterisk * marks whether you wish them BEFORE, BEHIND, or BEFORE and BEHIND the search term (e.g. lightweight*, *lightweight, *lightweight*).
Finds documents with the search term in different spellings. "?" allows only one character (e.g. organi?ation).
Special characters are understood as AND (e.g. Miller Bros. & Sons).

Semantic Search

powered by (Link opens in a new window)
loading …
Log in
Top

4. The ChatGPT Architecture: An In-Depth Exploration of OpenAI’s Conversational Language Model

  • 2023
  • OriginalPaper
  • Chapter
Published in:
Authors
Akshay Kulkarni
Adarsha Shivananda
Anoosh Kulkarni
Dilip Gudivada
Published in
Applied Generative AI for Beginners
Publisher
Apress

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The chapter delves into the architecture of ChatGPT, an advanced conversational language model developed by OpenAI. It explores the evolution of GPT models, from GPT-1 to GPT-4, highlighting the role of scale and the challenges associated with larger models. The Transformer architecture, particularly the decoder-only structure and self-attention mechanism, is discussed in detail. The chapter also covers the innovative use of reinforcement learning from human feedback (RLHF) to fine-tune ChatGPT, making it a standout feature. Additionally, it addresses the strengths and limitations of ChatGPT, including its ability to understand context, generate human-like text, and the ethical considerations surrounding its use. The discussion on biases and the continuous improvement process of the model adds depth to the exploration, making it a must-read for anyone interested in the cutting edge of conversational AI.
AI Generated

This summary of the content was generated with the help of AI.

Please log in to get access to your license.

Log in Register for free

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Business + Economics & Engineering + Technology"

Online-Abonnement

Springer Professional "Business + Economics & Engineering + Technology" gives you access to:

  • more than 102.000 books
  • more than 537 journals

from the following subject areas:

  • Automotive
  • Construction + Real Estate
  • Business IT + Informatics
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Mechanical Engineering + Materials
  • Insurance + Risk


Secure your knowledge advantage now!

inform now

Springer Professional "Engineering + Technology"

Online-Abonnement

Springer Professional "Engineering + Technology" gives you access to:

  • more than 67.000 books
  • more than 390 journals

from the following specialised fileds:

  • Automotive
  • Business IT + Informatics
  • Construction + Real Estate
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Mechanical Engineering + Materials





 

Secure your knowledge advantage now!

inform now

Springer Professional "Business + Economics"

Online-Abonnement

Springer Professional "Business + Economics" gives you access to:

  • more than 67.000 books
  • more than 340 journals

from the following specialised fileds:

  • Construction + Real Estate
  • Business IT + Informatics
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Insurance + Risk



Secure your knowledge advantage now!

inform now
previous chapter LLMs and Transformers
next chapter Google Bard and Beyond
Title
The ChatGPT Architecture: An In-Depth Exploration of OpenAI’s Conversational Language Model
Authors
Akshay Kulkarni
Adarsha Shivananda
Anoosh Kulkarni
Dilip Gudivada
Copyright Year
2023
Publisher
Apress
Book
Applied Generative AI for Beginners

Print ISBN: 978-1-4842-9993-7

Electronic ISBN: 978-1-4842-9994-4

Copyright Year: 2023

DOI
https://doi.org/10.1007/978-1-4842-9994-4_4

Premium Partner

    Image Credits
    Neuer Inhalt/© ITandMEDIA, Nagarro GmbH/© Nagarro GmbH, AvePoint Deutschland GmbH/© AvePoint Deutschland GmbH, AFB Gemeinnützige GmbH/© AFB Gemeinnützige GmbH, USU GmbH/© USU GmbH, Ferrari electronic AG/© Ferrari electronic AG