- Home Page /
- Books /
- Computers & Technology /
- Computer Science /
- AI & Machine Learning /
- Expert Systems /
- Build a Large Language Model (From Scratch)
Item #:
90174974
Build a Large Language Model (From Scratch)
Item #:
90174974
0 ratings
Write a review
Out of stock
Imported from USA store
Secured transaction
Ubuy works hard to protect your security and privacy. Our advanced payment security system ensures confidentiality by encrypting your information during transmission using AES (Advanced Encryption Standards) and SSL (Secure Socket Layer) protocols. Your payment details are 100% secure as we do not share your payment details with third party sellers.
Our Top Logistics Partners
Fast
Shipping
Free
Return*
Secure Packaging
100% Original Products
PCI DSS Compliance
ISO 27001 Certified
Note: Step Down Voltage Transformer required for using electronics products of US store (110 V-120 V). Recommended power converters Buy Now.
Product Details
- How to implement LLM attention mechanisms and GPT-style transformers. In Build a Large Language Model (from Scratch) bestselling author Sebastian Raschka guides you step by step through creating your own LLM. Each stage is explained with clear text, diagrams, and examples. You’ll go from the initial design and creation, to pretraining on a general corpus, and on to fine-tuning for specific tasks.Build a Large Language Model (from Scratch) teaches you how to:Plan and code all the parts of an LLMPrepare a dataset suitable for LLM trainingFine-tune LLMs for text classification and with your own dataUse human feedback to ensure your LLM follows instructionsLoad pretrained weights into an LLMBuild a Large Language Model (from Scratch) takes you inside the AI black box to tinker with the internal systems that power generative AI. As you work through each key stage of LLM creation, you’ll develop an in-depth understanding of how LLMs work, their limitations, and their customization methods. Your LLM can be developed on an ordinary laptop, and used as your own personal assistant.About the technologyPhysicist Richard P. Feynman reportedly said, “I don’t understand anything I can’t build.” Based on this same powerful principle, bestselling author Sebastian Raschka guides you step by step as you build a GPT-style LLM that you can run on your laptop. This is an engaging book that covers each stage of the process, from planning and coding to training and fine-tuning.About the bookBuild a Large Language Model (From Scratch) is a practical and eminently-satisfying hands-on journey into the foundations of generative AI. Without relying on any existing LLM libraries, you’ll code a base model, evolve it into a text classifier, and ultimately create a chatbot that can follow your conversational instructions. And you’ll really understand it because you built it yourself!What's insidePlan and code an LLM comparable to GPT-2Load pretrained weightsConstruct a complete training pipelineFine-tune your LLM for text classificationDevelop LLMs that follow human instructionsAbout the readerReaders need intermediate Python skills and some knowledge of machine learning. The LLM you create will run on any modern laptop and can optionally utilize GPUs.About the authorSebastian Raschka is a Staff Research Engineer at Lightning AI, where he works on LLM research and develops open-source software.The technical editor on this book was David Caswell.Table of Contents1 Understanding large language models2 Working with text data3 Coding attention mechanisms4 Implementing a GPT model from scratch to generate text5 Pretraining on unlabeled data6 Fine-tuning for classification7 Fine-tuning to follow instructionsA Introduction to PyTorchB References and further readingC Exercise solutionsD Adding bells and whistles to the training loopE Parameter-efficient fine-tuning with LoRA
| Publisher | Manning |
| Publication date | October 29, 2024 |
| Language | English |
| Print length | 368 pages |
| ISBN-10 | 1633437167 |
| ISBN-13 | 978-1633437166 |
| Item Weight | 1.35 pounds (610 grams) |
| Dimensions | 7.38 x 0.7 x 9.25 inches (18.7 x 1.8 x 23.5 cm) |
Product Description
Build a Large Language Model (From Scratch)
Customers also viewed these products
Important information
- Limitations : For products shipped internationally, please note that any manufacturer warranty may not be valid; manufacturer service options may not be available; product manuals, instructions, and safety warnings may not be in destination country languages; the products (and accompanying materials) may not be designed in accordance with destination country standards, specifications, and labeling requirements; and the products may not conform to destination country voltage and other electrical standards (requiring use of an adapter or converter if appropriate). The recipient is responsible for assuring that the product can be lawfully imported to the destination country. When ordering from Ubuy or its affiliates, the recipient is the importer of record and must comply with all laws and regulations of the destination country.
- Not all the products listed on Ubuy are for sale, as Ubuy is a global search engine. Products are subject to export/trade regulations.
Currently unavailable.
We don't know when or if this item will be back in stock.
This item is not restrict in my country.(Please click on above link if this item is not restrict in your country, So our team will review and allow.)
Secured transaction
PCI DSS compliant and ISO 27001:2022 certified, with encrypted payments and full buyer protection on every order.
Our Top Logistics Partners
Fastest cross-border delivery
Ubuy Assurance
Experience worry-free shopping with 100% original products, PCI DSS-compliant payment security, ISO 27001-certified data protection, the fastest cross-border delivery, free returns *, and secure packaging on every order.