See all courses

Reasoning Models: The Next Level of AI

Explore AI reasoning models from the inside out by diving into the research behind them. Learn how reasoning models think, where they struggle, and how prompting, reinforcement learning, reward models, and test-time compute shape their (sometimes scary!) behavior.

5 hours 0 projects 38 + lessons

Rated 4.9 out of 5 on Trustpilot

Rated 4.9 out of 5 on Trustpilot

5 Days

Average time students take to complete this course.

instructor
Taught by: Scott Kerr
Last updated: September 2026
Our students are getting hired by these companies. We can help you too.

What you'll learn

  • Understand how the breakthrough behind reasoning models came to be
  • Compare how models differ in their reasoning style and comprehension
  • Use context engineering to guide model performance
  • Understand the reinforcement learning and RLHF
  • Explore process reward models and verification
  • See how test-time compute can improve reasoning
  • Recognize common reasoning failures and deceptive outputs

Reasoning models can do impressive things. But what actually makes them different from a standard LLM?

This course gets beneath the surface.

You’ll explore the research breakthroughs that led to reasoning models and how they work under the hood. Learn to use this next level of AI models to tackle problems, compare the behavior of different systems, and examine what their outputs can — and can’t — tell you about how they arrived at an answer.

From there, you’ll dig into the techniques shaping modern reasoning AI. Prompt engineering. Context engineering. Reinforcement learning. RLHF. Process reward models. Test-time compute.

You’ll also see where things get messy.

Why can reasoning models become confused? What happens when a model produces convincing but unreliable reasoning? How can verification help separate a plausible answer from a genuinely strong one? And why don't they like cats...?

By the end, you’ll have a clearer mental model for how reasoning systems are trained, evaluated, prompted, and improved - and a more practical way to work with them.

Who You Will Learn With

You're getting more than just a course

Our instructors, TAs, Mentors, Alumni, and fellow students go above and beyond to help guide you and ensure you're on the right path to achieve your goals. Our private ZTM Discord server is a key factor in taking your skills, confidence and career to the next level.

Course curriculum

To make sure this course is a good fit for you, you can start learning AI for free right now by clicking any of the PREVIEW links below.

2 sections38 lessons5 hours total length

Reasoning Models

36 lectures · 4hr 35min
36 lectures · 4hr 35min

Introduction·3:40

3:40
PREVIEW

A Note On The Next Two Lessons

PREVIEW

Replay: Chain-of-Thought Prompting - Part 1·5:24

5:24
PREVIEW

Replay: Chain-of-Thought Prompting - Part 2·5:45

5:45
PREVIEW

Introduction to Reasoning Models·9:23

9:23
PREVIEW

First Contact with Reasoning·16:47

16:47
PREVIEW

Secrets and Lies!·12:14

12:14
BEGIN

Setting Up Our Open Source Reasoning Model·5:51

5:51
BEGIN

A Reasoning Model's Real Thoughts - Part 1·5:15

5:15
BEGIN

A Reasoning Model's Real Thoughts - Part 2·8:40

8:40
BEGIN

Exercise: Compare Reasoning Style of Different Models

BEGIN

Reasoning & The Context Window

BEGIN

Thinking Like LLMs - Breaking The Chains·12:15

12:15
BEGIN

What Are Reasoning Models Good For? (The Generator-Verifier Gap)·13:32

13:32
BEGIN

Exercise: Determine GVG·10:07

10:07
BEGIN

Prompt Engineering for Reasoning Models·7:27

7:27
BEGIN

Context Engineering·18:19

18:19
BEGIN

Thinking Like LLMs: Cats Are...Confusing? - Part 1·10:21

10:21
BEGIN

Thinking Like LLMs: Cats Are...Confusing? - Part 2·7:10

7:10
BEGIN

Reinforcement Learning - The Problem·6:20

6:20
BEGIN

Reinforcement Learning - How It Works·15:02

15:02
BEGIN

Exercise: Code Your Own Maze Game

BEGIN

RL Environments (Soccer)·4:18

4:18
BEGIN

RL Environments (Go)·7:46

7:46
BEGIN

-- Qualitative vs. Quantitative

BEGIN

Reinforcement Learning from Human Feedback (RLHF)·16:06

16:06
BEGIN

Reinforcement Learning for Reasoning Models - Let's Verify Step-By-Step·6:36

6:36
BEGIN

Reinforcement Learning for Reasoning Models - Process Reward Model·9:27

9:27
BEGIN

PRM800K Introduction·7:41

7:41
BEGIN

PRM800K Deep Dive·13:11

13:11
BEGIN

Test-Time Compute·12:40

12:40
BEGIN

Are Reasoning Models Lying To You? - Part 1·11:07

11:07
BEGIN

Are Reasoning Models Lying To You? - Part 2·2:42

2:42
BEGIN

Are Reasoning Models Lying To You? - Part 3·7:53

7:53
BEGIN

Are Reasoning Models Lying To You? - Part 4·2:51

2:51
BEGIN

Mandatory Homework: The Thinking Game

BEGIN

Challenge - Build Your Third Game (Flappy Bird)

2 lectures
2 lectures

Who is Zero To Mastery Academy for?

You'll fit right in if:

You're struggling to make progress using free tutorials that aren't giving you the structure or clear path to achieving your goals.
You don't want to learn alone. You want personalized feedback, support, and motivation from instructors and mentors and want to be part of a supportive community of like-minded individuals.
You want to learn by doing. You're excited to embrace the struggle of making mistakes that comes with building real-world projects you'll be proud of.
You're sick of outdated & boring tutorials. We pride ourselves on having the most up-to-date (and fun!) courses in the industry so that you're not wasting your time and only learning what matters right now.
You can't afford to spend $8,000+ on over priced bootcamps and colleges. We got you. We'll help you go from zero to hired for less than the cost of a cup of coffee a day.
You're ready to embrace AI. You're excited to go beyond basic prompt tricks and hacks and learn the latest AI tools and skills.

We're not for you if:

You're just going to watch the lessons and take no action. Our courses are all about getting your hands dirty with exercises and putting what you're learning into action by building fun and impressive real-world projects.
You're not ready to invest in yourself by taking the time to deeply learn a topic or you're just looking for the cheapest way to learn.
You don't think fundamentals matter anymore because AI can do everything for you. Understanding the fundamentals and how things really work will always be important.
You think AI is going to replace you and think there's nothing you can do about it. Well, if you keep wasting time not learning AI tools & skills, you're probably right. Or you embrace them, and 2x your productivity (and your income).
You think influencers on YouTube are the experts and would rather watch superficial videos that get a lot of views to learn. Our courses are taught by actual industry experts.

Meet your instructor

Your AI & LLM instructor (Scott) has more than just a wealth of AI knowledge. He has years of real-world professional experience. He has been in your shoes. He makes learning fun. He makes complex topics feel simple. He will motivate you. He will push you. And he will go above and beyond to help you succeed.

Scott Kerr

Hi, I'm Scott Kerr!

Scott uses his years of professional research and enthusiasm for AI to teach and guide new students to learn how to utilize AI, get hired and advance their careers.

SEE MY BIO & COURSES

Scott Kerr

Head of AI Initiatives

Frequently Asked Questions

Are there any prerequisites for this course?

  • None! All you need is an enthusiasm to learn. You will also have the option to use paid or free AI tools.

Who is this course for?

  • Anyone aiming to gain a comprehensive and practical understanding of modern techniques in prompt engineering and LLMs.
  • Developers looking to understand how to work with LLMs that are implemented in their AI-driven applications or within their organizations
  • Graduates of coding bootcamps or online AI courses who wish to delve deeper into the nuances of prompt engineering and explore beyond the introductory concepts
  • Individuals aspiring to integrate AI and LLMs into their career
  • You seek a structured guide to learning how to design effective prompts and interact with LLMs from scratch, progressing to proficiency levels that position you attractively compared to those without AI knowledge
  • Students who find beginner tutorials on LLMs inadequate, as they do not progress beyond basic examples and fail to provide advanced skills
  • Developers eager to transition into AI-focused roles, leveraging the powerful capabilities of LLMs for tasks such as iterating, summarizing, transforming, inferring, and expanding information.
  • You are an AI enthusiast who wants to learn more in a fun, interactive manner

Do you provide a certificate of completion?

We definitely do and they are quite nice. You will also be able to add Zero To Mastery Academy to the education section of your LinkedIn profile as well.

Are there subtitles?

Yes! We have high quality subtitles in 6 different languages: English, Spanish, French, German, Arabic, and Hindi.

You can even adjust the text size, color, background and more so that the subtitles are perfect just for you!

Still have more questions about the Academy?

Still have more questions specific to the Academy membership? No problem, we answer some more here.

What students are saying

Our courses and community have helped 1,000s of Zero To Mastery students go from zero to getting hired to levelling up their skills and advancing their careers to new heights.

Rated 4.9 out of 5 on Trustpilot

Learn the skills to stand out and get hired. In the age of AI.

Choose your currency:
$ USD • US Dollar

This Course Only

US $99
One payment. Lifetime access.
GET THIS COURSE

Master this skill, on your schedule.

Lifetime access to this course
All updates included at no extra cost
Certificate of completion
500,000+ member community (Discord)
Personalized ZTM Passport

BEST VALUE

PRO PLAN

Pay yearly
Pay monthly
$25 / month

Paid yearly at $299$588/y49% OFF

Get Annual Plan

Build a high-value, future-proof career. For less than $1/day.

Unlimited access to all courses
Guided career paths (beginner to job-ready)
500,000+ member community
Live career coaching sessions with mentors
Completion certificates for every course
Personalized ZTM Passport
Private LinkedIn networking group
Priority support

Lifetime ACCESS

$1,299
Only pay once, ever
Get Lifetime Access

Invest in your future — pay once and you’re covered for whatever comes next.

Includes everything in PRO PLAN
No subscriptions. No renewals. Just unlimited learning for life.
Risk Free Pricing
100% Risk Free

We know you'll love ZTM. That's why we provide a no-hassle, 30-day money-back guarantee.

Students also take these courses