What you'll learn
- Understand why open source LLMs matter
- Compare models using AI leaderboards
- Evaluate models beyond benchmark scores
- Test LLMs against real-world use cases
- Create prompts for repeatable model testing
- Choose models based on your own priorities
- Set up local models with LM Studio
- Explore model guardrails and limitations
In this course, you’ll explore the fast-moving world of open source LLMs and learn how to evaluate models based on what actually matters for your use case. You’ll look at leaderboards and intelligence tests, then go beyond their scores by putting models through tests of your own.
You’ll create reusable evaluation prompts, compare how different models respond, and develop a more practical way to think about model quality.
Then you’ll move from comparing models to running them yourself. Using LM Studio, you’ll learn how to set up an open source model locally and get familiar with the process behind local AI.
Along the way, you’ll also investigate guardrails and see how model behavior can change depending on the restrictions and decisions built around it.
The result is a practical foundation for exploring, testing, and choosing open source AI with more confidence.
I'm a proud lifetime ZTM member. It's changed the trajectory of my life. The projects I built from ZTM courses made me stand out as the #1 candidate and landed me the job. Thanks to Andrei, Yihua, and the entire ZTM team, instructors, and community.
Who You Will Learn With
You're getting more than just a course
Our instructors, TAs, Mentors, Alumni, and fellow students go above and beyond to help guide you and ensure you're on the right path to achieve your goals. Our private ZTM Discord server is a key factor in taking your skills, confidence and career to the next level.
