Hyperparameter optimization with Python
Discover what you'll learn in the course (enable cookies if the video doesn’t play).
What you'll learn
👉 Build higher-performing models by understanding which hyperparameters matter and how to tune them effectively.
👉 Explore hyperparameter spaces confidently with Grid Search and Random Search.
👉 Make reliable model-selection decisions with robust cross-validation and nested cross-validation.
👉 Go beyond basic search with Bayesian optimization using Gaussian processes, TPE, and random forests.
👉 Accelerate experimentation with multi-fidelity methods that stop unpromising trials early.
👉 Automate advanced optimization workflows with Optuna; from flexible search spaces to efficient pruning.
What you'll get
Lifetime access
Instructor support
Certificate of completion
Access on mobile
💬 English subtitles
What our students say
Can't afford it? Get in touch.
30 days money back guarantee
If you're disappointed for whatever reason, you'll get a full refund.
So you can buy with confidence.
Instructor
Soledad Galli, PhD
Data scientist, Python Developer, AI Educator
Sole is a lead data scientist, instructor, developer advocate, author, and open-source software developer. She created and maintains Feature-engine, a popular Python library that simplifies feature engineering and selection through a comprehensive collection of scikit-learn-compatible transformers. Since its launch, Feature-engine has grown into a widely adopted project supported by an active community of users and contributors.
Sole is also the author of three books published by Packt: Python Feature Engineering Cookbook, Feature Selection in Machine Learning with Python, and Imbalanced Data: Myths, Mistakes and Modern Solutions. Through her courses, books, and open-source work, she helps data scientists build more effective machine learning models and apply best practices to real-world projects.
Learn more about Sole on LinkedIn.
Course description
Build better machine learning models through systematic, efficient hyperparameter optimization.
This practical Python course teaches you how to tune models for tabular data using cross-validation, Grid Search, Random Search, Bayesian optimization, multi-fidelity methods, and Optuna.
You will learn how to run these techniques, and also how they work, when to use them, and how to avoid unreliable or unnecessarily expensive experiments.
What is hyperparameter optimization?
Hyperparameters control how a machine learning model learns. Examples include tree depth, the number of estimators, regularization strength, and learning rate.
Hyperparameter optimization is the process of finding the combination of values that produces the best model for a particular dataset and business objective.
An effective optimization workflow requires:
- A well-designed hyperparameter search space
- A suitable search algorithm
- A reliable cross-validation strategy
- An objective function and evaluation metric
- An efficient use of time and computing resources
This course teaches you how to bring these components together in a practical workflow.
What will you learn?
By the end of the course, you will be able to:
- Design meaningful hyperparameter search spaces
- Evaluate models reliably with cross-validation
- Use nested cross-validation for robust model selection
- Apply Grid Search and Random Search effectively
- Use Bayesian optimization with Gaussian processes, Tree-structured Parzen Estimators, and random forests
- Accelerate optimization with successive halving, Hyperband, and other multi-fidelity methods
- Stop unpromising experiments early and focus resources on better candidates
- Build flexible, automated optimization workflows with Optuna
- Evaluate the search process and select strong model configurations
- Tune popular models for tabular data, including XGBoost and LightGBM
Along the way, you will explore the rationale, advantages, limitations, and practical considerations behind each method.
Hands-on hyperparameter tuning with Python
The course combines clear explanations with practical Python demonstrations and reusable Jupyter notebooks.
You will implement optimization workflows with popular open-source machine learning tools, including scikit-learn and Optuna. The examples focus on real model-tuning decisions rather than abstract theory, helping you transfer what you learn to your own datasets and projects.
Who is this course for?
This course is designed for:
- Data scientists and machine learning practitioners who want to improve model performance
- Professionals building models for business applications
- Python users who want a structured alternative to trial-and-error tuning
- Learners who want to understand modern hyperparameter optimization
Prerequisites
You should have:
- Basic knowledge of machine learning
- Familiarity with common classification and regression models
- Basic Python experience
- Some experience with NumPy, pandas, and scikit-learn
No previous experience with Bayesian optimization, multi-fidelity optimization, or Optuna is required.
Start building better models
By the end of the course, you will know how to choose an appropriate optimization strategy, build a reliable tuning workflow, and search for stronger model configurations without wasting valuable computing resources.
Turn hyperparameter tuning from trial and error into a structured, repeatable process you can apply to real-world machine learning projects.
Course Curriculum
Watch any videos marked Preview to sample our lessons for free.
- Cross-Validation (8:34)
- Cross-Validation schemes (13:55)
- Estimating the model generalization error with CV (Optional Demo) (8:35)
- Cross-Validation for Hyperparameter Tuning (Optional Demo) (7:33)
- Nested Cross-Validation (7:19)
- Nested Cross-Validation (Optional Demo) (6:43)
- Wrap-up (7:19)
- How are we doing? (0:26)
- Reading resources
- Extra Treat: Our Reading Suggestion 📕
- Sequential Search (5:49)
- Bayesian Optimization (5:10)
- Bayesian Inference - Introduction (7:11)
- Joint and Conditional Probabilities (7:40)
- Bayes Rule (12:02)
- Sequential Model-Based Optimization (15:54)
- Gaussian Distribution (7:28)
- Multivariate Gaussian Distribution (16:22)
- Gaussian Process (14:47)
- Kernels (6:41)
- Acquisition Functions (13:44)
- Quiz
- Additional Reading Resources
- How are we doing? (0:24)
- Added Treat: A Movie We Recommend
- Optuna (4:33)
- Optuna main functions (7:21)
- Search algorithms (7:03)
- Optuna: Model agnostic + powerful searches (6:19)
- Evaluating the search with Optuna's built in functions (4:41)
- Successive halving (11:00)
- Successive halving - demo (4:47)
- Hyperband (4:06)
- CASH: Combined Algorithm Selection and Hyperparameter optimization (7:30)
- References
Frequently Asked Questions
When does the course begin and end?
You can start taking the course from the moment you enroll. The course is self-paced, so you can watch the tutorials and apply what you learn whenever you find it most convenient.
For how long can I access the course?
The course has lifetime access. This means that once you enroll, you will have unlimited access to the course for as long as you like.
What if I don't like the course?
There is a 30-day money back guarantee. If you don't find the course useful, contact us within the first 30 days of purchase and you will get a full refund.
Will I get a certificate?
Yes, you'll get a certificate of completion after completing all lectures, quizzes and assignments.
Can I ask questions if I get stuck?
Absolutely! Under each video there is a comments section. Just pop your question in there, and the instructors will reply as soon as they can.
Is the course mobile-friendly?
It is indeed. Download Teachable's app on Google Play or Apple Store, log in with your Train in Data credentials and enjoy the courses from your mobile phone.
Can I get an invoice for my company?
Yes — we’re happy to help with company invoices 😊
If purchasing the product as a business, click the Are you a business? Enter your Tax ID (if applicable) link on the checkout page. This will reveal a field for Business name and Tax ID number. (Note that you must first fill out your billing address in order to enter in the Tax ID number). Entering in a valid Tax ID number will remove the tax charge, if any, from the total. Find out more details here.
Can I gift a course?
Yes, absolutely! 🎁
To gift a course, when you reach the checkout page of a product, you will see a checkbox with the option to purchase the product as a gift. From there, you can fill in the name and email of the person receiving the product. More details here.