Companies Home Search Profile

Hands On With Mixture of Experts Models

Focused View

Richard Aragon

1:12:46

11 View
  • 1 - Introduction.mp4
    05:50
  • 1 - Model-Handout.docx
  • 2 - BartPhi10 and BartPhi20.mp4
    16:05
  • 3 - BartPhi28.mp4
    12:32
  • 4 - CoTCog and Tiny Llama.mp4
    14:25
  • 5 - Lite Llama and Tiny Llama.mp4
    09:15
  • 6 - 3 Tiny Llamas and Mixtral.mp4
    14:39
  • Description


    Everything You Need To Know About Mixture Of Experts AI Models From Someone Who Has Built Several Of Them!

    What You'll Learn?


    • How To Build Mixture of Experts Models
    • How To Utilize Different Encoders and Decoders
    • How To Change and Tweak The Outputs of Your MoE Models
    • Hands On Access To Actual MoE Models and Code

    Who is this for?


  • This course is for anyone looking to learn more about Mixture of Experts models and especially for those looking for a true hands on experience.
  • What You Need to Know?


  • A basic understanding of Python, Transformers and Pipelines is a requirement for this course.
  • More details


    Description

    While Mixture of Experts models have recently hit the mainstream, I have a lot of experience building models with this particular architecture long before they hit the big time. In this course, I provide full access to several LLM models that I have personally constructed. I also impart all of the wisdom I have learned in constructing these models, as well as laying out the basic roadmap for every aspect that you need to do it.

    If you are interested in Mixture of Experts models on any level, then this is the course for you. From BartPhi, to 3 Tiny Llamas, and even the mighty Mixtral, I show you exactly to setup and run these models, all directly within a Google Colab environment. I give you the models, I give you the code, I explain everything you need to know around these things.


    The best part, if you have questions regarding any of these models, I am the engineer and architect of 90% of the models that I showcase in this course. I can answer your questions about these models and their construction far better than anyone else could. You get a course that you literally could not find anywhere else. Access to models that you would be hard pressed to find anywhere else. As well as access to the person who built said models if you need to, which you could not find anywhere else!

    Who this course is for:

    • This course is for anyone looking to learn more about Mixture of Experts models and especially for those looking for a true hands on experience.

    User Reviews
    Rating
    0
    0
    0
    0
    0
    average 0
    Total votes0
    Focused display
    Richard Aragon
    Richard Aragon
    Instructor's Courses
    From Apple employee number ~5,000 and working through college as a hardware technician, to a software developer, to a cloud architect, and now AI and ML Sherpa, I have seen it all when it comes to technology development over the past 20+ years. I simply wish to impart that advice in any way that I can.
    Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.
    • language english
    • Training sessions 6
    • duration 1:12:46
    • Release Date 2024/04/11