Learning ML Resources

OpenAI Spinning Up in Deep RL

Jacob Hilton Deep Learning Curriculum

• this one is quite open ended and has lots of experiments to do it yourself.
• it does point to some good resources for the prerequisites needed to understand the material.

Stanford CS224N: Natural Language Processing with Deep Learning

• Winter 2021/3 Youtube Playlist Lectures
• Total Watch Time 25 Hours 30 mins: 19 Lectures each at 1 hr 20 mins

Blogs

Lil’Log

• Open AI researcher, some very interesting blogs
  • How to Train Really Large Models on Many GPUs

How I got into OpenAI Rai

• Take aways
  • Recommended process to repeat
    • Make a list of relevant things in ML that I don’t understand
    • Find resources to understand it
      • Courseras
      • readings etc
    • Learn all I can from those resources, collect stuff I dont yet understand, and find references for those things you dont understand
  • Read up on recent papers
  • Read Spinngin Up on Deep RL from Open AI
    • similar but might be better Deep Learning Curriculum from Jacob Hilton

NLP Course For You

• Familiar, I think I read most of it before.

Transformers From Scratch

• Top down approach to Transformers with some good follow up resources at the bottom

Scaling Kubernetes to 7,500 Nodes