Machine Learning – Jamal J8 Ahmed

R2 Day 0-4: Break Down an RNN Update

j8ahmed — Thu, 15 Oct 2020 05:20:30 +0000

I am back for another round of the 100 Days of Code Challenge. I recently completed the challenge for the first time. I wrote a 100 Days Of Code Review covering the highs and lows of my journey through the challenge. The biggest take away was that I am not done and I have started round two. I left off my last challenge working on understanding how a Recurrent Neural Network (RNN) works.

Source

Day 98: You Should Always Breakdown Code

j8ahmed — Thu, 08 Oct 2020 04:57:18 +0000

A few days ago I was trying to breakdown some diagrams but was left with a lot of unanswered questions. The diagram was modelling a vanilla Recurrent Neural Network (RNN). It was a great exercise to help me understand what was going on inside the RNN but it left me wanting specific answers. Today, through breaking down the code of an example RNN I got those answers. First of all – the questions...

Source

Day 96: Neural Network Produces MJ Lyrics

j8ahmed — Tue, 06 Oct 2020 04:37:38 +0000

So I have been working through a Recurrent Neural Network (RNN) that can predict any text. So of course I thought why not give it some famous lyrics and see if it can produce a cool new song (the lyrics at least). The RNN was written by Andrej Karpathy in Python. It was shown as part of his Stanford lecture on RNNs which I am currently studying. Do I understand everything that is going on here?

Source

Day 95: RNN Diagrams Compared to Code

j8ahmed — Mon, 05 Oct 2020 04:02:04 +0000

Today was a solid day of work on learning Recurrent Neural Networks (RNNs). I drew some diagrams, took some notes, and asked a lot of questions about how the current example is structured. The current example I am working on is a character prediction RNN where, at each time step ‘t’ it should predict the next character in the word/sentence. So here are some of my questions: I made a reasonable...

Source

Day 93: A Neural Net Inside a Neural Net

j8ahmed — Sat, 03 Oct 2020 03:07:46 +0000

I am back working through the Stanford Recurrent Neural Network (RNN) lecture from Andrej Karpathy. I’ve been taking a lot of notes and the gears in my brain have been turning. One slide stood out today. Initially I thought that the ‘Recurrent’ part in RNNs referred to the continuous tweaking of predictions based on new input and what was previously predicted in the sequence. Plot twist...

Source

Day 92: University is Still Valuable?

j8ahmed — Fri, 02 Oct 2020 04:35:38 +0000

After searching online for more resources on Recurrent Neural Networks (RNNs) I stopped to reconsider why I wanted more resources. A few days ago I had found what I believed to be the ‘Diamond’ of lectures on RNNs. So why did I need more than that? I had planned to thoroughly study the material presented in the lecture but somehow I lost my own direction. Anyways, I got back to watching that...

Source

Day 90: Recurrent Neural Network Basics

j8ahmed — Wed, 30 Sep 2020 04:18:00 +0000

I’m finally back to what I want to focus on. How to build a great “Rock Paper Scissors” Bot for my freeCodeCamp project. This has been the longest I have ever spent on a freeCodeCamp certification project. I have failed many times but I think I am finally on the right track. I guess I am failing forward and making progress. Now, about the Recurrent Neural Networks (RNNs). I am only vaguely...

Source

Day 89: Neural Network Revision

j8ahmed — Tue, 29 Sep 2020 03:46:07 +0000

Today was a confidence booster for sure. I have been seriously studying Artificial Intelligence and Neural Networks for about a month now. I took a few days off to design and build my blog but now I’m back. I had intended to get back to studying Recurrent Neural Networks (RNNs) but when I started to look at the material I felt a bit out of it. Almost like I had forgotten the basics. So I went back...

Source