Back to Education
Course · Deep Learning Specialization

Sequence Models

Sequence Models shifted my focus from images to language, audio, and time-dependent data. It connected RNNs and LSTMs to attention and finally to Transformers, which became the bridge toward my current NLP/LLM direction.

RNNLSTMGRUAttentionTransformersAudio/NLP
Course or track certificate preview

What I learned

I worked through character-level language models, word embeddings, emoji prediction, jazz generation, attention-based translation, Transformer architecture, and trigger-word detection. This gave me both classical sequence modeling and modern attention-based foundations.

Why it mattered in my path

This course is one reason I moved toward NLP, Transformers, Hugging Face, LLMs, RAG, and agents as my next major learning direction.

What this course added to my engineering stack.

Sequence Models was not just a certificate item. I used it as one layer in a longer path: understand the concept, implement it in code, test it on assignments or notebooks, then connect the idea to future portfolio systems.

01 · Core role

Why I studied it

Sequence Models shifted my focus from images to language, audio, and time-dependent data. It connected RNNs and LSTMs to attention and finally to Transformers, which became the bridge toward my current NLP/LLM direction. The reason it matters on this page is that it shows the exact stage where my learning moved forward, instead of presenting education as a flat list of names.

02 · Concepts

What I focused on

The most important layer was not memorizing definitions; it was learning how the course concepts behave when they are turned into working code, trained models, evaluation outputs, and notebooks.

RNNsLSTMsattentiontransformersspeech signalstext generation
03 · Practice method

How I used it

I treated the course as a practical loop: watch the theory, re-implement the assignment logic, inspect outputs, record results, and then keep the code in a public repository as evidence of the learning process.

04 · Portfolio connection

How it connects

This course is one reason I moved toward NLP, Transformers, Hugging Face, LLMs, RAG, and agents as my next major learning direction. This page also connects to standalone milestone pages, so the course is not represented only by certificate text; it is represented through the labs, models, notebooks, results, and media produced during the learning path.

Theorymathematical or conceptual model
Implementationnotebooks, functions, model code
Evidencecertificate, repo, outputs, milestones
Engineering useapplied later in apps and research

Learning notes

I worked through character-level language models, word embeddings, emoji prediction, jazz generation, attention-based translation, Transformer architecture, and trigger-word detection. This gave me both classical sequence modeling and modern attention-based foundations. I also used the course to improve how I explain technical decisions: why a model is chosen, what assumptions it makes, where it fails, and what the next improvement should be. That explanation layer is important because my goal is end-to-end AI engineering, not only passing assignments.

Evidence and navigation

  • Official course page is linked for source context.
  • GitHub repository is linked where I have public code.
  • Certificate or badge appears in the showcase when available.
  • Milestone cards open separate pages when the course has larger labs or projects.

Connected milestone pages

Character-Level Language Model
Sequence Models

Character-Level Language Model

A character-level RNN built from scratch to generate dinosaur names and Shakespeare-style text one character at a time.

Open milestone
Emojify: Emoji Prediction from Text
Sequence Models

Emojify: Emoji Prediction from Text

A sentence-to-emoji classifier that starts with averaged GloVe vectors and then improves the representation with an LSTM sequence model.

Open milestone
Jazz solo generation visual
Sequence Models

Jazz Solo Generation with LSTM

A creative sequence-generation project that trains an LSTM on jazz musical values and then uses an inference model to generate a new solo.

Open milestone
Neural Machine Translation with Attention
Sequence Models

Neural Machine Translation with Attention

A date-normalization model that uses a seq2seq architecture with attention to translate human-readable dates into YYYY-MM-DD format.

Open milestone
Transformer Architecture from Scratch
Sequence Models

Transformer Architecture from Scratch

A from-scratch TensorFlow/Keras implementation of the Transformer: positional encoding, masks, scaled dot-product attention, encoder, decoder, and full model.

Open milestone
Milestone visual
Sequence Models

Trigger Word Detection

A wake-word detection project that synthesizes 10-second audio examples, converts them to spectrograms, and trains a Conv1D-GRU model to detect “activate.”

Open milestone