How to Work Efficiently Around Amazon Nova Act’s Slowness & Lack of Jupyter Notebook Support
Johnny Code
How to Work Efficiently Around Amazon Nova Act’s Slowness & Lack of Jupyter Notebook Support
2:11
Will Amazon Nova Act Replace Selenium/Cypress/Playwright Testers?
Johnny Code
Will Amazon Nova Act Replace Selenium/Cypress/Playwright Testers?
5:25
Build a Real-World Reinforcement Learning Environment - Part 0: Overview
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 0: Overview
1:22
Simply Explaining Proximal Policy Optimization (PPO): Full Whiteboard Walkthrough
Johnny Code
Simply Explaining Proximal Policy Optimization (PPO): Full Whiteboard Walkthrough
31:15
Your First “Hello World!” Reinforcement Learning Project
Johnny Code
Your First “Hello World!” Reinforcement Learning Project
14:34
Build a Real-World Reinforcement Learning Environment - Part 7: Vectorized Environment & TensorBoard
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 7: Vectorized Environment & TensorBoard
12:12
Build a Real-World Reinforcement Learning Environment - Part 6: Train with MaskablePPO
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 6: Train with MaskablePPO
12:49
Build a Real-World Reinforcement Learning Environment - Part 5: Action Masking
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 5: Action Masking
8:41
Build a Real-World Reinforcement Learning Environment - Part 4: Reward Function
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 4: Reward Function
11:25
Build a Real-World Reinforcement Learning Environment - Part 3: Action & Observation Space
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 3: Action & Observation Space
9:00
Build a Real-World Reinforcement Learning Environment - Part 2: Python Gymnasium Framework
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 2: Python Gymnasium Framework
8:02
Build a Real-World Reinforcement Learning Environment - Part 1: Modeling the Problem
Johnny Code
Build a Real-World Reinforcement Learning Environment - Part 1: Modeling the Problem
13:40
How to Capture Full Page or Full-Length Element Screenshots in Selenium Python
Johnny Code
How to Capture Full Page or Full-Length Element Screenshots in Selenium Python
2:24
Dueling DQN (Dueling Architecture) Explained & Implemented | DQN PyTorch Beginners Tutorial #11
Johnny Code
Dueling DQN (Dueling Architecture) Explained & Implemented | DQN PyTorch Beginners Tutorial #11
8:34
How Prioritized Experience Replay (PER) Works in Deep Q-Learning
Johnny Code
How Prioritized Experience Replay (PER) Works in Deep Q-Learning
10:30
Creating Enemy Animations, Collision Layers and Masks | Godot 4 “Your First 2D Game” Tutorial
Johnny Code
Creating Enemy Animations, Collision Layers and Masks | Godot 4 “Your First 2D Game” Tutorial
11:31
Coding Player Movement, Animations, Collision Detection | Godot 4 “Your First 2D Game” Tutorial
Johnny Code
Coding Player Movement, Animations, Collision Detection | Godot 4 “Your First 2D Game” Tutorial
13:32
Creating the Player Character Scene | Godot 4 “Your First 2D Game” Tutorial
Johnny Code
Creating the Player Character Scene | Godot 4 “Your First 2D Game” Tutorial
10:47
Easiest Way to Train AI to Play Atari Games with Reinforcement Learning | RL Baselines3 Zoo Tutorial
Johnny Code
Easiest Way to Train AI to Play Atari Games with Reinforcement Learning | RL Baselines3 Zoo Tutorial
21:01
Q-Learning Tutorial 7: Adjust Learning Rate to Unstuck MountainCarContinuous-v0 from Local Optima
Johnny Code
Q-Learning Tutorial 7: Adjust Learning Rate to Unstuck MountainCarContinuous-v0 from Local Optima
5:18
Q-Learning Tutorial 6: Train Gymnasium Pendulum-v1 on Continuous Action and Observation Spaces
Johnny Code
Q-Learning Tutorial 6: Train Gymnasium Pendulum-v1 on Continuous Action and Observation Spaces
4:50
Q-Learning Tutorial 5: Train Gymnasium Acrobot-v1 on Continuous Action and Observation Spaces
Johnny Code
Q-Learning Tutorial 5: Train Gymnasium Acrobot-v1 on Continuous Action and Observation Spaces
11:07
Tianshou Reinforcement Learning Library: DQN Sample Code Walkthrough
Johnny Code
Tianshou Reinforcement Learning Library: DQN Sample Code Walkthrough
25:25
Double DQN (DDQN) Explained & Implemented | DQN PyTorch Beginners Tutorial #10
Johnny Code
Double DQN (DDQN) Explained & Implemented | DQN PyTorch Beginners Tutorial #10
11:33
How I Take Notes From YouTube Videos with Gemini Flash & ChromaDB
Johnny Code
How I Take Notes From YouTube Videos with Gemini Flash & ChromaDB
14:18
Train the DQN Algorithm on Flappy Bird! | DQN PyTorch Beginners Tutorial #9
Johnny Code
Train the DQN Algorithm on Flappy Bird! | DQN PyTorch Beginners Tutorial #9
4:37
Test the DQN Algorithm on CartPole-v1 | DQN PyTorch Beginners Tutorial #8
Johnny Code
Test the DQN Algorithm on CartPole-v1 | DQN PyTorch Beginners Tutorial #8
9:32
Optimize the Target Network PyTorch Code | DQN PyTorch Beginners Tutorial #7
Johnny Code
Optimize the Target Network PyTorch Code | DQN PyTorch Beginners Tutorial #7
6:03
Explain Loss, Backpropagation, Gradient Descent | DQN PyTorch Beginners Tutorial #6
Johnny Code
Explain Loss, Backpropagation, Gradient Descent | DQN PyTorch Beginners Tutorial #6
3:57
Implement the Target Network | DQN PyTorch Beginners Tutorial #5
Johnny Code
Implement the Target Network | DQN PyTorch Beginners Tutorial #5
8:49
Setting Up ChromaDB with Docker & Role-Based Token Authentication
Johnny Code
Setting Up ChromaDB with Docker & Role-Based Token Authentication
11:20
Implement Epsilon-Greedy & Debug the Training Loop | DQN PyTorch Beginners Tutorial #4
Johnny Code
Implement Epsilon-Greedy & Debug the Training Loop | DQN PyTorch Beginners Tutorial #4
8:30
Implement Experience Replay & Load Hyperparameters from YAML | DQN PyTorch Beginners Tutorial #3
Johnny Code
Implement Experience Replay & Load Hyperparameters from YAML | DQN PyTorch Beginners Tutorial #3
8:01
Implement the Deep Q-Network Module | DQN PyTorch Beginners Tutorial #2
Johnny Code
Implement the Deep Q-Network Module | DQN PyTorch Beginners Tutorial #2
9:53
Implement Deep Q-Learning with PyTorch and Train Flappy Bird! | DQN PyTorch Beginners Tutorial #1
Johnny Code
Implement Deep Q-Learning with PyTorch and Train Flappy Bird! | DQN PyTorch Beginners Tutorial #1
9:44
Q-Learning Tutorial 2: Train Gymnasium Taxi-v3 on Multiple Objectives
Johnny Code
Q-Learning Tutorial 2: Train Gymnasium Taxi-v3 on Multiple Objectives
8:53
How to Install Gymnasium Box2D on Windows Subsystem for Linux (WSL)
Johnny Code
How to Install Gymnasium Box2D on Windows Subsystem for Linux (WSL)
8:05
Install PettingZoo Multi-Agent Reinforcement Learning (MARL) Library
Johnny Code
Install PettingZoo Multi-Agent Reinforcement Learning (MARL) Library
14:13
How to Save Best Model & Auto-Stop Training in Stable Baselines3
Johnny Code
How to Save Best Model & Auto-Stop Training in Stable Baselines3
4:59
Stable Baselines3 Tutorial 2: Dynamically Load RL Algorithm for Training | Demo on Pendulum-v1
Johnny Code
Stable Baselines3 Tutorial 2: Dynamically Load RL Algorithm for Training | Demo on Pendulum-v1
6:20
Beginner's Guide to Choosing Reinforcement Learning Algorithms | Stable Baselines3 Tutorial
Johnny Code
Beginner's Guide to Choosing Reinforcement Learning Algorithms | Stable Baselines3 Tutorial
6:10
MIP Broke My C# File Saving Excel Code, How to Fix it with 1 Line (Microsoft Information Protection)
Johnny Code
MIP Broke My C# File Saving Excel Code, How to Fix it with 1 Line (Microsoft Information Protection)
1:15
REINFORCE (Vanilla Policy Gradient VPG) Algorithm Explained | Deep Reinforcement Learning
Johnny Code
REINFORCE (Vanilla Policy Gradient VPG) Algorithm Explained | Deep Reinforcement Learning
8:15
Deep Q-Network (DQN) Applied to Gymnasium Mountain Car | Python+Pytorch Deep Reinforcement Learning
Johnny Code
Deep Q-Network (DQN) Applied to Gymnasium Mountain Car | Python+Pytorch Deep Reinforcement Learning
8:33
Use Pygame to Visualize a Custom Reinforcement Learning Environment
Johnny Code
Use Pygame to Visualize a Custom Reinforcement Learning Environment
12:24
How gymnasium.spaces.Box Works for Custom Gym Environments' Action and Observation Spaces
Johnny Code
How gymnasium.spaces.Box Works for Custom Gym Environments' Action and Observation Spaces
3:30
Build a Custom Gymnasium Reinforcement Learning Environment & Train w Q-Learning & Stable Baselines3
Johnny Code
Build a Custom Gymnasium Reinforcement Learning Environment & Train w Q-Learning & Stable Baselines3
21:28
How to Use CUDA & Multiprocessing to Add Records/Embeddings Faster in ChromaDB
Johnny Code
How to Use CUDA & Multiprocessing to Add Records/Embeddings Faster in ChromaDB
13:03
How to Retrieve Your Google API Key using Generate AI Gemini API Key as an Example
Johnny Code
How to Retrieve Your Google API Key using Generate AI Gemini API Key as an Example
0:59
Generate Better Vector Embeddings for ChromaDB with Gemini Pro
Johnny Code
Generate Better Vector Embeddings for ChromaDB with Gemini Pro
3:11
Convolutional Neural Network (CNN) in Deep Q-Learning (DQN) Explained
Johnny Code
Convolutional Neural Network (CNN) in Deep Q-Learning (DQN) Explained
12:06
3. How to Save YouTube Video Summaries to ChromaDB & Perform Semantic Search
Johnny Code
3. How to Save YouTube Video Summaries to ChromaDB & Perform Semantic Search
8:27
Deep Q-Learning in 60 seconds
Johnny Code
Deep Q-Learning in 60 seconds
1:00
2. How to Extract YouTube Video Summaries with Gemini Pro Python API
Johnny Code
2. How to Extract YouTube Video Summaries with Gemini Pro Python API
4:58
1. How to Search YouTube with Python API
Johnny Code
1. How to Search YouTube with Python API
6:53
Getting Started with ChromaDB Image Search (Multimodal Embeddings)
Johnny Code
Getting Started with ChromaDB Image Search (Multimodal Embeddings)
14:11
Deep Q-Learning/Deep Q-Network (DQN) Explained | Python Pytorch Deep Reinforcement Learning
Johnny Code
Deep Q-Learning/Deep Q-Network (DQN) Explained | Python Pytorch Deep Reinforcement Learning
34:05
How to Calculate Loss, Backpropagation, Gradient Descent on a Simple Neural Network
Johnny Code
How to Calculate Loss, Backpropagation, Gradient Descent on a Simple Neural Network
19:11
Q-Learning Tutorial 1.2: Watch Q-Learning Values Change During Training on Gymnasium FrozenLake-v1
Johnny Code
Q-Learning Tutorial 1.2: Watch Q-Learning Values Change During Training on Gymnasium FrozenLake-v1
4:36
Getting Started with ChromaDB - Lowest Learning Curve Vector Database For Semantic Search
Johnny Code
Getting Started with ChromaDB - Lowest Learning Curve Vector Database For Semantic Search
10:52
How to Autofill Excel Templates Using VBA Code
Johnny Code
How to Autofill Excel Templates Using VBA Code
12:42
How to Apply SQL Relational Database Design to Excel | Create an Excel Order Management System
Johnny Code
How to Apply SQL Relational Database Design to Excel | Create an Excel Order Management System
15:56
How to Fix Selenium if it Stopped Working for No Reason
Johnny Code
How to Fix Selenium if it Stopped Working for No Reason
3:00
How to Select Intersecting/Overlapping Area of 2 Circles (or Any Shape) in Gimp
Johnny Code
How to Select Intersecting/Overlapping Area of 2 Circles (or Any Shape) in Gimp
2:08
Best Way to Find the Difference Between 2 Large Lists | Excel Power Query
Johnny Code
Best Way to Find the Difference Between 2 Large Lists | Excel Power Query
6:51
Best Way to Combine/Union 2 Large Lists Without Duplicates | Excel Power Query
Johnny Code
Best Way to Combine/Union 2 Large Lists Without Duplicates | Excel Power Query
3:26
Best Way to Find Common Values or Intersection of 2 Large Lists | Excel Power Query
Johnny Code
Best Way to Find Common Values or Intersection of 2 Large Lists | Excel Power Query
4:43
How to Track if Customers Read/Opened Your Emails Sent From PHP
Johnny Code
How to Track if Customers Read/Opened Your Emails Sent From PHP
6:22
Getting Started with Stable Baselines3 Python Reinforcement Learning Library | MuJoCo Humanoid-v4
Johnny Code
Getting Started with Stable Baselines3 Python Reinforcement Learning Library | MuJoCo Humanoid-v4
12:36
Learning to Walk Like a Zombie | Fun with Reinforcement Learning
Johnny Code
Learning to Walk Like a Zombie | Fun with Reinforcement Learning
1:22
Q-Learning Tutorial 4: Train Gymnasium CartPole-v1 on Multiple Continuous Observation Spaces
Johnny Code
Q-Learning Tutorial 4: Train Gymnasium CartPole-v1 on Multiple Continuous Observation Spaces
9:17
Me vs Q-Learning Agent (Gymnasium Mountain Car)
Johnny Code
Me vs Q-Learning Agent (Gymnasium Mountain Car)
1:33
Q-Learning Tutorial 3: Train Gymnasium MountainCar-v0 on a Continuous Observation Space
Johnny Code
Q-Learning Tutorial 3: Train Gymnasium MountainCar-v0 on a Continuous Observation Space
8:31
Increase/Decrease Animation Speed for Gymnasium Reinforcement Learning Environments
Johnny Code
Increase/Decrease Animation Speed for Gymnasium Reinforcement Learning Environments
0:51
Q-Learning Tutorial 1: Train Gymnasium FrozenLake-v1 with Python Reinforcement Learning
Johnny Code
Q-Learning Tutorial 1: Train Gymnasium FrozenLake-v1 with Python Reinforcement Learning
11:42
Install Gymnasium (OpenAI Gym) on Windows | Resolve error "Failed building wheels for box2d-py"
Johnny Code
Install Gymnasium (OpenAI Gym) on Windows | Resolve error "Failed building wheels for box2d-py"
8:16
Q-Learning Tutorial 1.1: Understand How Q-Learning "Learns" In Gymnasium FrozenLake-v1
Johnny Code
Q-Learning Tutorial 1.1: Understand How Q-Learning "Learns" In Gymnasium FrozenLake-v1
11:11
Use ChatGPT to Generate Selenium Python Code Specific to Your Webpage
Johnny Code
Use ChatGPT to Generate Selenium Python Code Specific to Your Webpage
7:11
All Ways to Click in Selenium Python | Resolve “Element is not clickable at point” Exception
Johnny Code
All Ways to Click in Selenium Python | Resolve “Element is not clickable at point” Exception
10:34
Beginner Web Scraping with Selenium Python
Johnny Code
Beginner Web Scraping with Selenium Python
14:24
How to Install Selenium Python into a Virtual Environment (venv) and setup VSCode / ChromeDriver
Johnny Code
How to Install Selenium Python into a Virtual Environment (venv) and setup VSCode / ChromeDriver
3:44
How to Copy & Reuse Transformation Steps on Another Table | Power BI / Power Query Tutorial
Johnny Code
How to Copy & Reuse Transformation Steps on Another Table | Power BI / Power Query Tutorial
1:12
Why I Kept My Lenovo (Yoga) Slim 7 Pro X [Long-Term Use Review]
Johnny Code
Why I Kept My Lenovo (Yoga) Slim 7 Pro X [Long-Term Use Review]
8:35
How to Deploy Code to Shared Web Host Using GitHub
Johnny Code
How to Deploy Code to Shared Web Host Using GitHub
4:57
Power Query: How to Load CSV Data that Grow By Columns
Johnny Code
Power Query: How to Load CSV Data that Grow By Columns
2:51
How to Capture Browser Redirects in Chrome Dev Tools
Johnny Code
How to Capture Browser Redirects in Chrome Dev Tools
1:00
Learn Just Enough Git For a Small Project
Johnny Code
Learn Just Enough Git For a Small Project
21:53
Add/Update PHP 7 or 8 in Laragon & Easily Switch Between Projects that Depend the Specific Versions
Johnny Code
Add/Update PHP 7 or 8 in Laragon & Easily Switch Between Projects that Depend the Specific Versions
1:39
How to Stop Browser from Caching Stale Copy of JavaScript or CSS File
Johnny Code
How to Stop Browser from Caching Stale Copy of JavaScript or CSS File
0:50
Basics of Integrating Stripe with PHP | Accept Credit Card Payments on Your PHP Site
Johnny Code
Basics of Integrating Stripe with PHP | Accept Credit Card Payments on Your PHP Site
9:38
How I Import Any CSV File into MySQL/MariaDB Database
Johnny Code
How I Import Any CSV File into MySQL/MariaDB Database
4:41
How to Load MySQL/MariaDB Rows Directly into PHP Class Objects
Johnny Code
How to Load MySQL/MariaDB Rows Directly into PHP Class Objects
8:17
Resolve "Cannot declare class Attribute, because the name is already in use" or similar PHP errors
Johnny Code
Resolve "Cannot declare class Attribute, because the name is already in use" or similar PHP errors
0:59
How to Forward Engineer Model Changes in MySQL Workbench
Johnny Code
How to Forward Engineer Model Changes in MySQL Workbench
4:35
Install XDebug 3 in VSCode & Troubleshoot if Breakpoints Are Not Stopping
Johnny Code
Install XDebug 3 in VSCode & Troubleshoot if Breakpoints Are Not Stopping
11:19
How to Add or Update PHPMyAdmin in Laragon for Windows
Johnny Code
How to Add or Update PHPMyAdmin in Laragon for Windows
1:51
How to Access Localhost from Mobile Phone in your Home Wifi Network
Johnny Code
How to Access Localhost from Mobile Phone in your Home Wifi Network
1:14
How to Check if Firewall is Blocking Access from Mobile Phone to Localhost
Johnny Code
How to Check if Firewall is Blocking Access from Mobile Phone to Localhost
7:17
Install/Update Laragon with PHP 8.x, MariaDB 10.x , Apache 2.x on Windows | WAMP XAMPP Alternative
Johnny Code
Install/Update Laragon with PHP 8.x, MariaDB 10.x , Apache 2.x on Windows | WAMP XAMPP Alternative
4:32
Install PHP, MariaDB, Apache, VSCode, Laragon for Beginner Web/Database Development
Johnny Code
Install PHP, MariaDB, Apache, VSCode, Laragon for Beginner Web/Database Development
15:52