Creating A Game Using Pictoblox Machine Learning With Hand Gestures

 Creating A Game Using Pictoblox Machine Learning With Hand Gestures

Have you ever thought about creating a game? Maybe yes... but you couldn't because you never got the chance to do it or maybe you didn't how to.

Well, I have just the right thing- Pictoblox! 

Pictoblox is a software created by MIT for kids to do simple block coding or even advanced Python coding. It's available for free and you can download it from Google on your PC. It's easy. Just go to the following link to download the app.


Set up the app by creating an account and signing in. After installing, you'll see this default homepage.















Click on the 'Add Blocks' button and add the Hand Pose Classifier type of project in The Create New Project option.



















You'll see this window and then add classes 'Up', 'Down', 'Left', 'Right' and 'Nothing'. 

















Open the Webcam option for every class one at a time and click at least 500 pictures of yourself holding your hand in different positions respective to the class name. While doing the 'Nothing' class just click random pictures when the blue dots appear.

















After doing that click on the Train Model option and let it train the model for a couple of minutes.
















After the model training is complete, test your model by clicking the option on the right side. After testing the model, export the model in the 'Blocks' option.



















After exporting the model, add a sprite named Beetle from the sprite option and add 2 backdrops- one from your computer and one from the backdrop option.



















The backdrop you have to upload is a maze image without an apple👆.

The second one you have to upload is the Maze backdrop with the apple👇.



















After doing this, add the following code step-wise as provided in the following images...

1. In this step, we define the position, direction and size of the beetle when we click the green flag.

2. In this step, we see our Machine Learning blocks which we have to add later.

3. In this step, we add the Hand Pose identifying block so that it will identify the direction of our hand and the beetle would move in the same direction.

4. In this step, we add the sensing blocks so that if the beetle touches the maze's border it'll come to the starting spot again and when it touches the apple the backdrop would change to a Maze without an apple.


After this, save the project, rename it and then start playing!

I've provided a video below of me playing the game. ENJOY!


Thank You!






















Comments

Post a Comment

Popular posts from this blog

Creating a Home Automation Project Using Xiao board and Wi-Fi

Image
 Creating a Home Automation Project Using Xiao board and Wi-Fi You must've read one of my previous blogs where I used a Xiao ESP32C3 board to control an LED using Arduino IoT Cloud's dashboards using the integrated wi-fi of the board. This blog is about the next step. In this blog, we'll learn how to actually integrate it in our home. We'll be using the Arduino IoT Cloud's dashboard. What you'll need: A XIAO ESP32C3 board and its cable A single-channel relay The circuit from inside an AC-DC 5V adapter A light bulb holder 7-8 electrical wires A zero PCB 2 screw connectors Some wires  A 10x10x5 cm box with screw connecting pillars Tools: Screw driver Computer/PC/Laptop Soldering gun and its accessories Instructions: 1) First, take your  XIAO ESP32C3 board and its cable and connect it to your computer. Open  Arduino IoT Cloud on your browser. We're first going to set up our  XIAO ESP32C3 board.  2) Do all the necessary steps to sign in to Arduino Cloud. After ...
Read more

Making a Neon LED Sign Board

Image
Making a Neon LED Sign Board We had ordered some neon LED strips about two years ago when we planned to use them for various projects. However, over time, we forgot about them, and they were left in the cupboard all this time until we finally found them two days ago. When I first saw them, I didn't know what they were. Then, my father told me that they were Neon LED Strips used in LED signboards.   I was fascinated to see them. Then, my father suggested that I make an LED signboard for the DIY Lab. I was thrilled to create the signboard. First, I connected the LED strips to a power supply to check if they were working, and to my surprise, they looked beautiful. The bright, neon light was mesmerising.  I even switched the lights off to see them in the darkness, and they were looking awesome. Now, determined to make the signboard, I started planning. We first took references from the internet and understood the basic process to make the signboard. Then, we decided to use a big, ...
Read more

Creating a Home Automation Project Using MIT App Inventor

Image
Creating a Home Automation Project Using MIT App Inventor You must've read one of my previous blogs where I used a Xiao ESP32C3 board to control an LED using Arduino IoT Cloud's dashboards using the integrated wi-fi of the board.  Instead of using the Arduino Cloud, I am now creating an app with MIT App Inventor. This app will include the board's IP address to connect our phone to its own small Wi-Fi network. But, we'll not only do this, we're going to practically implement this in our house using a real light bulb. To do that, we will need: A XIAO ESP32C3 board and its cable A single-channel relay A light bulb holder 7-8 electrical wires Some wires A 10x10x5 cm box with screw connecting pillars Tools: Screw driver Computer/PC/Laptop Soldering gun and its accessories Instructions: 1. Take your Xiao board and upload the code provided below. Before doing that, you can change the *ssid of your Wi-Fi name to whatever you want and also modify its *password according to y...
Read more