Misty Lessons
  • Misty Lessons
    • 📖Welcome to Misty Lessons
    • 📚Get to know your Misty
    • 📲Connect to Misty
    • 👩‍💻Misty Studio
    • 🖥️Desktop Environment
    • ⬆️Update your Misty
    • 👥Projects
  • Blockly
    • 🧩Blockly Lessons
      • 🤸Lesson 1: Movement
      • 🎶Lesson 2: Voice and Sound
      • 🎭Lesson 3: Expressions
      • 🎥Lesson 4: Robot Cinema
      • 🛠️Lesson 5: Events
      • ☺️Lesson 6: Face recognition
      • 🔢Lesson 7: Variables and Functions
      • 💬Lesson 8: NLP
    • 🏫Blockly projects
  • Blockly Elements
    • ⚛️Misty Blocks
      • Movement
      • Speech
      • Audio
      • Vision
      • Events
      • Miscellaneous
      • NLP
      • System
    • 🔁Basic Blocks
      • Logic
      • Loops
      • Math
      • Text
      • Lists
    • 🅰️Advanced Blocks
      • Variables
      • Functions
  • Python
    • 🐍Python Lessons
      • 🦿Lesson 1: Loco-motion
      • 🤖Lesson 2 : Build a character
      • 🧠Lesson 3: Create memories
      • ⚒️Lesson 4: Event skills
      • 👀Lesson 5: Expand awareness
      • 🔗Lesson 6: Compact code
      • 🗣️Lesson 7: Start a conversation
  • Python Elements
    • 🐸Misty Python API
      • Motion and Mobility
      • Display and LED
      • Record Assets
      • Change/Remove Assets
      • Stream Assets
      • Get Assets
      • Events
      • Sensor Events
      • Speech and NLP
      • Arduino Backpack
      • System
      • Slam
    • 📗Python Definitions
  • Python Projects
    • 🔮MistyGPT
    • 🚨Misty Intruder Alert
    • 📺Conference Assistant
    • 🏷️QR code detector
    • 🕵️‍♂️Misty follow human
    • 👋Misty wave back
    • 🖲️Misty OA
    • 🌐Get weather
    • 🚚Misty Delivery
    • 🫂Motivational Misty
    • 🖼️Misty Museum Guide
    • 🎃Who for Halloween
  • ARDUINO
    • ♾️Arduino Backpack
    • 🦎Arduino
    • 🔧Arduino Lessons
      • 🔌Arduino to Misty
      • ➕Misty to Arduino
  • ARDUINO PROJECTS
    • 🛠️Misty Tracker
    • 🦾Misty Arm
  • Community Projects
    • 🌤️Misty weather forecaster
  • HARDWARE EXTENSION
    • ⚙️Arduino breadboard support
    • 🦾Misty arm
    • 🥤Tin holder
  • Resource Database
    • 📁Image files
    • 📁Audio files
    • 📁Languages
    • 📁Known objects
    • 📁NLP Actions
    • 📁Action Commands
    • 📁ChatGPT PDF files
    • 📁AR Tag Dictionary
    • ⚙️Technical Specifications
Powered by GitBook
On this page
  • Object recognition
  • Dance party
  • Phrase recognition and random behaviour
  1. Blockly

Blockly projects

If you want to challenge your students with Misty blockly programming this is the right page!

Last updated 7 months ago

Object recognition

The first challenge for your students after they finish the Blockly lesson course is to create an Object recognition event with Misty entering in a routine and then recognizing at least two objects. In this case, we selected something that could be easily found in a classroom: a book and a person.

The first step is to create an initial Misty behaviour, like this one, including different , and colours to your Misty.

Then it's necessary to create the events that will handle the objects that your Misty will recognize.

For example, a book:

or a person:

Make sure that your Misty will have a unique reaction to each recognized object and now you're ready to call the object recognition event:

You can stop Misty's object detector after completing the recognition by enabling the grey block ("stop object detector") at the end of the event handler for each recognized item.

After this event, you can create new animations or interactions with Misty!

Dance party

In this challenge, Misty will have to learn which types of music/dance exist and also how to dance them!

For example, we selected Waltz and Headbang.

To make Misty learn which type of music/dance it's necessary to create a context that will train her AI capabilities to make her recognize the words in the sample label

And to make Misty learn how to dance describe what you want her to do with an action block! Don't forget to upload the music that Misty will play on the Explore>Expression page and then select it.

You need to run this blockly code before your next ones, in this way, even if Misty will not do anything she'll learn all that she needs for your skill!

Now it's time to create some interaction:

Use NLP blocks to build your very original conversation with Misty including your context in the first state and your actions in the next ones

After you run the code, also this block can be disabled because Misty will have learnt it.

If you want to apply changes to your structure feel free to keep it enabled and Misty will delete the previous conversation and create a new one with the same name.

When you're satisfied, you can use these blocks to run it!

Phrase recognition and random behaviour

With this latest challenge, your Misty will assume a random behaviour when suddenly woken up!

Also in this case is best to create a sequence of actions before the actual skill to create context.

In this case, Misty will pretend to sleep and she will extract a random number between 1 and 3, it will help us later.

Then it's necessary to create functions that will handle every number:

And last but not least the listening event that, once heard the word, will assign to each number its action.

In this case, you cannot disable the functions because they are not memorized in Misty's memory as it was for the NLP.

Check all !

This challenge involves Misty's and her great skills in dancing and having fun!

We'll use the extracted number to select one of the three actions that Misty can do while she listens to the.

🏫
Misty's known objects
NLP capabilities
faces
audio
Misty word