Misty Lessons
  • Misty Lessons
    • 📖Welcome to Misty Lessons
    • 📚Get to know your Misty
    • 📲Connect to Misty
    • 👩‍💻Misty Studio
    • 🖥️Desktop Environment
    • ⬆️Update your Misty
    • 👥Projects
  • Blockly
    • 🧩Blockly Lessons
      • 🤸Lesson 1: Movement
      • 🎶Lesson 2: Voice and Sound
      • 🎭Lesson 3: Expressions
      • 🎥Lesson 4: Robot Cinema
      • 🛠️Lesson 5: Events
      • ☺️Lesson 6: Face recognition
      • 🔢Lesson 7: Variables and Functions
      • 💬Lesson 8: NLP
    • 🏫Blockly projects
  • Blockly Elements
    • ⚛️Misty Blocks
      • Movement
      • Speech
      • Audio
      • Vision
      • Events
      • Miscellaneous
      • NLP
      • System
    • 🔁Basic Blocks
      • Logic
      • Loops
      • Math
      • Text
      • Lists
    • 🅰️Advanced Blocks
      • Variables
      • Functions
  • Python
    • 🐍Python Lessons
      • 🦿Lesson 1: Loco-motion
      • 🤖Lesson 2 : Build a character
      • 🧠Lesson 3: Create memories
      • ⚒️Lesson 4: Event skills
      • 👀Lesson 5: Expand awareness
      • 🔗Lesson 6: Compact code
      • 🗣️Lesson 7: Start a conversation
  • Python Elements
    • 🐸Misty Python API
      • Motion and Mobility
      • Display and LED
      • Record Assets
      • Change/Remove Assets
      • Stream Assets
      • Get Assets
      • Events
      • Sensor Events
      • Speech and NLP
      • Arduino Backpack
      • System
      • Slam
    • 📗Python Definitions
  • Python Projects
    • 🔮MistyGPT
    • 🚨Misty Intruder Alert
    • 📺Conference Assistant
    • 🏷️QR code detector
    • 🕵️‍♂️Misty follow human
    • 👋Misty wave back
    • 🖲️Misty OA
    • 🌐Get weather
    • 🚚Misty Delivery
    • 🫂Motivational Misty
    • 🖼️Misty Museum Guide
    • 🎃Who for Halloween
  • ARDUINO
    • ♾️Arduino Backpack
    • 🦎Arduino
    • 🔧Arduino Lessons
      • 🔌Arduino to Misty
      • ➕Misty to Arduino
  • ARDUINO PROJECTS
    • 🛠️Misty Tracker
    • 🦾Misty Arm
  • Community Projects
    • 🌤️Misty weather forecaster
  • HARDWARE EXTENSION
    • ⚙️Arduino breadboard support
    • 🦾Misty arm
    • 🥤Tin holder
  • Resource Database
    • 📁Image files
    • 📁Audio files
    • 📁Languages
    • 📁Known objects
    • 📁NLP Actions
    • 📁Action Commands
    • 📁ChatGPT PDF files
    • 📁AR Tag Dictionary
    • ⚙️Technical Specifications
Powered by GitBook
On this page
  • Text-To-Speech (TTS)
  • Stop speaking
  • Speech and Keyphrase recognition
  • Capture speech
  1. Blockly Elements
  2. Misty Blocks

Speech

Last updated 1 year ago

In this folder, you will find more information about Misty's speech capabilities and how to use the speech blocks.

Text-To-Speech (TTS)

Text-to-speech is one of the most important tools that you will need to give Misty a voice. You can select your favorite language and insert a text value block with your unique text to have Misty say it in the language that you've chosen.

You can adjust the pitch of Misty's voice from 0 (Deep), 1 (Default) to 2 (High).

Here you can find a list of all the languages that Misty can speak:

Arabic, Bengali, Chinese, Czeck, Danish, German, Greek, English, Spanish, Estonian, Finnish, Filipino, French, Gujarati, Hindi, Hungarian, Indonesian, Italian, Japanese, Khmer, Kannada, Korean, Malayalam, Mandarin Chinese, Norwegian, Nepali, Dutch, Polish, Portuguese, Romanian, Russian, Sinhalese, Slovac, Sundanese, Swedish, Tamil, Thai, Turkish, Ukrainian, Urdu, Vietnamese.

In most of these languages, you can select a male or female voice, but we suggest using the female one because it matches Misty's character and personality more. Afterall, she was designed to be the power girl of the robot world.

Stop speaking

If Misty is speaking and you want her to stop at a specific point, you can use a timer block and the stop speaking block to let her know.

Speech and Keyphrase recognition

Speech recognition allows Misty to record your speech and convert it into text that she can understand. This tool will be essential when you start creating conversations with Misty. The keyphrase recognition blocks use speech recognition to record specific keywords or keyphrases. These can be useful when you want to trigger sequences using a word or a phrase. The default keyphrase for Misty is 'Hey Misty'.

Once you've trained your Misty to recognize specific words you can use these two blocks in order to start or end Misty's "listening mode" for keyphrases. When Misty will show you that she is listening by turning her head tally light blue.

Capture speech

This block starts capturing speech in a new audio recording. By default, Misty's chest LED pulses blue when she is recording audio or listening for the key phrase. Misty's head tally light also turns on when she is recording audio or video.

Misty waits to start recording until she detects you speaking. She then records your speech until she detects the end of a question or statement. By default, Misty records speech up to 7.5 seconds.

To learn more about Misty's conversational capabilities, you can jump to NLP

⚛️
speech blocks
text to speech block
stop speaking block
keyphrase blocks
capture speech block