Misty Lessons
  • Misty Lessons
    • 📖Welcome to Misty Lessons
    • 📚Get to know your Misty
    • 📲Connect to Misty
    • 👩‍💻Misty Studio
    • 🖥️Desktop Environment
    • ⬆️Update your Misty
    • 👥Projects
  • Blockly
    • 🧩Blockly Lessons
      • 🤸Lesson 1: Movement
      • 🎶Lesson 2: Voice and Sound
      • 🎭Lesson 3: Expressions
      • 🎥Lesson 4: Robot Cinema
      • 🛠️Lesson 5: Events
      • ☺️Lesson 6: Face recognition
      • 🔢Lesson 7: Variables and Functions
      • 💬Lesson 8: NLP
    • 🏫Blockly projects
  • Blockly Elements
    • ⚛️Misty Blocks
      • Movement
      • Speech
      • Audio
      • Vision
      • Events
      • Miscellaneous
      • NLP
      • System
    • 🔁Basic Blocks
      • Logic
      • Loops
      • Math
      • Text
      • Lists
    • 🅰️Advanced Blocks
      • Variables
      • Functions
  • Python
    • 🐍Python Lessons
      • 🦿Lesson 1: Loco-motion
      • 🤖Lesson 2 : Build a character
      • 🧠Lesson 3: Create memories
      • ⚒️Lesson 4: Event skills
      • 👀Lesson 5: Expand awareness
      • 🔗Lesson 6: Compact code
      • 🗣️Lesson 7: Start a conversation
  • Python Elements
    • 🐸Misty Python API
      • Motion and Mobility
      • Display and LED
      • Record Assets
      • Change/Remove Assets
      • Stream Assets
      • Get Assets
      • Events
      • Sensor Events
      • Speech and NLP
      • Arduino Backpack
      • System
      • Slam
    • 📗Python Definitions
  • Python Projects
    • 🔮MistyGPT
    • 🚨Misty Intruder Alert
    • 📺Conference Assistant
    • 🏷️QR code detector
    • 🕵️‍♂️Misty follow human
    • 👋Misty wave back
    • 🖲️Misty OA
    • 🌐Get weather
    • 🚚Misty Delivery
    • 🫂Motivational Misty
    • 🖼️Misty Museum Guide
    • 🎃Who for Halloween
  • ARDUINO
    • ♾️Arduino Backpack
    • 🦎Arduino
    • 🔧Arduino Lessons
      • 🔌Arduino to Misty
      • ➕Misty to Arduino
  • ARDUINO PROJECTS
    • 🛠️Misty Tracker
    • 🦾Misty Arm
  • Community Projects
    • 🌤️Misty weather forecaster
  • HARDWARE EXTENSION
    • ⚙️Arduino breadboard support
    • 🦾Misty arm
    • 🥤Tin holder
  • Resource Database
    • 📁Image files
    • 📁Audio files
    • 📁Languages
    • 📁Known objects
    • 📁NLP Actions
    • 📁Action Commands
    • 📁ChatGPT PDF files
    • 📁AR Tag Dictionary
    • ⚙️Technical Specifications
Powered by GitBook
On this page
  • Aim
  • Voice and Speech
  • Challenge 1: Hello world!
  • Challenge 2: Start a dialogue
  • Challenge 3: Action goodbye
  • Sound and Audio
  • Challenge 4: Vocal expressions
  • Challenge 5: Record audio
  • Challenge 6: Upload your favourite song
  • Challenge 7: Time your song
  • Challenge 8: Misty Dance
  • Up Next 👇
  1. Blockly
  2. Blockly Lessons

Lesson 2: Voice and Sound

Last updated 1 year ago

Aim

The aim of this lesson is to understand how to enable Misty's voice and program her to speak and play audio. By the end of this lesson, you'll be able to understand how to use Misty's speech and audio capabilities in any way you prefer. If you have any questions about Misty's voice and sound capabilities, you can check out Speech and Audio.

Voice and Speech

Challenge 1: Hello world!

Besides physical greetings you can also have Misty greet her human friends with words. Now that you've mastered Misty's movements, let's hear what she has to say. Select the speak block from the 'Speech' tab in Misty Blocks and nest a text block from the 'Text' tab in Basic Blocks. You can identify your text block by the double quotation marks (" "). Try out, writing your first sentence in the text block and select your language. You can also adjust the pitch. The pitch value must be higher than 0, her default is 1.0. What would you like Misty to say?

Challenge 2: Start a dialogue

Once you've found your favorite voice and pitch, let's create a dialogue where Misty plays two robot characters. You can select a different pitch and a different voice in the same language to create more characters. How would you continue this dialogue?

Challenge 3: Action goodbye

After all that talking it's nice to give Misty an exit out of the dialogue. Let's give her a chance to wave and say goodbye. Try combining the speech blocks and the movement blocks. Connect the blocks in a sequence that you are comfortable with. How would you customize it?

Sound and Audio

Challenge 4: Vocal expressions

Besides her wonderful voice and speech capabilities, Misty can also be a little vocal about her feelings and has a number of vocal expressions that you can choose from. Select the play audio block in the 'Audio' tab in Misty Blocks to try out some of her vocal expressions. You can explore them in the drop down list or the resource database Audio files. Try out adjusting Misty's volume in a range from 0 to 100.

Challenge 5: Record audio

Misty can also record your voice and other sounds. Connect the recording block from the 'Audio' tab to let Misty record your voice. After you complete recording the audio file will be automatically saved in Misty's memory and you will be able to select it in the drop down list in the play audio block. Remember to keep the file-type .wav.

Challenge 6: Upload your favourite song

Do you want Misty to become your personal DJ and play your favorite songs? Then she has just the block you need. Add the upload audio block in the 'Audio' tab and click on the check box, a desktop tab will appear. From your desktop, select your song and press upload/open, then a check mark will appear in your upload audio block and the name of the song in the <filename> field.

Press the run button to let Misty save the file in her memory. Success! Your song is now uploaded.

Important: Before using the uploaded audio file you always need to run the program only with the upload audio block, then refresh the page. After that you will be able to find your song in the play audio file block. If it doesn't show up in the drop down list of the play audio file block try running the upload audio block again.

After you upload the audio you can delete the upload audio block because the audio is already saved.

Note: Remember that you can't upload two contents with the same name, if so, the <filename> will not change and your new block will not upload the audio, because Misty will see that she already has the same name in her memory.

Challenge 7: Time your song

If you only want to play a short segment of your song you can connect a timer block and a stop audio block from the 'Audio' tab. Try out playing the song for only 10 seconds.

Challenge 8: Misty Dance

Now that Misty can play your favorite song, let's combine speech, movements and audio to teach her how to dance and sing!

You can start by uploading the song, then try out making Misty drive forward, say the name of the song and create choreographed dance. Which dance will you create?

If you are unsure of how you want to build it, you can use the example below of Misty Dancing the Moonwalk.

Up Next

👇
🎭Lesson 3: Expressions
🧩
🎶
Page cover image