Monday, November 12 , 2018, 5:07 pm | Fair 72º


Singing Robot Helps Study Human-Robot Interactions

Meet ROVER. If you’re lucky — and trigger its heat sensors — it’ll roll up to you and sing a song.

This friendly robot is the creation of Hannah Wolfe, a graduate student researcher in UCSB's Media Arts and Technology program, who’s investigating robot-human interactions.

“I wanted to create an interactive art installation that would make people happy,” said Wolfe, who is based in the rather austere environment at UCSB’s Elings Hall.

“I thought if something came up to people and sang to them that would bring joy into the space,” she said.

With a Roomba (sans vacuum) as its feet, a Raspberry Pi as its brain and an Arduino acting as a nervous system, Rover is more than an artistic endeavor, however. It is also a tool for investigating the ways humans respond to robots.

Think about it: We ask iPhone’s Siri or Amazon’s Alexa for help accessing information, making purchases or operating Bluetooth-enabled devices in our homes.

We have given robots jobs that are too tedious, too precise or too dangerous for humans. And artificial intelligence is now becoming the norm in everything from recommendations in music and video streaming services to medical diagnostics.

“Whether we like it or not, we’re going to be interacting with robots,” Wolfe said. “So, we need to think about how we will interact with them and how they will convey information to us.”

To that end, Wolfe has ROVER generate sounds — beeps and chirps and digital effects (think R2D2) — that she found elicit positive versus negative reactions from people. Meanwhile, an onboard camera records how individuals respond to ROVER.

“I looked through the literature on what kind of audio qualities express different emotions in linguistics and music research,” Wolfe said.

"While some research focuses on how to compose these sounds, there weren’t generative algorithms for sounds that could reliably convey the intended emotion — sounds that may be different, but could impart the same meaning," she said.

The results of her research were somewhat surprising: In comparison to computers, people found themselves more emotionally aroused by their desktops and laptops than by a robot that serenaded them.

“That was definitely against my expectations,” Wolfe said, noting it could be due to a variety of reasons, not the least of which is the proximity people have to their computers.

“A computer is in our personal space — something that we touch — and having it in your personal space is potentially more threatening or exciting than something in your social space,” she said.

ROVER, by contrast, is programmed to keep a polite distance from the person to whom it is singing, and therefore the lack of intimacy may result in relatively less arousal.

Wolfe’s research is one of many ongoing forays into the nature of human-robot interactions, a research field that is growing in prominence as automatons become increasingly sophisticated and share more space with people.

Wolfe points to Jibo, a commercially available “social robot” created by Massachusetts Institute of Technology media arts professor (and UCSB alumna) Cynthia Breazeal.

“Jibo is pretty much Siri with a face that looks at you and talks,” Wolfe said. “It doesn’t move around the space, but it is the beginning of social robots in the home.”

Beware the Uncanny Valley One of the most longstanding areas of research in robotics — and also one of its pitfalls — is a strange phenomenon that occurs as androids begin to more closely resemble their human creators.

“If something becomes too real but not quite real enough, it falls into the uncanny valley,” said Wolfe.

Originally a Japanese term coined in 1970 and loosely translated into English, “uncanny valley” refers to feelings of strangeness, coldness, eeriness and even disgust that arise in people when a robot begins to blur the line between machine and living, breathing human.

Star Wars’ C-3PO, for instance, has an obviously robotic build but a very human affect, which makes him harmless and endearing.

Hanson Robotics’ AI-powered Sophia, on the other hand, is far more lifelike but not quite human, making her fascinating for some, creepy for others.

“There’s been a lot work trying to figure out what exactly it is, where things fall into it and how you can kind of get around it using design,” Wolfe said.

“I’ve started looking at playing with emotive gibberish, and the sounds that ROVER makes are kind of creepy and gross, which is interesting for art, but inappropriate for social robotics,” she said.

For that reason, Wolfe focuses more on beeps and notes and digital effects as opposed to speech. However, this won’t stop her from exploring the notion of humans’ mental discomfort with almost-humans, albeit in a playful manner.

She has shown ROVER speaking gibberish at the 2017 International Symposium of Electronic Arts and is planning for another exhibition.

“I’ll be working with Sahar Sajadieh, a performance artist in media arts and technology. We were talking about having ROVER approach people and either hit on them or insult them,” Wolfe said. “We haven’t decided which.”

— Sonia Fernandez for UCSB.


Support Noozhawk Today

You are an important ally in our mission to deliver clear, objective, high-quality professional news reporting for Santa Barbara, Goleta and the rest of Santa Barbara County. Join the Hawks Club today to help keep Noozhawk soaring.

We offer four membership levels: $5 a month, $10 a month, $25 a month or $1 a week. Payments can be made using a credit card, Apple Pay or Google Pay, or click here for information on recurring credit-card payments and a mailing address for checks.

Thank you for your vital support.

Become a Noozhawk Supporter

First name
Last name
Select your monthly membership
Or choose an annual membership

Payment Information

Membership Subscription

You are enrolling in . Thank you for joining the Hawks Club.

Payment Method

Pay by Credit Card:

Mastercard, Visa, American Express, Discover
One click only, please!

Pay with Apple Pay or Google Pay:

Noozhawk partners with Stripe to provide secure invoicing and payments processing.
You may cancel your membership at any time by sending an email to .(JavaScript must be enabled to view this email address).

  • Ask
  • Vote
  • Investigate
  • Answer

Noozhawk Asks: What’s Your Question?

Welcome to Noozhawk Asks, a new feature in which you ask the questions, you help decide what Noozhawk investigates, and you work with us to find the answers.

Here’s how it works: You share your questions with us in the nearby box. In some cases, we may work with you to find the answers. In others, we may ask you to vote on your top choices to help us narrow the scope. And we’ll be regularly asking you for your feedback on a specific issue or topic.

We also expect to work together with the reader who asked the winning questions to find the answer together. Noozhawk’s objective is to come at questions from a place of curiosity and openness, and we believe a transparent collaboration is the key to achieve it.

The results of our investigation will be published here in this Noozhawk Asks section. Once or twice a month, we plan to do a review of what was asked and answered.

Thanks for asking!

Click Here to Get Started >

Reader Comments

Noozhawk is no longer accepting reader comments on our articles. Click here for the announcement. Readers are instead invited to submit letters to the editor by emailing them to [email protected]. Please provide your full name and community, as well as contact information for verification purposes only.