Qinghai Quake and robots

What is it with disasters? They’re coming fast and furious. Here’s the 411 on robots at the China quake.

The Qinghai quake is the latest of the series of tragedies. Prof. Bin Li at the Shenyang Institute of Automation and an active member of the IEEE Technical Committee on Safety Security Rescue Robots, contacted the Chinese national earthquake response service this morning. It doesn’t look like ground robots are appropriate– the structures are mostly small and constructed from brick and mud. That type of construction is problematic– the brick and mud turns to a liquidized dust, acting like water to fill all the voids and displaces air. Even if there are voids, the suspended dust causes respiratory distress. Eric Rasmussen InSTEDD has many tales to tell of the similar Turkey earthquake.

China, by the way, does have at least one rescue robot. Bin tells me it was deployed to the mine collapse but could not be used because it wasn’t waterproof. (A gentle aside to manufacturers: d’uh!)

Aerial vehicles might be helpful for tactical operations and I can’t help thinking that an unmanned marine vehicle with an acoustic camera capable of penetrating turbid waters could provide more information about that crack in the big dam…

Bin was a participant in the NSF-JST-NIST workshop at Disaster City at the first of the month and we look forward to working with him and his group. In the meantime.. I’m speaking tomorrow at AUVSI day at the Capitol– I hope that in the future we can do more than offer our prayers.

Robin

China and West Virginia: Mobile Robots for Mine Rescue

Just as I was sitting down to blog (with relief) about the rescue of the Chinese miners, the explosion in West Virginia hit the news. Terrible, terrible. Our prayers go out to the miners and families.

Rescue robots have been used in mine disasters in the past and perhaps they will be of service in Raleigh, WV.

Some background on mine rescue robots. From 2007-2008, I led a study for the Mine Safety and Health Administration (MSHA) on underground mine rescue robots, getting to work with Dr. Jeff Kravitz and his team, attending a rescue competition at the MSHA academy in West Virginia, plus participated in two different mine disasters: Midas Gold Mine and Crandall Canyon Utah. A summary of the study was published in IEEE Robotics and Automation Magazine.

Jeff had been exploring rescue robots from mine disasters since before 9/11(!) and has pioneered their use- MSHA is second only to CRASAR in the number of deployments to actual incidents.

Coal mine disasters are tricky for robots- in part because methane is often present. As in “hmm… which would be worse- the explosion or the huge amounts of coal catching fire?” I know of only 1 robot rated to work in those conditions and not trigger an explosion- MSHA’s modified Remotec Wolverine, called V2. Making it intrinsically safe made it much bigger and much heavier, which are not necessarily pluses for agility. MSHA has an iRobot Packbot and is upgrading it, while NIOSH has a set of Gemini robots developed by Sandia Labs. The smaller robots we used at Midas and Crandall Canyon didn’t have to be intrinsically safe because one was a gold mine and the air quality testing at the coal mine showed there was no significant presence of methane- mine environments in the Rockies are different from mine environments in the East.

Mine disasters are also tricky because there are at least three different scenarios for using a robot- and each scenario favors a different type of robot. One size does not fit all. I’ll try to upload some slides to go through the unique challenges posed by each scenario.

Chile and tsunami: what robots can do

The news this morning of the Chilean earthquake continues to highlight the possibilities for robots to help in the response and recovery.

Certainly the big surveillance UAVs such as the Predator and Global Hawk variants can give a “big picture” overview, but don’t forget that search and rescue is largely done by small teams working independently who need information “on demand”. They can’t tell you what they want until they get there. And if they don’t get within a few minutes, they move on. Small helicopter like UAVs can help them assess a collapsed building, see people trapped on the other side of a pile of rubble, and get the views they want. Small, shoe-box sized robots can drive into rubble deeper than a search camera or boroscope can go, finding voids that would be otherwise missed. And unmanned marine vehicles can determine if the substructure of bridges and sea walls is still intact and whether rubble and debris is being washed into the footings and will cause damage.

We’re standing by, hoping to help and hoping to learn. And hoping that one day responders all over the world will have these robots to use immediately.

Living with Robots screened at Sundance

Honda’s short-film documentary, Living with Robots, was screened at the Sundance Film Festival on Jan 22, 2010. Rescue robot footage from CRASAR and director Robin Murphy appear throughout the documentary.[youtube]http://www.youtube.com/watch?v=AF0WsvfG_nI[/youtube]

Why New Technologies Rarely Show Up at Disasters

I’m getting a lot of questions about why wasn’t CRASAR, or any robotic technology, in Haiti. Interestingly, some of the questions indicate anger at agencies and while I thought CRASAR could have been of use in saving lives and learned important lessons for science, I’d like to defend the decision not to invite us.

It is always a difficult call for an incident commander to bring in new technology that they have not trained with or has been shown definitely to work. A disaster is just that—it’s usually a surprise and by definition exceeds resources. So the command structure is busy just trying to do the regular things of getting traditional resources to the right place. And people under stress fall back to the things they are most comfortable with. Consider too, the individual responders are too tired and stressed to take on out new equipment (more things to lug around) even if they are familiar with it.  That’s why for the first 4 years following 9/11, I gave nearly a hundred talks to response agencies and participated in many exercises so that we could show the responders what the robots could do and get their comfort level up. We created a 2-hour awareness course and a 10 hour introductory course that responders could get continuing ed credits for. The role of giving responders hands-on time with robots has largely been taken over by NIST and their rescue robot standards program.

And remember most new equipment has terrible interfaces and ergonomics, so it is a true pain to use.  This means bringing trained operators to use the equipment on behalf of the responders adds to the logistics footprint- here’s a couple more people that aren’t on the official roster and have to be accounted for.  And the tech operators may have no experience or response training- and there are basic procedures and terminology that you need to know. The liability and logistics is just hard. It is way easier for the incident commander to just to say “no.” CRASAR is all about the technicians getting response training so we won’t be a burden or a liability.

Also keep in mind that disasters always bring out people who are well-intentioned but have no clue whatsoever. I have some horror stories from the Crandall Canyon Utah mine disaster so I can definitely sympathize with the incident commanders.  The fire service typically just says “no” based on past experiences because they don’t have time to get distracted with such things—so if they didn’t know you and felt comfortable with you before a disaster, you aren’t likely to get your foot in the door. Trying to pressure them just makes it worse for the rest of us.  The robots used at 9/11 were invited by the NY State and City emergency departments through the connections of Lois Clark McCoy at NIUSR, but the responders viewed them warily and did not take us to the field. John Blitch led a small group that used the robots on the first day but the second day when you couldn’t get to the site without being part of a tasked assignment, we just sat there. A guy from a major government lab in a suit was wandering around the Javits Center where all the response teams were housed talking about how great the lab’s sensors were. (Back up- A guy in a suit. At a disaster site. That certainly undermined any credibility that these guys had ever stepped outside of their lab, much less did rigorous field testing. ) Then suddenly the FEMA teams started asking for us to come with them- primarily because Chief Ron Rodgers (bless him!) at Florida Task Force 3 posted to a responder chat room that my group had worked with him in the field and the students and I had completed basic response training. We became known quantities.

There’s also a matter of scale. The incident command team is responsible for doing the most good for the most people. Will a couple (or even a hundred) of experimental technologies really make a difference and be worth the disruption to the already stressful way of doing things and additional personnel and logistics burden? Or is a more rational decision to focus on doing the basics?  That’s the incident command teams call and I respect that.

The point is not whether CRASAR participates in a disaster  but rather whether we are getting closer to the day when the responders routinely take the robots and other technologies that they own and operate to the incident- that’s our mission.

Haiti: Prayers and best wishes

The Haiti earthquake is looking grim. At this point CRASAR has not been contacted about assisting and is unlikely to be.  The two USAID teams, CA-TF2 and VA-TF1 , are being deployed. Reports suggest that there was a hospital collapse. In these large geographically distributed disasters, aerial assets (manned or unmanned) are helpful in establishing what is damaged, where people appear to be in the most danger or need, and whether roads are passable. Ground robots are helpful for large buildings, but, in general, dogs are the biggest help in finding victims in residential areas– dogs smell faster  much faster than the most agile robot can get in the rubble. Marine vehicles can be of value in inspecting sea walls and checking shipping channels. Let’s keep rooting for improvements to subsurface sensors and other equipment that can help the teams. Godspeed to CA-TF2 and VA-TF1! And all of Haiti is in our prayers!

Robotics Rodeo at Ft. Hood

RIMG0149

RIMG0159

RIMG0149

I had the good fortune to attend the Robotics Rodeo at Ft. Hood last week- a rodeo of unmanned ground robotics hosted by U.S. Army Tank Automotive Research, Development and Engineering Center (TARDEC) and Fort Hood III Corps (go Phantom Warriors!). A wonderful experience and many thanks to the CO Gen. Ricky Lynch (he has MS in robotics from MIT).

Some pictures are above and some thoughts about the commercialization of robotics…

According to a good friend, Bill Kearns, at the turn of the last century, there were over 200 car manufacturers in North America. (His family’s business was one of them.) Each manufacturer had something special, a starter motor, independent suspension, what have you. An amazing array of advances, some redundant, many brilliant.

But the problem was, they weren’t on the same car. Who wanted the latest, greatest engine on a car that you had to use with a hand crank?

Durant and Ford were credited with manufacturing but sometimes it is missed that they it wasn’t just that they mastered mass production, they mastered mass production of the right thing. They were among the first to view the cars as the sum of its parts. The superior technology of a component (usually invented by the owner) was not the reason for existence but rather a marketable feature of a desirable whole. As was stressed in one of my mechanical engineering courses, automobile companies are manufacturing companies, which make things for people to buy, not engineering companies, which create or investigate ideas for someone else to make into things for people to buy. Automotive companies at the turn of the century were really about engineering, not about the car. A similar pattern of scattered developments which were consolidated into systems happened in the aerospace industry.

The Robotics Rodeo reinforced my opinion that ground robotics is in the same state. Interesting pieces, some brilliant engineering, lots of duplication, and few useful systems.

One conclusion is that this is the Natural Order of Things and will sort itself out over time. This line of reasoning is: perhaps some duplication will result in lesser technologies occasionally trumping superior technologies and some dollars will be wasted. But this should be tolerated since the duplication and competition is usually efficient overall and reduces purchase prices, right? Besides, premature standards or regulations can kill off an emerging technology.

The Natural Order of Things philosophy has problems. In asymmetric warfare, do we have time or dare risk being beta-maxed by an adversary? And in days of trillion dollar deficits, will we be able to afford the cost of duplication? Remember, the government is subsidizing the UGV market (either through DoD or law enforcement) whereas automotive industry was private capital. There is no real consumer market for these devices. Is UGV development is in fact regulated by the invisible hand of capitalism or being de facto regulated by current defense acquisition processes. If so, is that a good or a bod thing? I don’t know…

Wildland firefighting, UGVs, and UAVs

I think UAVs for wildland firefighting is a good thing, honest!

I’m at the AUVSI North America conference– yesterday I gave two papers, one on the wildland firefighting descriptive analysis that we did with Lockheed Martin on the use of ground robots and one on our Rollover Pass, Texas, response. The wildland firefighting paper made the Flight Global Daily newsletter today (probably as the token application du jour that didn’t involve weaponization). I’m quoted giving a list of problems with UAVs for wildland firefighting- that was the list of problems from the focus group of subject matter experts.

There may be a killer UAV with my name on it… please, please, call them off. I love UAVs, honest!

The list of problems is based on what they’ve seen in UAVs to date, not what’s possible or what is even available. Sadly the disconnect between what exists and what the response community has access to remains depressingly high. Bob Roth and Tom Zajkowski with the Forestry Service are working hard, with Greg Walker’s group at Alaska and Brian Argrow’s team at Colorado combining research and fieldwork.

But the poor firefighters often only see and interact with vendors who come out of nowhere at a disaster and claim to have the best technology; while well-meaning, the technology is often a poor match because there is no understanding of what the responders really need. Trust me, it’s not covered in any of the movies, you actually have to talk with them. Before a disaster. During, they are way too busy and are justifiably deeply suspicious of anything outside of their network of relationships..

Which reminds me about the time a group of technologists were told by an agency that their technology wasn’t needed, but showed up at the disaster anyway (I warned them not to do that), and were jailed and their gear impounded. Yep, interfering with a response is an offense. And the incident commander makes the call as to what constitutes interference.

Mismatched technology plus bad manners = deep abiding negative view of robots.

Anyway, ground robots good, aerial robots good, all good for wildland firefighting when applied appropriately! But we’ve got to educate the firefighters about what’s out there and ourselves about what they need. Don’t shoot the messenger 😉

Beyond Asimov; The Three Laws of Responsible Robotics

IEEE Intelligent Systems just printed our (David Woods, OSU, and my) article about “Beyond Asimov: The Three Laws of Responsible Robotics” and put “Beyond Asimov” as one of the articles on the cover… and the hate mail has started!

So what does Asimov and his Three Laws of Robotics have to do with rescue robotics? The Three Laws are being taken seriously as a framework for discussing human-robot interaction. Rescue robotics has humans behind the robot and humans in front of the robot- it’s about as human-centric as you can get. I became one of the early drivers of the human-robot interaction community (I co-chaired the seminal 2001 DARPA/NSF study) precisely because I found through my fieldwork that the poor interaction was the limiting factor. No matter how bad the rescue robots were in terms of locomotion, communications, sensing- the horrible mismatch between the robots and the human cognitive abilities for the environment was the limiting factor. It isn’t just interfaces, it is the set of fundamentally, pervasively wrong assumptions about how people interact with robots.

Whenever I hear some grad student talking about wanting to design robots which meet Asimov’s Three Laws and thereby provide perfect human-robot interaction I get ill. One year I heard a researcher telling the press that their robot met the First Law of Robotics (a robot may not injure a human) because it was able to avoid people. Except that it was simply avoiding heat sources and people happen to be warm.

To say AI researchers tend to be technological optimists is an understatement.

The paper came about when I began to read Moral Machines (David texted me that I had to stop whatever it was I was doing and go read it now, he was so put out by the book). I next-day-ed the book, and between that and the Living Safely with Robots tome, shouted “enough with the Asimov’s Laws already as some sort of gold standard for robot ethics. It was a literary device. Let it go!” My family tends to find things to do away from the house at time like that. I thought the Moral Machines actually made a strong, though unintentional, argument for why Asimov would get sued if he were a robot manufacturer.

So I whipped up a draft on alternative laws one Saturday morning. Leila Takayama and Victoria Groom from Cliff Nass’ group at Stanford read it, make great suggestions, and included in their HRI workshop. I sent it to David to read and he came back with excellent ideas, tons of experiences and examples of how autonomy and automation fails, and way better prose. I insisted that we stay with three laws and that they had to be symmetric with Asimov’s– sticking with literary convention to make a point. I agree with David, if you really want laws, it’d be better to start over. Anyway, we put a version in an IEEE ICRA workshop (thanks Cindy for presenting!) and continued to refine. We ran it past Robert Hoffman who saw the possibilities of getting a more informed discussion going and after a rapid edit cycle and a discussion with Jeff Bradshaw, it’s in print. (I’m sharing names in a Good Way, please don’t go yell at them if you hate the paper.)

Hopefully, besides hate mail, we’ll get a real intellectual discussion going instead of extreme quotes in the media. AI robotics is capable of so many things, I hate to handicap true progress by adherence to a cute literary devices designed to create problems.