Hurricane Irene: hope it’s not 7.5 days after landfall that robots get deployed

The Roboticists Without Borders members are standing by to assist with Hurricane Irene at no cost.

We’ve been pinging our contacts in the response and emergency management communities to remind them about the uses of robots. I recently presented a paper at AUVSI that analyzed the 8 known deployments of robots at 7 disasters in 2010– if the incident command agency or company already had robots or an agreement in place, robots were used with 0.5 days. If not, it was an average of 7.5 days before the robots were used (land, marine, or air– that wasn’t a factor), well beyond the critical life saving first few days. 10 years after the successful use at 9/11, robots still haven’t been integrated into responses.

For a hurricane, as with a small earthquake or tornado, UAVs and marine vehicles tend to be of more immediate and impact larger regions than ground robots. That’s because there is usually little damage to large numbers of commercial buildings- instead homes are devastated. But homes create debris fields less than 3m deep, which canines and existing tools work great with and faster than small ground robots. State National Guard teams often fly Predators, but don’t rule out the value of small UAVs hand launched by response teams to get on demand “hummingbird” views of the situation.

New Jersey has two UASI teams with ground robots and I’ve heard they’ve been looking at small UAVs, but I don’t know of any other response agencies in the projected area with rescue robots. Please let me know if there are (we’ll mail you a CRASAR patch for confirmed info).

But regardless, my thoughts on Hurricane Irene  comes down to this: I hope that no lives will be lost and damage will be minimal.

Japanese Colleagues Get JST Grant and CRASAR plans its return

Prof. Fumitoshi Matsuno, the vice-president of the International Rescue Systems Institute (IRS), and the organizer of the IRS-CRASAR deployment with the ROVs north of Sendai had just received a grant from the Japanese Science and Technology agency according the Japan Times. The IRS team certainly deserves funding for their continued efforts. This grant matches our NSF RAPID.  We have received the second phase funds of our RAPID and expect to return to work with Prof. Matsuno and Prof. Kimura again in September or October. Thank you NSF!

Presentation at the Preliminary Report on the Disaster and Robotics in Japan: Special Forum at ICRA 2011

forum position.pptx is the presentation I gave on May 11, 2011– I’ve had requests for it, so here it is. It’s a .pdf file so it may open in another window or ask to be downloaded depending on your browser. I was asked to discuss all US robots used to date at the disaster, not just the IRS-CRASAR Roboticists Without Borders deployment,  and thanks iRobot, QinetiQ, and Honeywell for their help. Any errors are totally mine.

Tornadoes and mudslides

The horrific tornadoes in Missouri and the mudslide at the Malaysia orphanage are very sad. The events were a stark reminder of the lessons learned at the annual Summer Institute on emergency informatics hosted last weekend by Texas A&M at TEEX’s Disaster City and EOTC facility May 19-21.

Missouri illustrates that it’s both response and recovery. The life-saving response activities usually can (and due to the immediacy of the injuries have to) be managed by the local and regional groups, but the less obvious challenge is how to get the community rebuilt. Can aerial vehicles do more than help with response allocation but also speed insurance and small business claims? Can marine vehicles help find or clear debris? Can robots help with victim management, such as the work being done by the US Army TATRIC? Of course, it’s all moot if the responders don’t have these assets or can’t effectively distribute, visualize, and use the information… there’s a missing information infrastructure.

The mudslide illustrates the need to be able to “see” into an access denied area- which we call remote assessment or perception at a distance. Mudslides are always difficult due to low rate of survival of direct contact as the mud displaces all oxygen and the mud is particularly hard on a ground robot as we learned at the LaConchita deployment in 2005.  If there is a void, it’s a small one and it’s imperative to reach the survivor before their air is gone. Progress in ground penetrating radar remains slow but new advances such as Dan Goldman’s sandworm robot may make it possible to quickly find voids. Of course that means both advances in the technology but also acquisitions so that teams have the robots and don’t lose a day or more getting them in.

Our hearts and prayers go out to the victims and the families and the loss of the orphanage in Malaysia is doubly sad.

Mexico Mine Disaster and Robots

Juan Rojas caught the mine disaster in Mexico– a coal mine and methane-related explosion. The Mine Safety and Health Administration, which owns the only mine-permissible robot in the world, has been in contact with the embassy. It is not a good fit for their Wolverine-variant robot, as the miners were in a small area, crews were able to get in and recover some victims but are blocked by rubble (which would also block the golf cart robot).

Our hearts go out to the victims, the injured (the 15 year boy- the age of my son- who lost both arms), and the families- and it is sad that robots could not help.

Tornadoes and robots

I’m getting asked about why aren’t robots being used in Alabama, below is an informal description of the utility of air, land, and sea vehicles for these situations. Our hearts go out to the families- having seen 400 miles of this type of devastation we know that every square inch is a person’s life or livelihood.

Aerial vehicles are probably the most useful in these situations. Micro fixed wing UAVs that responders can literally throw to launch can quickly give the respond team a view of the situation and allows them to control what they are looking at. Medium resolution but on-demand with immediate viewing and feedback (“no– over there”) is  superior for immediate operations to getting super high resolution images with almost everything you wanted to see a couple of hours after you asked for it.  The responders and other decision makers need different resolutions of data and at different times.

Ground robots are less useful– the rubble isn’t particularly deep- remember, in general the sweet spot for a rescue robot is to penetrate further than 20 feet. Plus it’s the houses and non-engineered structures that get wiped out, so the density and style of collapse is different from the World Trade Center, parking garage collapses (e.g., Berkman Plaza II in Jacksonville or the Hackensack NJ apartment building), and building collapses (e.g., Cologne Germany Archives Building) where robots have been used by CRASAR and New Jersey Task Force 1.

Also, just a reminder to people thinking about IED “Hurt Locker” robots, in these situations you are often standing on the top of the rubble/roof and trying to work down into the rubble. So you want very small robots on a tether/belay to wiggle in and find voids. Mark Micire’s analysis of the use of tethered robots at the WTC for his Masters showed that tethers actually help the operators get the robot through the rubble in these vertical descents.

Canines give a great indication is someone is buried and a search camera (camera on a pole) is a great one-two high tech/low tech combination and search teams are incredibly fast. Rescue robots make sense where they do things that people and dogs can’t do or can do significantly faster.

Marine vehicles can help with victim and economic recovery- lots of things get pushed into ponds and lakes- but this is usually of interest later after the initial rescue phase.

CRASAR back from Japan: 6 sites, 5 days, 4 new research areas, 3 robots

CRASAR-IRS team photo, courtesy of CRASAR and NSF (Robin Murphy, Karen Dreger, Eric Steimle, Sean Newsome, Tetsuya Kimura, Jesse Rodocker, Satoshi Tadokoro, Kenichi Makabe)

We’re now all back in the US. Our third day at Rikuzen Takada, in the pouring rain and high wave activity, did not find any victims, so we were a bit disappointed. We participated in a press conference held by our hosts, the International Rescue Systems institute at the Chiba Institute of Technology on Sunday morning (Dr. Anne Emig from NSF Tokyo was there and it was great to meet her in person- she’s been a tremendous help), then dropped off gear at Continental cargo (huge thanks!), boarded our flights, and flew home. We cannot thank our host Prof. Tetsuya Kimura, Prof. Fumitoshi Matsuno, their grad students, and the IRS team enough for their help! We hope to obtain NSF funding to return with a different set of robots better tuned to searching for bodies under flotsam or underwater debris within a month.

It was nice to see that Minami Sanriku Mayor Hitoshi Sato publicly stated that the new port facility was being reopened because of our search.  The Rikuzen Takada City Manager, like the Minami Sanriku fisheries expert, also was interested in the ROVs for use with fishing and oyster farming- a positive, unintended consequence of being there.

Here’s some numbers about our work:

In total we searched six sites in Japan over 5 days.

Of the four robots in our cache, we only used 3. We used the SeaBotix SARbot at each site- it was definitely engineered for underwater search and rescue making it easy to quickly deploy. The SeaBotix LBV-300 was not used, as the SARbot was sufficient for the areas of interest and using the LBV-300 at the same time as the SARbot would require them to have to work in different areas to avoid their sonars from interfering with each other.  The Seamor was used twice and its DIDSON sonar (which doesn’t interfere with the SARbot Gemini sonar) had some advantages but wasn’t intended to be a rapidly deployable system. The Access AC-ROV, essentially a camcorder with thrusters, was also used twice in clear water to assess debris in very shallow water. It was fun to literally throw it in the water.

At the press conference we reported out on four preliminary findings on needed research:

1. Simulation and Geographical Information Systems- we’d like to see work in projecting the location of victims, and mechanisms to then update models as bodies were recovered

2. Cyber-physical systems- we definitely see the need for autonomous station-keeping to keep objects in view and accurate control in all kinds of water conditions
3. Computer vision & cognitive engineering- while underwater search and recovery is something that is perceptually a bit like Supreme Court Justics Potter Stewart’s quote about pornography (“I’ll know it when I see it”), we believe that cooperative computer vision algorithms permitting object cueing (“look here dummy”)  and  sensor fusion of sonar and video would be of great benefit.
4. Human-robot interaction- I suspect based on my rough observations that the operators never got beyond Level 2 Situation Awareness using Dr. Mica Endsley’s scheme, so help with visualization of surrounding clutter and advances in multi-modal interfaces would be useful.

Day 2 at Rikuzen-Takada: more video

Our CRASAR/IRS team continues to work in Rikuzen-Takada searching coves and flotsam jams that the Japanese Coast Guard divers cannot check. Today will be our last day and then we will return home on Sunday. The devastation is unimaginable and we have made only the tiniest dent in the victim recovery process and haven’t even touched critical infrastructure inspection and recovery operations.

These videos show the value of the image enhancement software on the SARbot, which has been our “go to” ROV. (And yes, we did all gasp when we first saw the glove, thinking it was a hand.) We were told to expect victims either trapped under flotsam or partially buried in slit on the sea bottom.

[youtube]http://www.youtube.com/watch?v=cdN2-LCCUR8[/youtube]

[youtube]http://www.youtube.com/watch?v=fJ_V2t79h7I[/youtube]

Rikuzen-Takada: robots go where divers cannot

We worked at two sites in the Rikuzen-Takada area after meeting with the Mayor yesterday and then this morning with the City Manager in the city offices overlooking the spectacular bay. The Mayor lost his wife, and the City Manager, his wife and daughter,  in the tsunami as they were at home by the water while they were at work when the wave hit. A reminder of why we’re here- it’s not the technology, it’s about people.

Japanese Coast Guard examining SARbot at IRS/CRASAR deployment to Rikuzentakada, courtesy Eric Steimle, CRASAR, NSF

Our hosts, the International Rescue Systems institute, coordinating the search  with the Japanese Coast Guard.

The Coast Guard divers were very enthusiastic about the ROVs because the divers are forbidden to dive under structures or flotsam such as these houses here. But victims may be trapped under that rubble…

This video is from the SARbot (which was able in less than 10 minutes from car stopping to robot getting across the landing to get under the house).

We also used the AC-ROV for the first time on the trip– it’s essentially a camcorder with thrusters!

No sign of bodies, but we were able to check off two areas that the Coast Guard had been unable to explore. More today.

[youtube]http://www.youtube.com/watch?v=YUvymnvsXq4[/youtube]