Robot Assistant Lifeguard: Update

Posted by admin on Mar 02, 2016 at 10:17 pm America/Chicago

Exciting things continue to happen with EMILY- there’s an improved EMILY, a team of computer science, aerospace, and industrial engineering students are working on smartEMILY, and 37 undergraduates in senior capstone design are working on Computing For Disasters topic! Tony Mulligan, CEO of Hydronalix, creator of EMILY, and Roboticists Without Borders member, is heading back to Greece this weekend to check in with the teams and we look forward to his updates. Everything is going great-- except that 410 refugees  have died so far this year and the resort-based tourism economy of Lesvos has been wrecked. Our thoughts and prayers go out to the refugees, the generous and kind citizens of Lesvos, and to the NGOs who continue to do the best they can.

Improved EMILY

[caption id="attachment_2016" align="alignleft" width="274"] Improved EMILY with camera and lights inside the float cover instead of on top[/caption] EMILY has been improved. Notice that her video and thermal cameras are now mounted flush so that if a large number of refugees need to hang on to her, they won’t try to grab and break the camera. The Hellenic Coast Guard loves their EMILY so much, she’s on their Wikipedia page! Check out https://en.wikipedia.org/wiki/Hellenic_Coast_Guard

smartEMILY

  Back here in Texas,  we are continuing the theme of participatory research, engaging graduate and undergraduate students in generating new concepts for lifeguard assistant robots: smartEMILY.  The students in my CSCE 635 Introduction to AI Robotics class are working on making EMILY easier to use. As I wrote in my 1/12/2016 blog “The refugee crossings present a new scenario- how to handle a large number of people in the water. Some may be in different levels of distress, elderly or children, or unconscious. One solution is to use EMILY to go to the people who are still able to grab on, while the lifeguards swim to aid the people who need special professional attention. Chief John Sims from Rural/Metro Fire Department, Pima, (our 4th team member) is anticipating situations where rescuers can concentrate on saving children and unconscious victims while sending EMILY to the conscious and responsive people.” We’re calling this idea “smartEMILY” and the students from computer science, aerospace engineering, and industrial engineering are designing the artificial intelligence needed for robust operation. I can’t wait to test on EMILY in April.  

Computing for Disasters

Two of the projects in  undergraduate students in our CSCE 482 Senior Capstone design class on “computing for disasters”  are also related to EMILY and two others are on other aspects of humanitarian work. [caption id="attachment_2015" align="alignright" width="225"] Dr. Zoi and her colleague trying out EMILY's two way audio during trials with the Hellenic Coast Guard[/caption] One project was inspired by our meeting with Dr. Zoi Livaditou https://m.facebook.com/zoi.livaditou  who is working with the Hellenic Coast Guard. Dr. Livaditou, a medical doctor, has a cassette tape of directions to play over a megaphone to the refugees in their language—yes, a cassette tape. She was so excited at the idea of using EMILY’s two-way radio to play her taped phrases. Three groups of students (EMILYlingo, Fast Phrase, and Team Dragon) and  are working on a smart phone app that she can get different speakers in different languages to record phrases and then easily call them up.  It should be faster to find the right phrase, easier to add phrases, and far more convenient. A more futuristic variant that would be perfect for a large flexible display mounted on EMILY (the stuff of my dreams!) is to display what you are trying to tell the refugees to do.  For example, how to tie a cleat hitch so their boat can be towed. Even just to reinforce how to steer the boat right or left, so the person hears and sees what the directions are. Two teams, Team Tanks and Team TBD, are working on this. A very promising non-robotic project is the Refugee Predictor. A student team is writing an inductive machine learning program to predict the of boats, approximate time of arrival, and location for the next day’s data. They are hoping that there is a pattern in the weather, water, time of sunrise/sunset, and any other relevant data for the past year that explains why some days there are 20 boats hitting Skala, and other days 8 boats going to Mytelini. What a great use of machine learning! The other Computing for Disasters project is there to help with data management by us and other NGOs. In particular, if EMILY is on the water for a morning, the “action” may only be a few minutes.  In order to generate a report, someone has to edit the video clip. The students on Team Snips are working to create a website where any of the NGOs can upload a file plus one or more timestamps, and then it will cut out a snippet of a specified length. We are seeking funding to buy our own EMILY and Fotokite, then return to Greece to continue to learn and to partner with Prof. Milt Statheropoulos’ group at the National Technical University of Athens. I am still hoping to raise another $2,504 to cover the unpaid expenses from the January trip so please donate at https://www.gofundme.com/Friends-of-CRASAR