N1005 IBM Research: command and control

<br /><table cellpadding="0" cellspacing="0" class="tr-caption-container" style="float: left; margin-right: 1em; text-align: left;"><tbody><tr><td style="text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhtqgMGfsaMObdx1-UP97oa6k0ailsCNoKmMwkbIvMPAPXJx5iihfI46T-FgdSWUL-QjQYvYPQSAPsY6pc3RyozAzo5QLoerh6h80qld9_jB9QKBuVEzm7VI79X7D0Prq0nLMDnlZ1_D-8/s1600/GalAshour.jpg" imageanchor="1" style="clear: left; margin-bottom: 1em; margin-left: auto; margin-right: auto;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhtqgMGfsaMObdx1-UP97oa6k0ailsCNoKmMwkbIvMPAPXJx5iihfI46T-FgdSWUL-QjQYvYPQSAPsY6pc3RyozAzo5QLoerh6h80qld9_jB9QKBuVEzm7VI79X7D0Prq0nLMDnlZ1_D-8/s1600/GalAshour.jpg" width="148" /></a></td></tr><tr><td class="tr-caption" style="text-align: center;">Gal Ashour</td></tr></tbody></table><i><span style="background: white; font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-bidi-font-family: Helvetica;">Editor’s note: This article was authored by Gal Ashour, manager of video and GIS analytics at IBM Research – Haifa.</span></i><br /><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="background: white; font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-bidi-font-family: Helvetica;">Drones </span><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">have been all over the news lately, with futuristic promises to do everything from chasing criminals to delivering packages. The reality is that drones</span><span style="background: white; font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-bidi-font-family: Helvetica;">, also known as unmanned aerial vehicles,</span><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">are already commonly used in complex systems. This includes systems that rely on obtaining large amounts of video information in real time, such as those used for managing large-scale emergencies, as well as ones used for improving farming techniques and traffic control. </span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">My team at IBM Research – Haifa developed a framework for command and control (C2) applications that use mobile video feeds. We call it CARMEL, short for IBM Context-Aware Rich-Media Extensible middLeware.</span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">These drones carry mobile sensors that can film large areas, providing good video coverage at a low cost. </span><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">They come in all shapes and sizes, and have even made their way to the consumer market in the form of quad-copters. </span>In disasters such as floods or fires, when road travel may not be an option, video from drones may be the only view we can get. Our aim is to help the people who need to interpret these types of videos. </span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><b><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">Reducing information overload</span></b></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">As is often the case with new technology, these video sensors can create as many problems as they are attempting to solve. They provide such huge sets of data so quickly that sorting through them in time for practical use is difficult. And because the sensors are in motion as they photograph, figuring out when or where events took place can be nearly impossible.</span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">CARMEL works by pairing video segments with the location information provided by metadata from the sensors’ geographic information system (GIS), annotating the videos with date and time information. Users can watch videos streamed in real time, understand what they are seeing, and then make decisions based on accurate, up-to-date information.<span style="mso-spacerun: yes;">  </span></span><br /><br /><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;"><span style="mso-spacerun: yes;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">The software uses IBM middleware such as Websphere, MQ, and Informix. It is not integrated directly with drones. But once the feeds from the drone are received at the ground-station network in industry standard format, CARMEL can detect these feeds (scanning the relevant IP/Port ranges) and ingest the data along with geographical metadata into the system.  </span></span></span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><b><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">Collaboration capabilities</span></b></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">Today, emergency officials can get video feeds of the aftermath of a flood. Watching from a command center, away from the disaster, the videos come in faster than they can watch them, let alone analyze what they are looking at. Imagine that the officials see video of people stranded on their rooftops, yet they are not sure exactly where the houses are, or where rescue crew members are, or even if the roads between them are passable.</span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt; mso-no-proof: yes;">Using CARMEL, rescue teams in this situation can search for people who need help while simultaneously watching aerial video feeds and projecting their coordinates to their managers. The command center can then locate those in need and view their immediate surroundings to quickly and safely direct their rescue forces there. </span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><span style="font-family: "Verdana","sans-serif"; font-size: 10.0pt;">CARMEL can also be configured to focus on a specific area, reducing information overload and potential distractions. The technology also provides instant-replay and collaboration capabilities while video continues to be captured. This allows CARMEL users to collaborate by sharing annotations on the viewed video in real-time In the case of disaster recovery, emergency managers can divide a region among rescue workers. These features work together to help streamline planning, evaluating, and acting — crucial in situations in which every minute counts.</span></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div><div class="MsoNormal" style="line-height: normal; margin-bottom: .0001pt; margin-bottom: 0cm;"><br /></div>

First response made faster with video analytics

Gal Ashour Editor’s note: This article was authored by Gal Ashour, manager of video and GIS analytics at IBM Research – Haifa. Drones have b...