Page 27 - Forum-2021-JanToMarch

that screenshots
may differ from the
actual application
since development
is still ongoing) with
descriptive but-
tons, as well as an
explanation canvas
on the right, which
guides the investi-
gator through the
app, and can display
a description of the
function of each but-
ton by right-clicking
the button. The
figure also shows an
example of a cluster
generated by ImEx
containing 79 imag-
Figure 6. ImEx user interface with example cluster of vertical tail. es of the vertical tail.

Conclusion
In this paper, an
application is
presented that was
developed after
the Flight MH17
investigation showed
its necessity. ImEx
generates clusters
with images contain-
ing similar content,
based on features
extracted with a
neural network. This
allows the investi-
gator to efficiently
explore and search
through a large im-
age collection, bring
Figure 7. ImEx user interface showing overall progress (left part) and a Sankey diagram showing the progress of structure to the data
the buckets capturing the categorization performed by the investigator (right part). by placing images
into user-defined
tion, the Sankey diagram in Figure 7 shows that parts of of the exploration-search axis. After a large buckets, and show
the wings were located both in site 4 and site 6, because bonfire during New Year’s Eve on the beach got the relationships
images containing wings were placed in the “wings” out of hand, the Dutch Safety Board started an between the buckets
bucket, but also in the “site 4” and “site 6” buckets. investigation. Approximately 4,000 images were through the Sankey
collected from citizens, police, and journalists. diagram. This makes
Successful Use Case ImEx was then used to find all images showing analyzing a large
While the application was developed in light of the the tower of pallets before it was set on fire. By and complex image
Flight MH17 investigation, it is not the only investiga- making use of the cluster overview, relevant collection achievable
tion with a large number of photos, as nowadays almost clusters were quickly identified, allowing for through an efficient
everyone has a camera on their phone with them at all efficient browsing of the image collection. ImEx and clear process.
times, and thus crashes and other incidents and their greatly reduced the time needed to find the The app can be
aftermath are sometimes captured by many people. To relevant images, as only a small part of the im- downloaded for free
see how the application generalizes to other cases, the age collection needed to be inspected in close at https://tinyurl.
following use case is discussed. detail. com/imexapplica-
This use case focused mainly on the search part Figure 6 shows the main user interface (note tion.
January-March 2021 ISASI Forum • 27