|
A competitive assessment task was carried out
comparing the SUBITO system against current state of the art
unattended baggage technologies. The scope of the assessment was
limited to comparing the functionality of SUBITO against existing
products in the marketplace. The main constraint of the evaluation
was the level of access and detail that could be obtained from
sources about the capability of the systems investigated.
It was decided that the assessment would focus
on existing products in the marketplace as these are the most
mature systems. A number of avenues were explored to identify a
list of systems/companies for the assessment. This included:
Gathering information from past SUBITO activities, internet
searches for products with unattended baggage/object capability,
requesting information from partners & in-house capability experts
and contacting companies requesting information on the capability
of their systems relating to unattended objects.
The assessment focussed on functional capabilities
as a full comparison of the functional and performance capability
of systems was not appropriate or feasible due to the level of
access and detail available.
The criteria used for the assessment was based on
the SUBITO primary objectives:
The criteria also included the basic functionality
required (detection, classification, tracking, and behavioural
analysis) as well as underlying enabling technologies (3D detection
& tracking, PTZ, carried object detection, face detection &
recognition, concept of ownership & social relations) that can
be utilised to provide a more robust solution (one of the key
drivers of the SUBITO project).
An assessment of the underlying enabling technologies
and general capabilities of the surveyed products allowed a top
level comparison against the main SUBITO objectives to be carried
out. The results are shown in the table:
Top level functionality comparison
The results showed that, as expected, all the
systems investigated have the basic image and behavioural analysis
capability required to detect unattended baggage events. Some
systems include more complex image and behavioural analysis
technologies (3D detection, abnormal pedestrian flow etc.) to
provide a more robust solution. But it is only systems which have
a form of concept of ownership that can fulfil the main SUBITO
functions.
Only one system other than SUBITO (Intuvision)
definitely utilise a 'concept of ownership' between objects. No
systems other than SUBITO were found to utilise more complex
behavioural analysis such as taking account of social relations.
No systems were found which had achieved Image
Library for Intellegent Detection Systems (i-LIDS) approval for
abandoned baggage detection. A recommendation from this work is
that a European-wide and/or worldwide standard would be useful
in order to be able to compare the performance of different video
analytic systems on a standard dataset.
In terms of performance, a direct comparison could
not be carried out (as information was not available for a common
dataset) however it has to be acknowledged that SUBITO is currently
a capability demonstrator and therefore is less mature than existing
products currently in the marketplace. Nevertheless the assessment
shows that overall the SUBITO functional capability equals, and
in some areas (concept of ownership & social relations) exceeds,
current state of the art unattended baggage detection technology.
Furthermore the fundamental building blocks of
the SUBITO system are applicable to other security & surveillance
applications. Therefore there is scope that a SUBITO system could
be developed into a more wide ranging application in the future.
|
