Workflow monitoring based on 3d motion features
2009 IEEE 12th International Conference on Computer Vision …, 2009•ieeexplore.ieee.org
Activity recognition has primarily addressed the identification of either actions or well-
defined interactions among objects in a scene. In this work, we extend the scope to the study
of workflow monitoring. In a workflow, ordered groups of activities (phases) with different
durations take place in a constrained environment and create temporal patterns across the
workflow instances. We address the problem of recognizing phases, based on exemplary
recordings. We propose to use Workflow-HMMs, a form of HMMs augmented with phase …
defined interactions among objects in a scene. In this work, we extend the scope to the study
of workflow monitoring. In a workflow, ordered groups of activities (phases) with different
durations take place in a constrained environment and create temporal patterns across the
workflow instances. We address the problem of recognizing phases, based on exemplary
recordings. We propose to use Workflow-HMMs, a form of HMMs augmented with phase …
Activity recognition has primarily addressed the identification of either actions or well-defined interactions among objects in a scene. In this work, we extend the scope to the study of workflow monitoring. In a workflow, ordered groups of activities (phases) with different durations take place in a constrained environment and create temporal patterns across the workflow instances. We address the problem of recognizing phases, based on exemplary recordings. We propose to use Workflow-HMMs, a form of HMMs augmented with phase probability variables that model the complete workflow process. This model takes into account the full temporal context which improves on-line recognition of the phases, especially in case of partial labeling. Targeted applications are workflow monitoring in hospitals and factories, where common action recognition approaches are difficult to apply. To avoid interfering with the normal workflow, we capture the activity of a room with a multiple-camera system. Additionally, we propose to rely on real-time low-level features (3D motion flow) to maintain a generic approach. We demonstrate our methods on sequences from medical procedures performed in a mock-up operating room. The sequences follow a complex workflow, containing various alternatives.
ieeexplore.ieee.org