Usability

We evaluate tool Usability while exercising the tool Functional Features described below. Usability factors that we evaluate include, but are not limited to: UI design, UI learnability, UI efficiency (as measured by UI gestures), UI response times (as measured in time), interactive help, and technical documentation.

Functional features

Functional features that we evaluate are categorized into Drawing features and Simulation/Execution features:

Drawing features

We evaluate basic, intermediate, and advanced drawing features of modeling tools. Basic drawing features that we assess include, but are not limited to, opening/closing models, opening/closing diagrams, drawing model elements and relationships, editing properties of elements and relationships, and multiple undo/redo capabilities. Intermediate drawing features that we assess include, but are not limited to, support for recursive design techniques, defining business rules, and generating relationship tables. Advanced drawing features that we assess include, but are not limited to, model management and customizability. We also evaluate UI support functions (e.g., context-sensitive help, documentation) as well as ease-of-use for tool installation and administration.

Simulation/execution features

Simulation/execution features that we evaluate for BPMN modeling tools include, but are not limited to: simulating/executing business process workflows and enforcing business rules.

Standards compliance/Interoperability

We evaluate tool compliance to BPMN notation (syntax) and semantics as defined by the current BPMN specification. We also evaluate the interoperability of XMI files generated for model import/export, and the interoperability of BPMN diagrams with UML diagrams for modeling projects that support mixed Business Analysis/Software Development teams.

Support/Team modeling

We evaluate general tool support to include installation, set up, update mechanisms, and technical support.  We also evaluate team modeling support for project sharing, versioning, and user permissions.

Value

We calculate Value as a function of Features/Price, and rank tools in relative order.