Analyze effectiveness
Out of the box, Evelyn includes several Superset-based dashboards:
To access the dashboards, log into Control Tower and navigate to Analytics > Dashboards.
Name Sanction Screening
The Name Sanction Screening dashboard contains information about Evelyn's key performance metrics and trends.
Automation metrics
The view covers the following metrics:
Alert Automation Rate: the percentage of alerts processed automatically.
Hit Automation Rate: the percentage of hits processed automatically.
Alert Automation Rate Trend: a line chart showing the alert automation rate trend over time.
Hit Automation Rate Trend: a line chart showing the hit automation rate trend over time.
Alerts trend by number of hits: a chart showing the distribution of alerts grouped by the number of hits associated with each alert.
Alerts trend by Name Matching Score: a chart showing the distribution of alerts grouped by name matching score values.
Alerts trend by alert category: a chart showing the distribution of alerts by alert category.
Alerts trend by alert type: a chart showing the distribution of alerts by alert type, for example,
INDIVIDUAL.
Alert and hit overview
The view shows the following alert and hit summary metrics:
Alerts: the total number of alerts.
Hits: the total number of hits.
Average Hits Per Alert: the average number of hits associated with one alert.
Alerts Trend: a chart showing the alert count trend over time, broken down by decision categories.
Hits Trends: a chart showing the hit count trend over time, broken down by decision categories.
Average Hits: a chart showing the trend of the average number of hits per alert over time.
Straight-through processing metrics
The view shows how many alerts and hits can be routed through for straight-through processing (STP) and how these metrics change over time. A higher percentage generally indicates higher automation potential.
Alerts Eligible For STP: the total number of alerts that meet the criteria for STP.
Alerts Eligible for STP %: the percentage of alerts that meet the criteria for STP.
Hits Eligible for STP: the total number of hits that meet the criteria for STP.
Hits Eligible for STP %: the percentage of hits that meet the criteria for STP.
Alerts Eligible for STP Trend: a line chart showing the trend of alerts eligible for STP over time.
Hits Eligible for STP Trend: a line chart showing the trend of hits eligible for STP over time.
Manual Task metrics
The view shows manual review workload metrics:
Average time per assignment: the average time spent per assignment during manual review, in seconds.
Name Sanction Screening Verified Analytics
The Name Sanction Screening Verified Analytics dashboard provides a consolidated view of alert and hit volumes, automation rates, confirmed decision rates, and verified outcome quality metrics.
The dashboard contains the following metrics:
Alerts: the total number of alerts included in the selected period and filters.
Alert Automation Rate: the percentage of alerts automatically dispositioned by Evelyn.
Alert confirmed decision %: the percentage of alert decisions confirmed through verification.
Hits: the total number of hits included in the selected period and filters.
Hit Automation Rate: the percentage of hits automatically dispositioned by Evelyn.
Hits confirmed decision %: the percentage of hit decisions confirmed through verification.
False Positive Hits (in %): the percentage of hits verified as False Positive, relative to the total number of hits.
True Positive Hits (in %): the percentage of hits verified as True Positive, relative to the total number of hits.
Missed True Positive Hits (in %): the percentage of True Positive hits that were missed during verification, relative to the total number of hits.
Missed False Positive Hits (in %): the percentage of False Positive hits that were missed during verification, relative to the total number of hits.
Missed False Positive Hits: the number of missed False Positive hits during verification.
Missed True Positive Hits: the number of missed True Positive hits during verification.
True Positive Hits: the number of hits verified as True Positive.
False Positive Hits: the number of hits verified as False Positive.
Alerts performance by Name Matching Score: alert performance broken down by name matching score.
Alerts performance by number of hits: alert performance broken down by the number of hits per alert.
Alerts performance by Alert Type: alert performance broken down by alert type.
Alerts performance by Alert Category: alert performance broken down by alert category.
Name Sanction Screening Alert Details
The Name Sanction Screening Alert Details dashboard represents alert information in a table view.
The table contains the following alert-associated information:
Alert ID
Alert category
Gold decision
Entity type
Digital Worker alert status
Reviewer alert status
Reviewer alert comment
Reviewer name
HTML report link
CSV report link
Auto QC
Name Sanction Screening Hit Details
The Name Sanction Screening Hit Details dashboard represents hit information in a table view.
The table contains the following hit-associated information:
Hit ID
Hit category
Gold decision
Entity type
Search date
Reviewer hit status
Reviewer hit comment
Reviewer name
Digital Worker hit status
Digital Worker hit comment
Manual review alert status
Manual review alert comment
Ticker status from the Name Screening Ticker Lookup Business Process