Performance measurement is an important practice as a regulator, as it allows the agency to ensure it is meeting objectives and using its resources effectively. Measuring performance enables the AGCO to provide excellent service to its stakeholders, cultivate a highly engaged workforce, and improve program effectiveness. It does this by setting targets, assessing data and evaluating the results.
Strong performance measurement and monitoring practices also provide a mechanism through which achievements may be recognized and improvements can be made to their activities and services. Through continuous evaluation and feedback, the AGCO is able to achieve the key objectives that are identified in the Strategic Plan.
The results from these measures, shown in the table below, demonstrate that in 2020-21, while the AGCO was affected by the COVID-19 pandemic, it has successfully met or surpassed minimum agency targets in many respects. The achievement of these measures results from a number of overarching projects and initiatives at the AGCO, including:
The AGCO is committed to improving agency-wide performance measures. To meet this commitment, the AGCO has created a new Business Optimization and Insights unit, which will continue to engage in multi- year goal setting and a refinement of its approach to linking resource planning and performance measurement. The goal is to develop a robust performance measurement framework at the AGCO to support transparency, accountability and regulatory compliance.
|
AGCO Performance Measure |
Description |
Outcome / Output Metric |
2020–21 Results |
---|---|---|---|---|
Modern Regulator |
Digital First |
The AGCO provides user- based services and information through multiple windows and service channels anytime and anywhere. |
Outcome Metric: % of users using digital options1to transact with the AGCO meets or exceeds target of 85%. |
89.6% |
Service Excellence |
Service Experience |
A service-centred design that optimizes the service experience, engages customers proactively and identifies opportunities for improvements. |
Output Metric: Online application turnaround time (in days)2meets or is lower than target of 20 days. |
45 |
|
Outcome Metric: % of clients satisfied with services3meets or exceeds target of 75%. |
74% |
||
Value for Money |
Ensuring value per transaction (internal and external) with a focus on streamlining process and reducing regulatory burden. |
Output Metric: % of applications for SOPs auto-issued meets or exceeds target of 90%. |
40.4% |
|
People First |
Employee Experience |
The level of engagement and enablement is directly correlated with higher productivity, increased motivation and job satisfaction. |
||
Outcome Metric: The % of AGCO staff who would recommend AGCO as a place to work4meets or exceeds target of 75%. |
86% |
|||
Outcome Metric: The % of AGCO staff who believe they have opportunities to have their ideas adopted and put into use5meets or exceeds target of 70%. |
76% |
1 Includes applications, inquiries and complaints
2 Includes application turnaround times and auto-renewals completed on the iAGCO portal
3 Average based on AGCO website, iAGCO portal and telephone calls
The Investigation and Enforcement Bureau (IEB) is composed of OPP officers and is fully integrated as a bureau within the AGCO. The OPP bureau works with AGCO operations to streamline, standardize and improve investigative responses. The IEB comprises the Investigations Branch and the Intelligence and Investigative Support Branch. These branches provide investigative expertise and share information with external law enforcement and regulatory and industry stakeholder agencies to ensure integrity and public safety within AGCO-regulated industries and sectors.
TABLE 2: Number of IEB investigations
|
2019–20 |
2020–21 |
---|---|---|
igaming |
45 |
60 |
Charitable Gaming |
14 |
7 |
Liquor Licence Holders and Applicants |
139 |
140 |
Lottery Insider Wins |
51 |
49 |
Lottery Suspicious Wins |
79 |
92 |
Other Lottery Investigations |
93 |
102 |
TABLE 3: Occurrences at casinos and slot machine facilities
|
2019–20 |
2020–21 |
---|---|---|
Total Investigations |
9,137 |
1,260 |
Total Criminal Code Offences |
1,581 |
353 |
Alleged Cheat-at-Play Instances |
271 |
0 |
Cheat-at-Play Charges Laid |
17 |
0 |
Total Non–Criminal Code Related Offences These occurrences involved provincial statute investigations or violations, such as under the Liquor Licence Act, Trespass to Property Act, and Mental Health Act. Not included are requests to assist local police with non–gaming related investigations. Only those events that result in a report being filed are considered reportable occurrences by the AGCO’s IEB. |
6,713 |
280 |
TABLE 4: Eligibility investigations
|
2019–20 |
2020–21 |
---|---|---|
Investigations – Gaming Includes files on Gaming-Related and Non-Gaming Related Suppliers, racing teletheatre investigations, investigations on gaming site employees, and lottery retailer investigations |
606 |
708 |
Outside Agency Assist Checks These checks provide investigative assistance to external law enforcement agencies. |
536 |
495 |
The AGCO’s Service Strategy and Experience Branch’s mandate is to deliver on the AGCO’s Service Excellence strategic objective by working with partners across the organization to ensure:
In 2020–2021, the branch has enhanced its capacity with additional expertise in service analytics, and service design, to better assist the AGCO putting the customer at the centre of all service design and improvement initiatives.
In October 2020, the AGCO launched the final phase of iAGCO online service delivery. The AGCO’s Digital First strategy includes modernizing service channels to provide an enhanced experience.
Organizations seeking charitable gaming licences from the AGCO and Electronic Gaming Suppliers seeking gaming approvals now conduct all AGCO-related transactions online through the iAGCO portal.
iAGCO has been the largest transformational project the AGCO has undertaken to modernize how we conduct our business, aligning with our goal to be a Modern Regulator and meeting our Service Experience objective of offering customers an easy, convenient and digital way of doing business with us. Now, all AGCO licensees, registrants and authorization holders can conduct their transactions online anytime from anywhere.
The AGCO was especially well-positioned to leverage iAGCO in 2020 during the COVID-19 pandemic. Our online service platform allowed most of our customers to continue to transact with the AGCO despite unprecedented emergency measures, while allowing AGCO staff to seamlessly transition to working remotely.
The COVID-19 pandemic continues to cause significant economic hardship for many AGCO licensees and registrants, particularly in bars, restaurants, casino gaming and horse racing. The AGCO has taken unprecedented steps to provide support by extending licensing and registration terms in 2020.
iAGCO user survey responses consistently show that our customers are extremely satisfied with the iAGCO services they use and appreciate the improved service experience. From the beginning, the rates for auto-approvals and auto-issuances have been high and have only grown over time:
As AGCO staff close out of this project by transitioning tasks, roles and responsibilities to ongoing operations, a new iAGCO Product Team is delivering on the AGCO’s strategic business goals through the fostering and building of iAGCO functionality. The AGCO’s Project Management Office, which provided leadership and oversight from start to finish and worked closely with our vendor, Computronix, has also undergone change to better respond to ongoing corporate project needs. The AGCO continues to refocus its efforts to further develop the iAGCO platform to deliver on organizational modernization and transformation goals.
TABLE 5: iAGCO liquor & gaming submission rates & auto-renewals
|
2019–20 |
2020–21 |
---|---|---|
Online submission rate for liquor applicants |
94% |
88% |
Online submission rate for gaming applicants |
87% |
57% |
SOP auto-issue |
93% |
39% |
Liquor licences auto-renewals |
38% |
9% |
Gaming registration auto-renewals |
62% |
31% |
The decrease in 2020–21 numbers can be attributed to the COVID-19 emergency measures.
TABLE 6: iAGCO and service improvements
|
2019–20 Volumes |
2020–21 Volumes |
---|---|---|
Online Regulatory Notifications |
25,074 |
18,247 |
Liquor Objections |
241 |
2823 |
Complaints |
2,581 |
2,980 |
Inquiries |
49,319 |
32,874 |
Cannabis Submissions (from the public and municipalities) |
1,086 |
9,393 |
Total |
78,301 |
66,317 |
Here is what customers have to say about iAGCO:
TABLE 7: Contact Centre and customer service support
The AGCO is committed to supporting its customers, the public and stakeholders through effective customer service support across a variety of channels.
|
2019–20 |
2020–21 |
---|---|---|
Telephone Contacts (Contact Centre) |
104,072 |
49,070 |
In-person customers (Head Office) |
2,162 |
0 (Head Office in-person Services were halted, and transitioned online due to the COVID-19 Pandemic) |
Self-Help (using automated voice messaging system) |
36,386 |
23,367 |
Web Chat |
6,756* |
5,164 |
AGCO website visits |
1,425,794 |
1,207,608 |
*Web Chat volumes are from September 2019 to March 2020.
The AGCO is committed to the continuous improvement of its customers’ service experiences and uses both quantitative service performance measures and customer feedback to gauge service performance and uncover customer insights that are used to improve service design and delivery.
Since March 19, 2020, AGCO Customer Services has offered Contact Centre services remotely, in accordance with Ontario’s COVID-19 Response. Using remote technology that was enabled to support the AGCO’s Continuity of Operations Planning, the AGCO pivoted to a virtual contact centre environment with no break in customer service delivery, while supporting public health safety objectives.
During this fiscal year, the remotely operated Contact Centre answered 91% of customer calls within five minutes or less, exceeding its 80% service level target. AGCO customer surveys indicated a customer satisfaction rating of 84% for those who called the Contact Centre, the same rating as the previous year.
Customer satisfaction surveys of the AGCO’s common service channels (iAGCO, website and voice) indicate an overall customer satisfaction rating of 72%, down from 78% in the previous fiscal year. With the Contact Centre’s rate unchanged at 84%, and a slight decline of the AGCO survey (41% to 39%), the most significant change was to iAGCO satisfaction, from 78% in 2019–20 to 67% in 2020–21. The AGCO experienced significant changes in the composition of licences being processed that relate directly to the opening and closure of business activities as part of the Province’s COVID response. Due to closures, typically more satisfied customers, including SOP applicants, represented a much smaller proportion of total services in 2020–21 than in previous years.
The AGCO’s Complaints & Inquiries Handling Policy continues to focus on complaints analysis, continuous improvement, and evidence-based decision making, with a renewed focus on ensuring complaint documentation is consistently meeting the needs of both due diligence requirements, and complainant satisfaction. Through regular performance monitoring, the AGCO’s turnaround for addressing regulatory complaints greater than 30 days improved to 26% in 2020–21 from 30% in 2019–20.
In September 2019, the AGCO launched a new channel of communication to support and further enhance the customer service experience. Web Chat offers customers a direct, web-based digital line to the Contact Centre Monday through Friday, from 8:30 a.m. to 5:00 p.m. This popular service, currently available to Special Occasion Permit and cannabis customers, is scheduled to expand to other lines of business.
Compliance Services (CS) is responsible for conducting regulatory inspections, audits and financial investigations across all lines of business regulated by the AGCO. Throughout 2020–21, CS continued to conduct regulatory inspections, in-person and virtually, across all lines of business during the COVID-19 pandemic to ensure business continuity while supporting the broader public health objectives.
This approach benefits both the AGCO and Operators through reduced administrative burden, increased operational flexibility and strengthened regulatory outcomes. It also allows the AGCO to proactively manage the evolving nature of its regulated industries and sectors while taking on new regulatory responsibilities.
When conducting an audit at a casino facility, the AGCO assesses site compliance with the requirements under the Gaming Control Act (GCA), the Registrar’s Standards for Gaming, the Proceeds of Crime (Money Laundering) and Terrorist Financing Act, 2001, and related regulations. The AGCO helps regulated entities to comply with regulatory requirements by taking an approach based on education, collaboration and deterrence.
During 2020–2021, the AGCO carried out three risk-based audits/reviews.
The AGCO applies a risk-based approach to all of its activities, including its eligibility assessment and registration process, technical assessment and approval of updates to the OLG igaming solution and new games, and the application of regulatory assurance activities to assess compliance with the Registrar’s Standards for Gaming.
During 2020–2021, the AGCO carried out three risk-based audits/reviews.
During 2020–2021, the AGCO monitored ongoing changes to the OLG’s lottery platform, assessed related risks, educated new Gaming-Related Suppliers on AGCO’s regulatory requirements and expectations, and assessed technology-related readiness.
In 2020–2021, CS continued to focus its resources on areas of higher risk with a continued emphasis on being outcomes-based and compliance-focused. Inspectors achieved this by investing significant effort into proactively working with licensees and registrants to ensure regulatory compliance.
Over the fiscal year, CS effectively used virtual compliance activities that allowed for continued communications between the AGCO and its stakeholders during the pandemic and allowed for enhanced service delivery with less regulatory burden.
CS recognizes the benefits of collaborative working relationships with police services and other regulatory bodies. Throughout 2020–2021, CS continued to seek out new strategic partnerships and collaborative approaches to promote compliance among all industries and sectors regulated by the AGCO.
In this fiscal year, CS continued to increase its collaboration with municipal partners, including participation in a new multi-ministry COVID safety awareness and compliance team of more than 200 provincial offences officers from various ministries throughout Ontario. This coordinated provincial initiative to combat COVID is an area where CS has been instrumental in assisting the effort to keep Ontarians safe.
CS has continued to work in strong collaboration with its strategic partners from the local police, public health units, and bylaw enforcement departments to limit duplication of local compliance and enforcement efforts.
TABLE 8: Compliance Services inspections – cannabis
|
2019–20 |
2020–21 |
---|---|---|
Pre-inspection |
73 |
1061 |
Cannabis pre-opening |
45 |
528 |
Education |
148 |
1189 |
Unannounced inspections |
222 |
678 |
All other inspection types |
154 |
1786 |
TABLE 9: Compliance Services inspections – raffles
|
2019–20 |
2020–21 |
---|---|---|
Inspections |
57 |
11 |
Infractions cited |
1 |
0 |
In addition to commercial gaming inspections, the AGCO continued to conduct inspections at sites that fall under 207(1)(b) of the Criminal Code. These sites are conducted and managed by the OLG (see “3. Charitable Gaming (cGaming)”).
AGCO COs also provide education and outreach to the charitable gaming sector to ensure continued compliance.
The Liquor Licence Act and its Regulations provide the Registrar with the authority for regulating and licensing liquor sales licences, ferment-on-premise facility licences, liquor delivery service licences, manufacturer’s licences, and manufacturer’s representative licences.
The AGCO is also responsible for overseeing the administration of Special Occasion Permits (SOPs), which are required for occasional private events (such as weddings and receptions) or public events (such as community festivals) where beverage alcohol will be served and/or sold to the public.
TABLE 10: Total number of liquor licences and Special Occasion Permits (SOPs)
|
2019–20 |
2020–21 |
---|---|---|
Liquor Sales Licensed Establishments |
17,753 |
18,211 |
Ferment-on-Premise Facilities |
468 |
468 |
Liquor Delivery Services |
325 |
582 |
Manufacturers |
817 |
899 |
Manufacturers’ Representatives |
913 |
1065 |
Total Liquor Licences |
20,276 |
21,225 |
SOPs Issued |
58,555 |
3,2001 |
1 The decline in SOPs can be attributed to government measures to limit public gatherings during the pandemic
As of March 31, 2021, there were 84 wineries selling their fruit wine, honey wine, maple wine or VQA wine at 226 Ontario Farmers’ Markets.
TABLE 11: Compliance Services inspections – Alcohol
|
2019–20 |
2020–21 |
---|---|---|
Inspections of licensed premises (excluding SOPs) |
18,590 |
14,706 |
Contraventions of Ontario’s liquor laws |
2,654 |
985 |
Serious occurrences escalated for further review |
136 |
83 |
TABLE 12: Notices of Proposal and Orders of Monetary Penalty (alcohol)
If the Registrar proposes to refuse, revoke or suspend a licence, the Registrar must serve a Notice of Proposal (NOP) on the applicant/licensee outlining the reasons for the proposed action.
Applicants/licensees who dispute an NOP may appeal the proposal to the Licence Appeal Tribunal (LAT).
|
2019–2020 |
2020–21 |
---|---|---|
NOPs • Applications (new, change, transfer) • Disciplinary (suspend and/or add conditions, revoke) • Premises closed (revoke licence) • Other |
82 |
61 |
Orders of Monetary Penalty |
38 |
9 |
TABLE 13: Compliance Services inspections – Gaming
|
2019–20 |
2020–21 |
---|---|---|
Inspections of registered retailers |
1,965 |
476 |
Infractions cited |
297 |
48 |
Warnings |
63 |
20 |
Gaming registrations must be obtained by individuals or businesses wishing to:
In reviewing applications, an eligibility assessment is carried out by the Registrar concerning the character, integrity, financial responsibility and competence of those persons or businesses and their suitability for registration.
TABLE 14: Total number of gaming and lottery registrations
LICENCE TYPE |
2019–20 |
2020–21 |
---|---|---|
Gaming Assistant |
18,631 |
17,435 |
Gaming-Related Supplier – Manufacturers |
44 |
47 |
Gaming-Related Supplier – Lottery |
16 |
16 |
Gaming-Related Supplier – Other |
67 |
70 |
Non-Gaming Related Supplier |
284 |
305 |
Operator – Charitable – 4 or more events per week |
59 |
59 |
Operator – Charitable – 3 or less events per week |
7 |
7 |
Operator – Commercial |
28 |
34 |
Seller |
10,164 |
10,320 |
Trade Union |
18 |
19 |
Total |
29,318 |
28,312 |
The AGCO administers the charitable lottery licensing program in Ontario. This includes lottery events conducted and managed by charitable or religious organizations (such as bingo, raffles and the sale of break open tickets). The AGCO also issues registrations to individuals or businesses that wish to provide goods or services to the charitable gaming sector and carries out inspection and compliance assurance activities to ensure that charitable gaming licensees and registrants are operating in accordance with the law and in the public interest.
The issuance of charitable lottery licences continues to be a responsibility shared between the AGCO and local municipalities. The AGCO licenses raffle prizes over $50,000 and bingo prize boards over $5,500. Municipalities have the authority to issue licences with prize boards less than these amounts.
TABLE 15: Lottery licences issued
|
2019–20 |
2020–21 |
---|---|---|
Bingo |
129 |
7 |
Charitable Gaming (Bingo Hall) |
2,099 |
671 |
Break Open Ticket (BOT) |
58 |
4 |
Raffle |
580 |
342 |
Social Gaming Events |
18 |
4 |
Other |
8 |
10 |
Total |
2,892 |
1,038 |
Ontario’s public confidence in gaming is largely based upon the integrity and fairness of the games and gaming systems in play. The Technical and Laboratory Services Branch ensures the technical integrity of gaming technology by testing and providing approvals of games and related gaming systems.
This technology is used throughout the province in all gaming industries and sectors regulated by the AGCO, including casino gaming, charitable/raffle gaming, lotteries and igaming.
The AGCO Gaming Laboratory (Gaming Lab) is composed of highly qualified and experienced experts in an in-house lab that is equipped with the same gaming systems used at gaming sites in Ontario.
The Gaming Lab is accredited to the international standard ISO 17025:2017 for testing laboratories, considered the international benchmark for excellence in testing laboratories. This achievement sets the AGCO apart as the only known gaming regulator with an in-house accredited gaming lab. This accreditation provides annual third-party assurance of the ongoing quality of the testing performed by the Gaming Lab.
In 2020–2021, the Gaming Lab did not conduct its annual survey of regulated entities due to the COVID- 19 pandemic. The Gaming Lab will conduct its annual survey in 2021–22 to gather valuable feedback from regulated Gaming-Related Suppliers to enable it to continue to provide industry-leading services.
|
2019–20 |
2020–21 |
---|---|---|
Electronic gaming-related products requested for approval |
2,328 |
1,395 |
Low-risk electronic gaming products that were pre- approved |
125 |
43 |
Products with regulatory issues discovered by the AGCO that were consequently not approved |
152 |
87 |
Note: The average turnaround time for approval in 2020–21 was 22 days, which is the fastest among Canadian jurisdictions according to Gaming Operators. The goal is to maintain or further improve the turnaround time in the upcoming fiscal year.
The AGCO licenses participants in the horse racing industry, such as jockeys, trainers, drivers, veterinarians, stables and partnerships, racetracks associations, and teletheatres. AGCO Licensing Agents work at racetracks and at the AGCO’s Head Office in Toronto. This work continued during the pandemic when racing was allowed.
TABLE 17: Horse racing licensing
Licensing (Number of licences issued) |
2019–20 |
2020–21 |
---|---|---|
Thoroughbred |
4,537 |
2,674 |
Quarter Horse |
428 |
271 |
Standardbred |
8,998 |
3,069 |
Teletheatres |
59 |
48 |
Racetracks |
15 |
15 |
Total |
14,037 |
6,077 |
In 2020–2021, the AGCO continued to conduct its horse racing–related inspection and investigation activities.
Note: Upon the completion of iAGCO online services rollout, horse racing complaints previously housed in the Horse Racing Database are now listed as Inspections and Investigations in iAGCO.
TABLE 18: Inspections – Horse racing
Inspection Types |
2020–21 |
---|---|
Complaint Driven – CMP |
33 |
Consult with Licensee / Registrant – CLR |
15 |
Education – EDU |
1 |
Equine Accident Inspection – EAI |
5 |
Equine Fatality Inspection – EFI |
12 |
Equine Positive Test – PTE |
34 |
Intelligence – ITL |
28 |
Issues Note – Contentious - INC |
3 |
Out of Competition Testing – OCT |
76 |
Unannounced Inspection – UNI |
107 |
Total |
314 |
TABLE 19: Investigations – Horse racing
Investigation Types |
2020–21 |
---|---|
AGCO Legal Investigation |
5 |
HRLA Investigation |
1 |
Horse Racing – Eligibility Review Investigation |
88 |
Racing Intelligence |
1 |
Rules of Racing |
2 |
Total |
97 |
Rulings are written decisions by AGCO Judges and Stewards that relate to violations of the Rules of Racing, 2018. The decisions can be appealed to the Horse Racing Appeal Panel, an independent and impartial adjudicative body – see Horse Racing Appeal Panel page of this Annual Report.
TABLE 20: Rulings by racing officials
Breed |
2019–20 |
2020–21 |
---|---|---|
Thoroughbred |
||
Stewards’ Rulings |
187 |
109 |
Live Race Dates |
171 |
134 |
Standardbred |
||
Judges’ Rulings |
417 |
313 |
Live Race Dates |
710 |
523 |
Quarter Horse |
||
Stewards’ Rulings |
13 |
22 |
Live Race Dates |
25 |
21 |
TABLE 21: Number of Notices of Proposed Order or Immediate Suspension
|
2019–20 |
2020–21 |
---|---|---|
Notice of Proposed Order To suspend, revoke or immediately suspend a licence |
12 |
3 |
The Licence Appeal Tribunal (LAT) is responsible for adjudicating appeals of decisions on licensing activities regulated by various ministries. The LAT is part of Tribunals Ontario and is independent of the AGCO.
Notices of Proposal, Notices of Proposed Order or an Orders of Monetary Penalty issued by the Registrar regarding a licensing or registration matter under the Liquor Licence Act (LLA), Gaming Control Act 1992 (GCA), Horse Racing Licence Act 2015 (HRLA) or Cannabis Licence Act 2018 (CLA) and regulations, can be appealed to the LAT.
The LAT will also conduct public interest hearings to determine if issuance of a liquor licence or changes to liquor-licensed premises is in the public interest.
Horse racing licensees can appeal decisions made under the Rules of Racing to the Horse Racing Appeal Panel.
The following settlements were reached without a LAT hearing:
TABLE 22: Alcohol-related settlements without a hearing
|
2019–20 |
2020–21 |
---|---|---|
Number of Settlements agreed to without a hearing (NOPs and OMPs) |
98 |
11 |
*These settlements are negotiated by the AGCO’s Legal Services Division, based on instructions from the Registrar.
TABLE 23: Alcohol-related public meeting conference calls
If the AGCO receives a written objection to the issuance of a liquor sales licence, a decision is made to either set up a public meeting at the AGCO or issue an NOP to review the licence application, which can be appealed to the LAT. A public meeting is an alternative dispute-resolution process and is an informal meeting among the liquor licence applicant, the objectors, and a Deputy Registrar of the AGCO. This meeting may be arranged as a telephone conference call.
|
2019–20 |
2020–21 |
---|---|---|
Number of Public Meeting Conference Calls |
15 |
12 |
TABLE 24: Gaming-related settlements without a hearing
|
2019–20 |
2020–21 |
---|---|---|
Number of settlements agreed to without a hearing (Notices of Proposed Order and Orders of Monetary Penalty) |
5 |
0 |
*These settlements are negotiated by the AGCO’s Legal Services Division, based on instructions from the Registrar.