Skip to content
 

Checklist

Checklist - Audit and External Verification

Document FSSMS-AUD-C19All stagesRevision 5Version 0.3.3

Topic pages open on your jurisdiction, and requirements tables show its line. You can change this on any page.

1. Scope

This category audits the audit. It asks whether the department has an audit program as described in 01 Audit Program, whether that program ran as written in the year, whether the people who ran it were competent and independent, whether the findings went anywhere, and whether the program itself was reviewed. It is the category that keeps the other 19 honest.

Because the safety division owns the audit program, this category is never scored by the health and safety officer or anyone in the safety division. In the annual audit it is scored by the lead auditor; in the quarterly cycle it is spot-audited by a trained officer from another division or by the municipality’s corporate safety function (01 Audit Program section 7). In an external verification year, the external party scores it and the internal result is reported beside it.

It does not cover workplace inspections and indicators (category 18), the management review that receives the audit (category 20) or the corrective action register itself (scored in category 16 and here only for audit findings).

The management-system requirement is an internal audit at planned intervals, with auditors selected for objectivity and impartiality and results reported to management and workers (ISO 45001:2018, cl. 9.2); the method is ISO 19011 (ISO 19011:2026). NFPA 1550 expects the department to evaluate its program on a fixed cycle and its annex guidance describes an internal audit at least annually and an external audit every three years (NFPA 1550, 2024, ch. 6 and Annex H). Check whether the applicable OHS statute requires the written program to provide for monitoring its own implementation and effectiveness (J03 OHS Policy and Program); this audit program is how the department does it either way. The COR convention is an internal audit every year and an external audit in year one of three (CFCSA, 2021).

2. Criteria

Source What it sets Items
ISO 45001 cl. 9.2 internal audit (ISO 45001:2018) Planned intervals; programme considering process importance and prior results; criteria and scope; auditor objectivity and impartiality; reporting to management and workers; retained records 1 to 5, 10 to 16, 27 to 30
ISO 19011 (ISO 19011:2026) Principles (cl. 4); managing an audit programme incl. objectives, risks, resources, competence, monitoring and review (cl. 5); conducting an audit incl. findings and reporting (cl. 6); auditor competence and evaluation (cl. 7) 1 to 36
NFPA 1550 ch. 6 and Annex H (NFPA 1550, 2024) Program evaluation cadence; the compliance worksheet as a technical backbone; internal audit yearly and external every three years in annex guidance 1, 6, 21 to 26
CFCSA National COR Accreditation Standard (CFCSA, 2021) Internal audit yearly, external in year one of three; documentation, observation and interview evidence; 80 per cent overall and 50 per cent per element 6 to 9, 17 to 20, 21 to 26
CFAI criterion 2D performance monitoring and the annual appraisal core competencies (CPSE, 2019, criteria 2D.1, 2D.4, 2D.6, 2D.7, 11B.6, and the appraisal indicators closing each Category V program: 5A.7, 5B.4, 5C.4, 5D.9, 5E.3, 5F.9, 5G.2, 5H.3, 5I.2, 5J.2, 5K.3) A documented methodology for assessing performance adequacy; each program’s efficiency and effectiveness assessed annually against industry research; gaps determined annually; a continuous improvement plan with timeframes; a formal, documented annual appraisal of the wellness and fitness program and of every operational program. The crosswalk is to the 10th edition; the 11th edition applies to agencies appearing from 2027 (CPSE, 2024) CFAI column
Compensation board certification and COR programs open to the department (J36 External Verification and Funding) The external verification routes available in the department’s province or territory, such as a board certification through a board-approved audit provider or COR through a certifying partner 21 to 26
Applicable OHS statute (J03 OHS Policy and Program; J05 Joint Committee and Health and Safety Representative) Any requirement that the written program provide for monitoring its implementation and effectiveness and be available to the committee and members; the committee’s functions, which may include auditing compliance 1, 31, 32
This package: 01 Audit Program, 02 Audit Checklist Master Index, Corrective Action Register The four-layer model, criteria register, scoring model, competence and independence rules, sampling, grading, reporting, external options, annual calendar, program review All

3. How to score

Full rules in 01 Audit Program section 5. In short: the CFAI column gives the 10th edition indicator the item evidences, or a dash. Score D, I and E each 0 to 3; derive the item score (0 not in place; 1 documented not implemented; 2 implemented not verified effective; 3 implemented and effective with evidence); both-required evidence codes need both types to score above 1 on implementation; weights C3, K2, S1 and the L flag (must score at least 2); category score is the weighted roll-up; effectiveness index from E alone.

4. Checklist

# Item Stage Wt Evid CFAI Scoring anchors (1 / 2 / 3) D I E Score Finding Owner Due
19.1 Audit program and criteria
1 A written audit program exists, approved by the fire chief, that sets scope, criteria, the four layers (monthly inspection, quarterly spot-audit, annual internal audit, triennial external verification), frequency, auditor rules, sampling, grading, reporting and review (ISO 45001:2018, cl. 9.2.2; ISO 19011:2026, cl. 5) S1 C3 L D 2D.1 1: a yes/no worksheet or a borrowed procedure / 2: this program adopted, approved, dated / 3: reviewed annually in April with changes recorded and the JOHSC consulted
2 The program’s scope covers every station including volunteer stations, training grounds, fleet areas the department operates, dispatch where owned, contractors on sites and every module switched on in the Program Profile Worksheet; modules switched off are listed with the reason S1 K2 D - 1: career stations only / 2: whole scope listed / 3: switched-off modules checked against dispatch data in the year
3 A criteria register lists every policy, program, standard edition and legal instrument the audit uses, with version and date, and is updated at least annually and on any change in law or edition (ISO 19011:2026, cl. 5.5.2) S1 K2 D 2D.4 1: criteria named loosely / 2: register with versions, dated within the year / 3: changes in the year traced to checklist updates
4 The audit plan for each audit records objectives, scope, criteria version, team, conflicts declared, schedule, sampling plan, documents requested and prior findings to follow up, on Form - Audit Plan and Report Template S2 K2 D - 1: a date and a name / 2: full plan for the annual audit / 3: full plan for every spot-audit and post-event audit too
5 Audit frequency is risk-based: the plan shows that categories with prior low scores, major findings, serious events or legal change were audited earlier or deeper (ISO 45001:2018, cl. 9.2.2; ISO 19011:2026, cl. 5.3) S2 S1 D+I 2D.6 1: fixed rotation regardless of results / 2: plan cites prior results / 3: lead auditor explains the risk weighting and it matches the year’s events
6 The audit uses the package’s 20-category checklist index with the three-dimension 0 to 3 scoring, D/O/I evidence codes with both-required flags, weights, the legislated floor and the effectiveness index; the scoring rules in use match 01 Audit Program section 5 S1 C3 D+O 2D.1 1: binary yes/no scoring / 2: full model used in the annual audit / 3: same model used in spot-audits, results comparable year to year
7 Post-event audits are triggered and run within 60 days after any line-of-duty death, serious injury, mayday, collapse with members inside, SCBA failure in IDLH, injury collision or high-potential near miss, by someone independent of the event and the investigation S2 C3 D 2D.6 1: trigger written, not applied / 2: applied to every qualifying event in the year / 3: post-event audit findings traced to changes
8 Regulator orders and external findings trigger a spot-audit of the affected category within 30 days of closure S2 K2 D - 1: not done / 2: done for every order in the year / 3: repeat orders in the same category are zero
9 Significant change (new station, new service, merger, change in law) triggers a re-run of the Gap Assessment for the affected modules and moves them to the front of the spot-audit cycle S2 S1 D 2D.6 1: not done / 2: done for each change in the year / 3: change log reconciled against the audit plan at the annual review
19.2 Auditor competence and independence
10 Internal auditors hold a recognized auditor course (COR auditor course or an ISO 19011 internal auditor course of two to three days) with the course, provider and date recorded, and the lead auditor has taken part in at least one prior audit (ISO 19011:2026, cl. 7) S2 C3 D - 1: no trained auditors / 2: lead and team trained, records / 3: refresher every three years, at least one audit every two years per auditor
11 The auditor pool is four to six people across divisions, including at least one volunteer officer in a composite department and one person with no reporting line into operations, so no single absence stops the audit S2 K2 D - 1: one trained person / 2: pool of at least four / 3: pool includes a volunteer officer and a non-operations member, all current
12 The lead auditor for the annual audit is from outside the safety division, and the fire chief confirms the lead’s independence in writing on the audit plan S2 C3 D - 1: HSO leads the audit of the HSO’s own program / 2: lead from outside the safety division, confirmation on file / 3: independence confirmed every year, no exception in three years
13 The HSO does not audit the categories the safety division owns or the records it maintains (categories 18 and 19, the register, the hazard profile); those are audited by a trained officer from another division or by corporate safety, and the HSO is interviewed as an auditee S1 C3 D+I - 1: HSO scores their own records / 2: separation shown in the plan and score sheets / 3: HSO describes being interviewed as auditee and the auditor confirms
14 No team member audits their own station, platoon, division or a program team they served on in the past 12 months; conflicts are declared at the planning meeting and recorded; mid-audit conflicts are handed over and the handover recorded S2 K2 D+I - 1: no conflict rule / 2: declarations on file for the year’s audits / 3: a handover in the year shows the rule applied
15 A consultant who wrote or delivered the safety management system has not audited it within three years of delivery, and any external party has declared its commercial relationship with the department in the report (some provincial COR programs apply the same independence rule; see J36 External Verification and Funding) S3 K2 D - 1: the author audited it / 2: rule in the program, no breach / 3: external report carries the declaration
16 Interviews are one-on-one and confidential; interview notes are held by the audit team and destroyed after the report is accepted; the report gives numbers by group and never attributes a statement to a person; members interviewed confirm they were told this (ISO 19011:2026, cl. 4.5) S2 C3 D+I - 1: supervisors present at interviews / 2: rule applied, members confirm / 3: destruction of notes recorded, no attribution complaint in the year
19.3 Spot-audits and annual audit done
17 Quarterly spot-audits were done on the schedule in 01 Audit Program section 15: five categories per quarter at Stage 2 for the three quarters before the annual audit, two per quarter at Stage 1, each with documents, a records sample, three to five interviews and one observation, and a category score sheet S1 K2 D - 1: fewer than half the planned spot-audits done / 2: all done, score sheets on file / 3: quarterly summaries reached the operations meeting and the JOHSC on time
18 The annual internal audit covered all 20 categories, every career station, at least 50 per cent of volunteer stations with every station inside two years and at least one per district, every platoon, and each active specialty module, in the January to February window S2 C3 D 2D.1 1: partial coverage, no sampling record / 2: coverage as stated, sampling recorded / 3: volunteer sample rotated and documented over two years, limits stated in the report
19 Records samples met the rule (10 per cent or 30 records, whichever is larger, per record type; all where under 30), drawn at random and listed in the working papers (ISO 19011:2026, Annex A) S2 K2 D - 1: convenience samples / 2: rule met, lists on file / 3: sample method described in the report with its limits
20 Interviews met the headcount table, stratified by rank and career or volunteer status with at least 30 per cent volunteer members in a composite department, and the observation list was completed (incident or drill, apparatus and SCBA check, decon cycle, JOHSC meeting, station inspection, training evolution) S2 C3 D - 1: interviews with officers only / 2: table met, observations done / 3: report states counts by group and names any shortfall
19.4 External verification
21 The department has chosen its external verification option (CFAI accreditation, a compensation board certification where the board offers one, COR through a municipal certifying partner, ISO 45001 certification, or peer assessment under this package; J36 External Verification and Funding lists what each jurisdiction offers) at a management review, with the reasons and the budget line recorded S2 K2 D - 1: not chosen / 2: chosen and minuted / 3: budget line carried in the year-three budget
22 External verification has been completed within the last three years by a party external to the department and the municipality, against this program’s criteria or the chosen scheme’s instrument (NFPA 1550, 2024, Annex H guidance; CFCSA, 2021) S3 C3 D 2D.4 1: none in five years / 2: completed within three years, report on file / 3: findings closed and a light annual document review done in the intervening years
23 The external party’s competence is recorded: peer assessors trained by a recognized accreditation or peer-review body, auditors approved by the workers’ compensation board or a certifying partner, or registrar auditors S3 K2 D - 1: unverified / 2: credentials on file / 3: credentials checked before engagement and recorded in the plan
24 External findings are entered in the Corrective Action Register with the external reference as source and tracked on the same clocks as internal findings S3 K2 D 2D.7 1: held in the external report only / 2: in the register / 3: closed on time, verified, reported to the external party
25 The internal and external results for the same year are compared, and a gap of more than 15 percentage points in any category is explained in the management review pack S3 S1 D - 1: not compared / 2: compared / 3: explanations led to changes in the internal method or auditor training
26 Where the department is a CFAI agency, the Category 11 and Category 8 exhibits are drawn from this audit’s working papers and score sheets, and all 18 Category 11 indicators are treated as mandatory regardless of core status (CPSE, 2019) S3 S1 D 11B.6; 5A.7, 5B.4, 5C.4, 5D.9, 5E.3, 5F.9, 5G.2, 5H.3, 5I.2, 5J.2, 5K.3 1: separate exhibit sets / 2: exhibits drawn from the audit / 3: peer team comments on the audit as evidence recorded
19.5 Finding grading and closure
27 Findings are graded major nonconformity, minor nonconformity, opportunity for improvement or good practice against the written definitions; each graded finding takes its priority on the department’s one scale (a major nonconformity is P1 (Imminent) or P2 (Serious) by risk, a minor nonconformity P3 (Moderate), an opportunity for improvement P4 (Improvement)); and every nonconformity records criterion, evidence, root cause, priority, owner and due date (ISO 19011:2026, cl. 6.4.8) S1 C3 D 2D.6 1: a list of comments / 2: graded with all fields / 3: grading challenged and upheld at the closing meeting without change in the year
28 Every nonconformity is in the Corrective Action Register within five working days of the closing meeting (a P1 on the day it is found), with the audit reference as source S1 C3 D 2D.7 1: findings stay in the report / 2: all in the register within five days / 3: reconciliation between report and register shows zero missing
29 Each finding meets the clocks its priority sets: P1, interim control the same shift, fire chief and JOHSC co-chairs told within 24 hours, plan in two working days, closure in seven days; P2, interim control within 24 hours where practicable, plan in seven days, closure in 30 days; P3, plan in 30 days, closure in 90 days; P4, plan by the next quarterly program update, closure within 365 days or by the next budget cycle; extensions and escalation follow the scale in the Corrective Action Register S1 C3 D+I 2D.7 1: clocks written, not met / 2: met for the year’s findings in a sample / 3: no P1 or P2 overdue in the year, escalations recorded where used
30 Closure of a P1 or P2 finding is verified by an internal auditor other than the finding’s author, with evidence; P3 findings by the HSO; an effectiveness check follows closure at the interval the register sets S2 K2 D 2D.7 1: closed on the owner’s say-so / 2: verification recorded / 3: effectiveness checks done and at least one reopened item shows the check is real
31 The audit report is issued within 15 working days of the closing meeting with the executive summary, three-pillar view, category results, findings register, prior findings status and conclusion, and reaches the fire chief, senior officer H&S, HSO, deputy chiefs, program managers, both JOHSC co-chairs, the CAO or corporate safety, and the union and association representatives (ISO 45001:2018, cl. 9.2.2) S1 C3 L D - 1: report late or partial distribution / 2: on time, full distribution / 3: JOHSC comments minuted and answered
32 A member-facing summary reaches every station within 30 days of the report, and members at sampled stations can say what the audit found S2 K2 D+I - 1: no summary / 2: summary issued on time / 3: members describe at least one finding and what is being done
33 The report states the psychological-safety measure (proportion of interviewees answering both standing questions positively, by group) next to the near-miss and good-catch reporting rate and stop-work calls reviewed without reprisal (Edmondson, 1999)DOI S2 K2 D - 1: not reported / 2: reported / 3: trend across audits shown and discussed at management review
19.6 Audit program review
34 The audit program is reviewed every April against the seven review questions in 01 Audit Program section 16 (coverage, competence and conflicts, auditor days, what events showed the audit missed, closure rate, timeliness of reporting, changes for next year), and the review is minuted (ISO 19011:2026, cl. 5.6 and 5.7) S2 K2 D 2D.4 1: no review / 2: review minuted / 3: changes from the review visible in the next plan or checklist
35 The management review receives the audit report, the register’s open-item age profile, the closure rate and the effectiveness index as standing inputs (Management Review) S2 C3 D 2D.6, 2D.7 1: audit not on the agenda / 2: received, minuted / 3: decisions and resources traced to audit findings
36 Accountability loop. The audit program has a completed accountability and closed-feedback-loop table (fire chief as owner; senior officer H&S, HSO, lead auditor and external party as doers; management review, external verification and JOHSC as verifiers; the fixed feedback dates; the register as closure) and the owner can answer the loop test with a real example from the year S1 K2 D+I 11B.6 1: table blank or generic / 2: filled, owner describes each row / 3: loop test answered with a real finding from the year, closed and fed back to the station

Loop test. The January audit grades a finding major and rates it P1 on a Friday. By Monday, who has been told, what interim control is in place, when is the plan due, who verifies the closure, and when does the crew at the station concerned hear what was found and fixed?

5. Effectiveness questions

Answer each from observation or interview only, record the evidence, and use it for the E score of the items it touches.

  1. Did the audit find what the year’s events found? Take the three most serious injuries, near misses or regulator contacts in the year. For each, ask whether the preceding audit or spot-audit scored the relevant items below 3, and whether the finding was open or closed when the event happened. An audit that scored a category 85 per cent two months before a serious event in that category is evidence of an audit problem, not a department problem, and the review question in item 34 exists for this.
  2. Does the audit change anything? Ask the fire chief, a deputy chief and a program manager each to name one thing the department did differently because of last year’s audit, without the report in hand. Score 3 only if all three answers are specific and match the register.
  3. Do members report they can speak to an auditor safely, raise a concern and get an answer? Ask every interviewee the two standing questions from 01 Audit Program section 1a. Then ask members who were interviewed last year whether they were told nothing would be attributed, whether they believed it, and whether they heard what came of it. Record the proportion with a specific, positive answer (Edmondson, 1999)DOI.

6. Interview and observation prompts

  1. Fire chief: when did you confirm the lead auditor’s independence, and why that person?
  2. Lead auditor: how did you choose which volunteer stations to visit, and what did the report say about the ones you did not?
  3. Lead auditor: show me the conflict declarations for the last audit and one records sample list.
  4. HSO: describe being interviewed as an auditee. Which categories did you not score, and who did?
  5. Program manager: which of your findings from the last audit are still open, and why?
  6. JOHSC co-chair: when did the committee receive the full report, and what did it say in reply?
  7. Member interviewed last year: what were you told about confidentiality, and what did you hear afterwards about the audit?
  8. Deputy chief: which overdue finding was escalated to you this year, at what point, and what did you do?
  9. Observe: the criteria register’s version against the editions cited in the checklists.
  10. Observe: the register reconciled against the audit report’s findings list; count any missing.
  11. Observe: the destruction record for last year’s interview notes.
  12. Everyone: if you saw something unsafe tomorrow, who would you tell and what would happen? Have you raised a concern in the last year, and did you get an answer?

Jurisdiction requirements

This chapter relies on the following legal requirements, which differ by province and territory. Check your jurisdiction’s section on each topic page before adopting it.

Topic What to check in your jurisdiction Page
OHS Policy and Program Whether the written OHS program must provide for monitoring its own implementation and effectiveness, and who must receive a copy, such as the committee and any member on request (items 1, 31) J03 OHS Policy and Program
Joint Committee and Health and Safety Representative The committee’s statutory functions, including any function of auditing compliance or taking part in inspections and investigations (items 31, 32) J05 Joint Committee and Health and Safety Representative
External Verification and Funding Which external checks are open to a municipal fire department: a COR certifying partner, a compensation board certification or incentive program, or accreditation, and any premium rebate tied to them (items 21 to 23) J36 External Verification and Funding

References

Canadian Federation of Construction Safety Associations [CFCSA]. (2021). National COR accreditation standard (final draft, 2021-06-11). https://cfcsa.ca/pdfs/CFCSA%20National%20COR%20Accreditation%20Standard%20-%20FINAL%20DRAFT,%202021.06.11.pdf

Center for Public Safety Excellence [CPSE]. (2019). Fire and emergency service self-assessment manual (10th ed.). Commission on Fire Accreditation International. https://cpse.org/wp-content/uploads/2019/08/10th-Edition-FESSAM-Strikethrough-Underline-v.4.pdf

Center for Public Safety Excellence [CPSE]. (2024). Fire and emergency service self-assessment manual (11th ed.). Commission on Fire Accreditation International. https://www.cpse.org/accreditation/cfai10/

Edmondson, A. C. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2), 350–383. doi:10.2307/2666999

International Organization for Standardization. (2018). ISO 45001:2018, Occupational health and safety management systems: Requirements with guidance for use. https://www.iso.org/standard/63787.html

International Organization for Standardization. (2026). ISO 19011:2026, Guidelines for auditing management systems (4th ed.). https://standards.iteh.ai/catalog/standards/iso/602c3cef-1d84-4d52-8d97-48d35b8d824e/iso-19011-2026

National Fire Protection Association. (2024). NFPA 1550, Standard for emergency responder health and safety (consolidates NFPA 1500, 1521 and 1561). https://www.nfpa.org/codes-and-standards/nfpa-1550-standard-development/1550

© 2026 The Human Factor · Licensed under CC BY-NC-SA 4.0 with the Adopting Agency Grant

General information only, not legal, medical or other professional advice. Verify every requirement against the current official text of the law, standards and manufacturer instructions that apply to you. Obtain your own legal review and consult your joint health and safety committee before adopting anything. You adopt, adapt, implement and rely on this material entirely at your own risk and on your own responsibility. Full terms: Terms of Use, thehumanfactor.ca.

Copyright, licence and legal notices

Connections

Pages linked to and from this page.