Employee Identified Learning Needs
Executive
Summary
Prepared
for Canada School of Public Service
Supplier Name: Nanos Research
Contract Number: CW2267811
Contract Value: $222,587.40 (including HST)
Award Date: 2023-01-10
Delivery Date: 2023-06-02
Registration number: POR 110-22
For more information on this report, please
contact CSPS at: amanda.bloom@csps-efpc.gc.ca
Employee Identified Learning Needs Survey
Executive Summary
Prepared for Canada
School of Public Service by Nanos Research
June 2023
Canada School of
Public Service commissioned Nanos Research to conduct an online survey of
public servants to better understand their professional learning needs. A total
of is 8,709 public servants were surveyed from a randomly selected list
provided by CSPS. The online survey was conducted between March 8th
and April 6th, 2023. Twelve online focus groups were also conducted
between March 27th and April 14th, 2023. This publication
reports the findings of this research.
This publication may be reproduced for non-commercial purposes only. Prior written permission must be obtained from Canada School of Public Service. For more information on this report, please contact the Canada School of Public Service at: amanda.bloom@csps-efpc.gc.ca.
Catalogue Number: SC103-56/2023E-PDF
International Standard Book Number (ISBN): 978-0-660-68091-0
Aussi
disponible en français sous le titre « Besoin d’apprentissage des fonctionnaires ».
Numéro
de catalogue : SC103-56/2023F-PDF
Numéro
international normalisé du livre (ISBN) : 978-0-660-68092-7
© His Majesty the King in Right of Canada, as represented by the Minister of Public Services and Procurement Canada, 2023.
The Canada School of Public Service (the School) has a
legislative mandate to provide a range of learning activities to build
individual, organizational capacity and management excellence within the public
service.
Under the Canada
School of Public Service Act, the School, as a departmental corporation, is
mandated to:
•
encourage pride and
excellence in the public service
•
foster a common sense of the
purposes, values and traditions of the public service
•
support the growth and
development of public servants
•
help ensure that public
servants have the knowledge, skills and competencies they need to do their jobs
effectively
•
assist deputy heads in
meeting the learning needs of their organization
•
pursue excellence in public
management
To effectively
deliver on its mandate into the future, the School requires information on the
current and upcoming learning, training and developmental needs of federal
public service learners. The School is seeking information on these needs as
perceived by the learners themselves, as well as managers and executives
leading teams. Further, information will be sought on what the needs of public
servants are at different stages in their public service career, in designated
Employment Equity or minority groups, and in various functional areas and
roles.
Providing learning content and opportunities to develop the
skills of the public service workforce to meet the current and future needs of
Canadians is the School’s number one priority.
The School engaged in a research project that comprises a
Government of Canada-wide survey of public servants at all levels, in all
regions, and in all types of occupational roles, to inquire about their
self-perceived needs with respect to training, learning and development. This
survey will provide a comprehensive learning needs assessment. A survey of this
nature has not been done before and is required to meet the needs of public
servants, as those needs need to be clearly identified.
The results of the research will be used by the School to
inform the future allocation of departmental resources; to support our
relationships and interactions with functional communities and departments
across the Government of Canada; and, to ensure that external learning
resources being curated and procured by the School at scale on behalf of the
Government of Canada continue to meet the needs of public servants so they can
meet the needs of Canadians.
The results of this research will complement the information
on learning needs that currently exists within functional communities.
The primary objective of this
research was to provide baseline data for the learning needs of the public
service and could be conducted again in the future to capture the evolution of
the needs of learners, as this data does not currently exist.
Specifically, the survey was
used to inquire about public servants’ needs at all levels, in all regions, and
in all types of occupational roles, with respect to training, learning and
development. The School will use this information to tailor their learning
products and opportunities to better align with learners needs and preferred
method of learning.
To address the research objectives, an online survey and online focus groups were conducted with public servants at all groups, levels, in any location.
Quantitative
phase
The
online survey is comprised of 8,709 public servants from a randomly selected
list provided by CSPS, between March 8th and April 6th,
2023. The survey was provided in English and French and was distributed to 99,920
randomly selected public servants.
The
margin of error for a random survey of 8,709 public servants is plus or minus
1.0 percentage points, nineteen times out of twenty (a confidence interval of 95
per cent). The response rate for the survey was 9%.
Nanos provided instructions to the CSPS team on randomly selecting 100,000 records from their database through the use of a randomization formula. Once CSPS made the random selection, the database selection was reviewed by CSPS and then a password protected file was provided to Nanos. The randomization method ensured the database was representative of all departments across the public service. The decision was made to randomly select 100,000 records based on an estimated response rate of 12%.
The survey was also available via an open link on the CSPS website, to collect respondents’ self-perceived training, learning and development needs.
All
respondents self-administered the survey online.
Qualitative
phase
Nanos
conducted 12 online focus groups among 87
public servants, recruited from survey respondents who expressed interest in
participating. The groups were conducted between March 27th
and April 14th, 2023. Ten (10) focus groups were conducted in
English and two (2) in French.
Readers
should note that focus group research
is qualitative and directional in nature
and must not be used to estimate
the numeric proportion or number of individuals in the population who hold a
particular opinion. The focus group research allowed CSPS to gauge the views
and gather in-depth insights from public servants, including specific profiles
of interest.
The composition of the groups
was as follows:
Online, Group 1 – National Capital Region (ENG)
Online, Group 2 – Non-National Capital Region (ENG)
Online, Group 3 – Visible Minority (ENG)
Online, Group 4 – Visible Minority (ENG)
Online, Group 5 – New Public Servants (ENG)
Online, Group 6 – Service Providers (ENG)
Online, Group 7 – Disability (ENG)
Online, Group 8 – Disability (ENG)
Online, Group 9 – Visible Minority (ENG)
Online, Group 10 – Disability (ENG)
Online, Group 11 – National Capital Region (FR)
Online, Group 12 – Non-National Capital Region (FR)
The
research was commissioned by CSPS and was conducted by Nanos Research.
a.
Value
Provided
·
Overall, a majority of responding public
servants who report they have participated in professional learning on various
topics said the learning provided value to them, with the highest average value
rating being provided to communication skills and leadership (mean of 7.7 each
out of 10), where close to three in four each (75%) say it provided them a lot
of value (score of 7 to 10 out of 10). This is followed closely by training for
functional specialists (mean of 7.5), business skills (mean of 7.4) and Indigenous
reconciliation (mean of 7.3).
A comparatively lower intensity of value was given to
professional learning on product management, agile and design (mean of 7.1),
diversity, equity and inclusion (mean of 7.0) and general knowledge on
government operations (mean of 6.9).
b.
Level of
interest in learning more
·
Responding public servants who report they
have taken professional learning on various topics indicated they have the most
interest in learning more about leadership (mean of 7.8), followed by use of
data literacy (mean of 7.6), communication skills and digital technology and
working in a digital age (mean of 7.5 each). Responding public servants had a
lower intensity of interest in taking additional learning on general knowledge
on government operations and delegation of authorities (mean of 6.2 each).
c.
Applying
learning to job/career
·
Communication skills top the list when it
comes to the type of professional learning that public servants were able to
apply the most to their jobs and/or careers (mean of 7.8). This was followed by
leadership (mean of 7.5), digital technology and working in a digital age (mean
of 7.5), collaboration, and training for functional specialists (mean of 7.4
each). Responding public servants indicated they were the able to apply the
least from professional learning on diversity, equity and inclusion (mean of
6.4) and Indigenous Reconciliation to their job and/or career (mean of 5.6).
d.
Level of
interest in taking professional learning
·
Among those who report they have not taken
professional learning on the topic(s), digital technology and working in a
digital age received the highest mean interest score (mean of 7.3 of 10),
followed by professional learning on communication skills and leadership (mean
of 7.0 each), while product management, agile and design received the lowest
intensity of interest (mean of 4.5).
e.
Value in
participating in professional learning
·
Over seven in ten public servants (73%
with a score of 7-10) who report they have not taken professional learning in
the area rated communication skills as something that would be valuable if they
were to participate in it (mean of 7.6). This was followed by professional
learning on leadership (mean of 7.2), mental health and wellbeing (mean of 6.9)
and digital technology and working in a digital age (mean of 6.8).
·
A lower intensity of perceived value is
given to delegation of authorities, Indigenous reconciliation and training for
functional specialists (mean of 5.4 each) and product management, agile, design
(mean of 4.5) with over a third of responding public servants (36%) who think
this would not be valuable to them (score of 0 to 3 out of 10).
f.
Obtaining
knowledge
·
Responding public servants are two times
more likely to say much more knowledge is needed to perform at their job (45%)
(score of 7-10 out of 10) rather than little or no knowledge needed (22%), and
one third say they need a moderate amount of additional knowledge (33%).
·
They rank on-the-job learning first (26%)
in terms of the most effective learning method for them when it comes to
obtaining knowledge, closely followed by online self-paced courses (22%) and
in-person classroom learning (15%).
g.
Obtaining
skills
·
Around one in three responding public
servants each say there are much more new skills needed for them to perform at
their job (38%) (score of 7-10 out of 10) or few to no new skills needed (31%) (score
of 0-3 out of 10). Another third say they need a moderate amount of new skills
(30%).
·
Respondents again ranked on-the-job
learning as the most effective learning method when it comes to them obtaining
new skills (30%), with 16 per cent each ranking online self paced or in-person
classroom learning first.
h.
Barriers and
factors impacting participation
·
A third of public servants rank the
relevance of the topic to their work (33%) as the biggest factor that impacts
their decision to participate in a particular professional learning activity.
This is followed by the workload (21%) and their personal interest in the topic
(17%).
·
Ahead of all other potential barriers
encountered when trying to participate in professional learning activities in
the past is a lack of time and operational requirements (63%), followed by courses
not being offered (31%), not being available (31%) and being full (31%).
i.
Sources for
professional learning
·
A majority of responding public servants
say the Canada School of Public service is one of their main sources of
professional learning (85%). One third of respondents selected a college or
university (32%) as one of their main sources, followed by online sites (28%),
industry associations (12%) and non-profits (10%).
j.
Value and interest in learning more by key demographic
attributes
·
Age
-
Across nearly
all age groups, communication skills and leadership is a top learning area for
value, the exception is those 24 and under who found slightly more value in
training on business skills (mean of 8.1) rather than communication skills
(mean of 7.5), and those 25-29 who found more value in learning on diversity,
equity and inclusion (mean of 7.4), and mental health and wellbeing (mean of
8.0) with a mean of 7.1 for communication skills.
-
Leadership is
also a top learning area in terms of interest in learning more, as is digital
technology (especially for those 55 and older, mean of 7.7) and the use of data
literacy. Public servants 24 and under are most interested in learning more
about business skills (mean of 8.1) and Indigenous reconciliation (mean of
7.9).
·
Gender
-
Both men and
women place a high value on learning taken on communication skills (mean of 7.7
each), while women placed a slightly higher value on learning on leadership
(women: mean of 7.9; men: mean of 7.4).
-
Women are
also more interested in learning more on leadership (mean of 8.0) and
communication skills (mean of 7.6), while men are most interested in learning
on digital technology and working in a digital age (mean of 7.6) and the use of
data and data literacy (mean of 7.9).
·
Region
-
Both NCR and
non-NCR residents place a high overall value on learning taken on leadership
(mean of 7.7 each), while non-NCR residents also highly value communication
skills (mean of 7.9 overall) and NCR residents rate training for functional
specialists as the second most valuable learning area for them on average (mean
of 7.4).
-
Leadership
training was also the learning area with the most interest in learning more for
both NCR (mean of 7.7) and non-NCR residents (mean of 7.8), as well as across
all provinces excluding NCR residents, with the exception of Newfoundland and
Saskatchewan residents who gave higher ratings to other learning areas.
-
Residents of
Nova Scotia (mean of 8.2), PEI (mean of 7.6) and Saskatchewan (mean of 7.5)
rate learning on mental health and wellbeing as a top area of interest for
learning more for them, and Newfoundland residents give learning on digital
technology and working in a digital age a top score in terms of interest (mean
of 8.4).
·
Employee Role
-
Communication
skills is a top valued learning area across all employee roles, with leadership
also being highly valued. Executives gave the highest value score to
collaboration (mean of 7.9) and communication skills (mean of 7.8), while new
public servants most valued communication skills (mean of 8.3) and learning on
Indigenous reconciliation (mean of 8.0).
-
In terms of
their interest in learning more, use of data and data literacy was a top area
of interest, as well as leadership for all employee roles. New public servants
are also highly interested in learning on product management, agile and design
(mean of 7.8), Indigenous reconciliation (mean of 7.9), business skills (mean
of 7.8) and collaboration (mean of 7.8).
·
Employee Status
-
A high value
score was given to learning on Indigenous reconciliation for term (mean of
8.1), casual (mean of 8.3) and student employees (mean of 7.9), while term
(mean of 8.1) and casual employees (mean of 8.7) also highly valued learning on
leadership and student employees valued learning on business skills (mean of
7.9). For indeterminate employees, learning on communication skills (mean of
7.6) and leadership (mean of 7.6) were most valuable to them.
-
Regarding
their interest in learning more in these areas, indeterminate employees have
the highest level of interest in learning on leadership (mean of 7.7) and the
use of data and data literacy (mean of 7.6), while term employees are most
interesting in learning more about leadership (mean of 8.2) and communication
skills (mean of 8.1). Casual and student employees are highly interested in
learning more on Indigenous reconciliation (casual: mean of 8.2; student: mean
of 8.0), while students also want to learn more on business skills (mean of 7.8)
and casual employees want to learn more about mental health and wellbeing (mean
of 8.2).
·
Tenure
-
Employees who
have been with the government for less than 5 years place the highest value on
learning they took on communication skills (<1 year: mean of 8.2; 1-5 years:
mean of 7.9), with those who have worked less than one year also highly valuing
learning on Indigenous reconciliation (mean of 8.1) and those with a tenure of
1-5 years highly valuing learning on business skills (mean of 7.7). Learning on
leadership was a top valued area for employees across all higher levels of
tenure (6-25 plus years), with communication skills also being highly valued.
-
Across nearly
all tenure levels, employees are most interested in learning more about
leadership, as well as the use of data and data literacy. Those who have been
with the government for less than a year are also highly interested in more
learning on communication skills (mean of 8.1), while those who have been with
the government for more than 25 years are most interested in more learning on
digital technology and working in a digital age (mean of 7.5) and mental health
and wellbeing (mean of 7.7).
·
Language
-
Communication
skills and leadership were highly valued learning areas by participants across
all language profiles (in terms of their First Official Language and the
language they use the most at work). Individuals who report often speaking in a
language other than English or French also highly value learning on
collaboration (mean of 8.2), and those whose First Official Language is neither
English nor French highly value learning on digital technology and working in a
digital age (mean of 7.9).
-
In terms of
their interest in learning more, across all language profiles leadership was
top rated, as was the use of data and data literacy. Those whose First Official
Language is neither English nor French are also highly interested in taking
more learning on communication skills (mean of 8.1), as are those who primarily
speak French at work (mean of 8.0).
·
Disability
-
Leadership
and communication skills are highly valued by individuals regardless of whether
they self-identify as having a disability or not, while those who identify as
having a disability also highly valued learning on the use of data and data
literacy (mean of 7.6).
-
Individuals
who self-identify as having a disability are also highly interested in learning
more on leadership (mean of 7.9), as are those individuals who do not identify
as having a disability (mean of 7.7), and those with a disability are highly
interested in learning more on the use of data and data literacy (mean of 8.0).
·
Ethnic Community
-
There is
quite a bit of variance across ethnic communities in terms of the value they
received from learning in different areas, with those who identify as Chinese
or Black giving the highest level of value to communication skills, with Black
identifying individuals also highly valuing learning on leadership. Those who
self-identify as South Asian highly value learning on digital technology and
working in a digital age and collaboration. Of note, individuals who
self-identify as Metis, mixed descent, First Nations, Black and Latin American
place a high value on learning on Indigenous reconciliation, while those who
identify as Arab gave this a much lower value score (3.9).
-
Learning on
leadership and business skills are both areas of interest for learning more
across most of the ethnic communities, as is Indigenous reconciliation (again
given a low score of 3.7 by those who identify as Arab).
·
Classification Group
-
Value of
learning varies by classification group, with indigenous reconciliation,
training for functional specialists, leadership, and communication skills being
the learning areas most often receiving a top score for the different groups.
-
Interest in
learning more also varies across the groups, however leadership was given a top
score by eight of the 12 classification groups. Learning on Indigenous
reconciliation and use of data and data literacy were also rated a top score by
multiple classification groups.
·
Classification Level
-
Learning on
leadership was given a top score for value by all classification levels
(ranging from 7.6 out of 10 to 8.2), and communication skills was given a top
score by nearly all levels.
-
Leadership
also received top scores for interest in learning more by all classification
levels, while use of data and data literacy and communication skills also
frequently received top scores for this within each classification level.
·
Functional Area
-
Indigenous
reconciliation, communication skills and training for functional specialists
received top value scores from a number of functional
areas. Those in the client contact centre gave high mean value scores across
all learning areas, ranging from 7.4 for knowledge on government operations to
8.3 for communication skills.
-
In terms of
interest in learning more, once again communication skills and leadership often
receive top scores within each functional area, as did use of data and data
literacy, and digital technology and working in a digital age. Again, those in
the client contact centre functional area gave high average scores across all
learning areas, with the highest mean given to leadership (mean of 8.3).
a.
Opportunities
and barriers
·
Certification and/or recognition
was most likely to motivate participating public servants to participate in
more professional learning activities, followed by relevant and more advanced
training tailored for their specific role. Time was mentioned as a top barrier
for participating in more professional learning activities and supports needed
to address this barrier were having allocated time in their schedule for
training, support from management, and having courses be available at multiple
times/on different days.
·
Many participants mentioned that
the dissemination of course information and availability was an important
support they need to participate in the professional learning activities they
are interested in. This dissemination could include clear course descriptions,
learning outcomes, and even a learning path to connect multiple courses to
desired outcomes.
b.
Learning
experience
·
Aspects of a positive learning
experience most often mentioned by participating public servants were a good
instructor, the quality of the content and delivery, and applicability of the
content. Conversely, participating public servants most often mentioned a bad
instructor, poor delivery of the content and not being able to apply the
learnings in their job as aspects of a negative learning experience.
c.
Methods of
learning
·
Participating public servants
commonly said that acquiring knowledge was best suited for online learning,
while learning a new skill was best suited for in-person learning. Many
participants mentioned that in-person group learning was their preferred
method, while some said they preferred a mix of methods including online
self-paced and online in a group setting.
·
Benefits of online solo learning
included flexibility in scheduling and allowing them to go at their own pace,
while drawbacks included a lack of engagement and that it can be harder to
focus on the learnings. Online learning in a group setting was thought to be
beneficial by offering more opportunities for engagement than solo learning and
being accessible both in terms of travel/mobility, as well as availability of
supports such as closed captioning. Drawbacks mentioned by participants were similar to those of online solo learning such as limited
engagement, as some participants will keep their cameras/microphones off and
that it is easy to multitask and tune in and out of the learning activity.
·
Benefits of in-person group learning
mentioned by participants included networking and making new connections, less
distractions, better flow for discussions and even class structure (i.e.
regular breaks which can often be neglected when at home), and the ability to
learn from your peers or gain different perspectives. Drawbacks of in-person
learning in a group setting mentioned by participants were namely cost,
approvals for in-person activities often being harder to get, and time
management.
The contract value was $222,587.40 (HST included).
Supplier name: Nanos Research
PWGSC contract number: CW2267811
Original contract date: 2023-01-10
For more information, contact Department at
This
certification is to be submitted with the final report submitted to the Project
Authority.
I hereby certify,
as a Representative of Nanos Research, that the deliverables fully comply with
the Government of Canada political neutrality requirements outlined in the
Government of Canada’s Policy on Communications and Federal Identity and Directive
on the Management of Communications. Specifically, the deliverables do not
include information on electoral voting intentions, political party
preferences, party standings with the electorate, or ratings of the performance
of a political party or its leaders.
Nik Nanos
Chief Data Scientist and President
Nanos Research
(613) 234-4666
x237