Testing Recall of Recruitment Advertising:
Methodological
Report
Submitted to:
Department of National Defence
For more information on this
report, please email:
Submitted by:
Supplier Name: Narrative
Research Inc.
Supplier Address: 5001-7071
Bayers Road, Halifax, NS B3L 2C2
Contact Phone: 902.493.3820
Contact Fax: 902.493.3879
POR Number: POR 009-22
Contract Number: CW2230133
Contract Value: $35,679.75
(including HST)
Contract Award Date: June 8,
2022
Delivery Date: March 1,
2023
Ce rapport est aussi
disponible en français
Table of Contents
Methodology
and Research Usage
Political
Neutrality Statement and Contact Information
Appendix A: Study Questionnaires
Testing Recall of
Recruitment Advertising: 2022-23 Campaigns
Methodological
Report
Prepared for Department of National Defence
Supplier Name: Narrative
Research Inc.
March 1, 2023
This
report presents the methodological details for the August 2022 Campaign
Assessment and the February 2023 Campaign Assessment for the Testing Recall
of Recruitment Advertising: 2022-2023 Campaigns study conducted by Narrative
Research Inc. on behalf of the Department of National Defence (DND). For each
research wave, all respondents were from the Canadian general public aged 18-34. A total of 1,000 respondents were included in
the August 2022 post-campaign survey conducted between August 8 to 17, 2022,
and total of 1,008 respondents were included in the February 2023 pre-campaign survey
conducted between February 6 and February 16, 2023.
Ce
rapport est aussi disponible en français sous le titre: Évaluation du rappel de
la publicité de recrutement : campagnes 2022-23 Rapport de méthodologie
This publication
may be reproduced for non-commercial purposes only. Prior written permission
must be obtained from the Department of National Defence. For more information
on this report, please contact the Department of National Defence at: POR-ROP@forces.gc.ca or at:
60 Moodie Drive
Nepean, Ontario K2H 8G1
Canada
Catalogue Number: D2-411/2023E-PDF
International
Standard Book Number (ISBN): 978-0-660-47877-7
Related publications (registration
number: POR 009-22
Catalogue Number
(Final Methodological Report, French): D2-411/2023F-PDF
ISBN (French): 978-0-660-47878-4
© His Majesty the King
in right of Canada, as represented by the Minister of the Department of
National Defence, 2023
A robust recruitment marketing strategy is an integral component of
fulfilling the priority of maintaining the Canadian Armed Forces (CAF) and National
Defence readiness. The Assistant Deputy Minister (Public Affairs) (ADM [PA])
supports the recruitment strategy of the CAF. Recruitment marketing and
advertising initiatives are developed to inform Canadians, with a particular
focus on women and visible minorities, about career opportunities available in
the CAF, and to support the Strategic Intake Plan.
Each year the
Canadian Armed Forces must enroll Regular Force (full-time) and Reserve Force
(part-time) members to fulfill the Strategic Intake Plan. Specifically, the CAF’s 2022-2023 Awareness
Campaigns continue to target Canadians aged 18-34, with a goal of increasing
interest and consideration for CAF jobs by focussing attention on the relevancy
of its training, education and career development
programs. To help meet stated recruiting objectives, DND has a multi-pronged
CAF recruitment campaign consisting of an overarching awareness campaign, a
priority occupations campaign, a women-focus campaign, an Indigenous campaign, a
paid education campaign and a Reserve campaign. In 2023, new campaign material
was developed for use for CAF recruitment in 2023. Thus, the most recent February
2023 survey serves as a pre-campaign survey for the new 2023 campaign
materials. Thus, the results presented in this report are referred to as the
August 2022 post-campaign survey (for the 2022 campaign) and the February 2023
pre-campaign survey (for the 2023 campaign).
This research is mandatory, given that the
Treasury Board requires all Government of Canada advertising campaigns that
cost more than one million dollars to be evaluated.
The purpose of the quantitative research was to assess recall of and reactions to the advertising
campaign. At the highest level, the purpose of the research is to evaluate the
effectiveness of the advertising campaign. More specifically, the research objectives included:
a Measuring unaided recall of CAF advertising;
b Measuring aided recall of CAF advertising;
c Assessing the level of understanding of the key messages of the advertising campaign; and
d Gauging the awareness level of who was responsible for commissioning the advertising.
As specified in the project’s Statement of Work (SOW),
the target audience of the 2022-2023 Canadian Armed Forces Recruitment
Campaigns was Canadians between the ages of 18 and 34. Data was gathered from a
general public panel modelling key demographics of Canadians within the
aforementioned age group. The August
2022 survey required an average of five minutes to administer, while the February
2023 survey required an average of approximately four minutes to administer.
The participation
rates in each wave were 86.1 percent, and 90.3 percent, respectively. The
contact records for each wave were drawn from a national panel administered by
The Logit Group of Toronto, Ontario. There was a total of 1,000 surveys
completed for the August 2022 post-advertising campaign wave, while 1,008
surveys were completed for the February 2023 pre-wave iteration. The August
2022 post-campaign survey was administered August 8 to 17, 2022, while the February
2023 pre-campaign survey was administered February 6 to 16, 2023.
The survey data was collected to measure the recall and reaction to the
2022-2023 Recruitment Advertising Campaigns. As per the standard methodology utilizing the Government of Canada’s Advertising
Campaign Evaluation Tool (ACET), the data collected in the pre-campaign survey conducted in February
2023, prior to campaign ads being run in the media, will serve as a baseline
for the upcoming 2023 post-campaign survey.
Again, as per the
standard ACET methodology, both the surveys collected information related to
recall of the advertisement and its key messages, ad sponsorship, and what, if any, action has
been taken as a result of the ad. Post-campaign data metrics in 2023 will subsequently
be compared by Government of Canada representatives against the February 2023 baseline
findings.
The findings from this study are to be used by the
Department of National Defence to monitor the recall of the media campaign, the
efficiency of the media placement, and provide information to enhance the
effectiveness of the recruitment campaign. Given that this online survey methodology
used a non-probability sample, the data collected cannot be extrapolated to the
Canadian general public adult population 18-34 years of age.
The survey entailed the expenditure of $35,679.75, including HST.
Narrative Research offers this written consent
allowing the Library and Archives Canada to post, in both official languages,
this Methodological Report.
I hereby certify as a Senior
Officer of Narrative Research that the deliverables fully comply with the
Government of Canada political neutrality requirements outlined in the Policy
on Communications and Federal Identity and the Directive on the Management of
Communications. Specifically, the deliverables do not contain any reference to or
information on electoral voting intentions, political party preferences,
standings with the electorate, or ratings of the performance of a political
party or its leaders.
Peter MacIntosh
Chief Research Officer &
Partner
Narrative Research
pmacintosh@narrativeresearch.ca
902-493-3832
This evaluation utilized the Government of Canada’s
Advertising Campaign Evaluation Tool (ACET) and was administered to a sample of
Canadian adults 18 to 34 years old. The data collection was conducted in August
2022 and February 2023. Data collected in February 2023 served as a pre-campaign
baseline for the upcoming 2023 campaign, while the August 2022 served as a post-campaign measurement for
the 2022 campaign.
As stated, the questions
utilized in this study were based on the Government of Canada’s standard Advertising Campaign Evaluation Tool questionnaire.
The February 2023 iteration of the study utilized the newly updated ACET
questionnaire developed by the Privy Council Office (PCO). The surveys collected information
related to recall of the advertisement and its key messages, ad sponsorship,
and what, if any, action has been taken as a result of the ad. Post-campaign
data metrics would subsequently be compared by Government of Canada
representatives against previous baseline findings. For the post-campaign survey of August 2022,
respondents were aided in their ad recall by way of being shown on-screen
advertisement content from the recent DND advertising campaign.
Post-campaign wave survey tools include
advertisement content from the campaigns, and respondents were subsequently
asked a series of questions about this content. This aiding of respondents by
showing content drawn from the advertising campaign is a process that is
possible with an online survey methodology. Narrative Research ensured
that respondents were able to complete the survey on various platforms
including computers, tablets or smartphones.
As required by Government of Canada standards, English and French
pre-test surveys were collected in each
survey wave. As well, a line of questioning was included at the end of the pre-test
surveys in which respondents were asked if they encountered any questions or
survey wording that was difficult to understand.
No pre-test respondents expressed difficulty
in understanding survey questions during the August 2022 survey. One February
2023 respondent expressed difficulty and as a result, this respondent was asked
to identify which question or questions were problematic from a comprehension
perspective. No verbatim response was provided to this question, thus no
changes to the survey tool were necessary as a result of the two waves of pre-tests.
The surveys were designed to be administered to separate, unique online
general public panel samples of approximately 1,000 Canadian adults between the
ages of 18 and 34. That is, different panelists were utilized in each wave. Narrative
Research ensured that the surveys collected closely reflected the true distribution
of the Canadian general population from 18 to 34 years of age in terms of the
size of gender and age group proportions (broken into 18 to 24 and 25 to 34 age
segments), as well as by regional proportions, as required by the project’s
Statement of Work. Attention was also given to the mother tongue of
respondents, to ensure a meaningful distribution of surveys along this relevant
demographic category in terms of official language. Please note, however, that given the fact that this online survey
methodology used a non-probability sampling approach, the data collected cannot
be extrapolated to the Canadian general public adult population 18-34 years of
age. Specifically, to ensure robust samples that approximate the true population
parameters for age (18-24 and 25-34), gender (male/female), and region
(Atlantic, Quebec, Ontario, West/North), quotas were implemented. Age and
gender quotas were implemented per region, and statistical weighting of the
survey data was implemented to adjust for the small differences between the
target data collection quotas, on the one hand, and the actual distribution of
survey completions, on the other hand (mother tongue was included in this
statistical weighting regimen, as discussed below in the Data Collection
section of this Methodological Report).
Contact Records Source: Narrative
Research used the services of The Logit Group for this research. The Logit
Group’s online general population panel is comprised of over 600,000 Canadian
residents nationally, with sound representation across regions. Logit Group
panelists are recruited from a large number of sources to maximize reach and
representation. The recruitment policies of The Logit Group’s partners (SSI, Toluna, Asking Canadians, and Research Now) are broad in
scope. Survey data quality rests on many different factors, including sourcing
of panelists who are vetted, using ongoing quality checks such as eliminating
panelists who are no longer active, and so forth. The following are panel
member sources for Logit Group studies:
·
Email invitations: pre-authorized to opt in lists from
associations and groups
·
Social Media: advertising and social groups on leading
social media platforms
·
Media Platforms: advertising on online media platforms
both niche and mainstream
·
Use of major recruiting brands
·
Loyalty programs
·
Targeted audiences
·
Web and social networking sites
·
Targeted emails by The Logit Group’s online partners
to their members or subscribers
·
Referral programs
The Logit Group has established a variety of
quality assurance processes to proactively identify invalid respondents. For
example, the company has incorporated methods to quickly identify and flag
straight-lining speedsters (i.e., respondents who give the same responses to
all questions as a means of quickly finishing the survey), thereby monitoring
whether panelists are able to provide thoughtful and accurate responses to
survey queries.
Panel members are monitored against Statistics
Canada data to gauge statistical representation. Annual profile refreshing
campaigns are conducted to incentivize panelists to remain active; these can
also contain new questions in order to target specific niche audiences more
precisely. Panelists’ participation is rewarded with their choice of HBC
Rewards bonus points, Aeroplan Miles or Petro Points, as well as various
prizes.
The sampling procedure reflected a
computerized randomization of online panel members, with exclusions from the
randomization process being based upon, for example, whether a panelist had
received his/her monthly maximum number of survey invitations.
Survey Programming and Testing
Both survey waves were
programmed by Narrative Research in both English and French, using Voxco Acuity programming software. Respondents were
formally invited to the survey in the official language of their choice. As
well, at any point when completing the questionnaire, respondents had the
option to change the questionnaire language to the other official language.
Assistance in completing the survey was available from bilingual Narrative
Research staff, as required.
Respondents were
able to verify the legitimacy of the survey via representatives from Narrative
Research, or via the survey registration system made available by way of the
Canadian Research Insights Council (CRIC), Canada’s national research agency
for this sector. The programmed survey was tested to ensure question order and
skip patterns were properly implemented. Testing included Narrative Research researchers
receiving the invitation just as a respondent would, to ensure accuracy of
delivery, text, links, and so on. DND staff were also provided with the pre-wave
and post-wave survey links.
In addition, pre-tests were conducted among
respondents for both waves. In the August 2022 survey a total of 18 English and
10 French pre-tests were completed, while in the February 2023 survey a total
of 14 English and 14 French pre-tests were completed. These pre-test survey
completions were conducted via a survey “soft launch” whereby a small number of
panel respondents were invited to participate in the survey for testing
purposes.
The pre-testing of the survey allowed the
collected data to be reviewed to ensure accuracy and to identify any
programming aspects that should be modified. Pre-test respondents in both data
collection waves were asked if they had difficulty understanding any aspect of
the survey. No pre-test respondents expressed difficulty
in understanding survey questions during the August 2022 survey, and one
February 2023 respondent expressed general difficulty but when asked, this respondent did not indicate any specific concerns.
No substantive data quality issues arose as a result of the pre-tests, and thus
the pre-test data was maintained in the final data sets.
Data Collection
Accessibility for persons with disabilities was
taken into consideration during the research implementation. Specifically,
support was available in terms of logging into the survey, as well as providing
other customized assistance as required as per Treasury Board standards
on web technologies, optimizing accessible formats, and
offering alternative modes of data collection. Respondents are informed of the available
assistive technologies or alternatives. Narrative Research is mindful and
appreciates the need to ensure that accessibility issues (i.e., respondents who
use assistive technologies) are addressed, thereby expediting participation in
this study. Ensuring online surveys are accessible on assistive
technologies often requires basic programming (e.g., single font being used,
minimal to no imagery, and so forth). Narrative Research, for example,
uses JAWS (Job Access With Speech) as well as NVDA to test accessibility of the
survey for those using assistive technologies.
For this study router technology was utilized to
screen potential survey respondents and direct them to a potential survey. Accordingly,
it is not feasible to offer an estimation regarding the number of panelists who
were invited to take part in the research. As a result, it is correspondingly also
not feasible to estimate the number of Unresolved panelists in this ACET
research study. The sample routing technology utilizes an algorithm to assign
surveys to participants likely to be eligible for the study. Priority is given
to respondents who are invited via email. A list of potential survey matches is
determined for each panelist based on pre-identified information already known
about the participant (in the case of the current DND study, age, for example,
is a germane variable as the target population is people 18-34 years of age),
as well as information obtained by additional screening information within the
panel system.
Pairing this information together with known survey
information sought (i.e., gender, region, and age targets to achieve a
statistically aligned sample), participants are matched to the appropriate
project for which they likely qualify. Survey schedule and quota requirements
are also factored into which studies participants are invited to, although this
is a secondary priority for the algorithm as compared to the profile of the
target participants needed to achieve study objectives.
This study consisted
of two data collection phases: August 2022 and February 2023. The first wave,
which was the August 2022 post-campaign measurement, was administered August 8
to 17, 2022 while the second, which was the 2023 pre-campaign measurement, was
administered February 6 to 16, 2023. Fieldwork was
monitored and reviewed on an ongoing basis to ensure target quotas were being
met. Narrative Research provided regular reports to DND representatives
regarding progress, as requested or pre-determined. Quality assurance measures
were implemented whereby no individual was able to complete the survey
questionnaire more than once.
A total of 1,028 surveys
were submitted in the August 2022 post-campaign wave, and 1,026 surveys were
submitted in the February 2023 pre-campaign wave. In the August 2022 survey, 1,000
surveys were ultimately utilized, and 1,008 ultimately were utilized in the February
2023 wave. It is important to note that for various reasons, a small percentage of submitted
online panel surveys is often removed from study data sets after submission.
Such was indeed the case in these survey waves, as Narrative Research’s initial quota targets in each wave exceeded the
overall final requirement of 1,000 questionnaires. Thus, given the essentially unavoidable
possibility of having to remove surveys, post collection, Narrative Research as a precautionary measure collected more than the
initially targeted number of surveys per wave. Reasons for removing surveys
ultimately included respondents who consistently provided non-intelligible
verbatim responses, and duplicate IDs. Thus overall, a
small number were removed in the August 2022 wave (n=28), and the February 2023
wave (n=18).
The August 2022 survey required an average of five minutes to administer
and the February 2023 survey required approximately four minutes to administer
on average. A non-probability sample approach was
implemented given that the study was designed to be conducted among online
Canadian general public panelists. All such panels are inherently
non-probability in nature, given that panelists self-select to become members
of such panels, and not all adult Canadians belong to such a panel.
The tables below display regional, gender, mother tongue, and age data
in terms of the actual distribution of adult Canadians from 18 to 34 years old
as catalogued in the 2021 Statistics Canada Census. As well, approximate
regional, gender, and age quota targets per wave are detailed (both in terms of
the actual number of surveys
completed, and the percentage of all
surveys completed). Please note, such quotas were not implemented for mother
tongue; however, during the data collection phase of the project the
distribution of surveys collected along this demographic dimension was
observed, to ensure that a meaningful distribution of surveys for the relevant
categories was indeed captured. In addition, the tables on the pages below
present data with the weighted and unweighted number as well as percentage of
surveys collected, for relevant demographic dimensions for each wave.
Data Tabulation: There were a total of 48 overlapping or interlocking
statistical weighting cells created from the study design using the weighting
factors of: Region (4: Atlantic, Quebec, Ontario, and West/North – based on
survey Question d); Age group (2: 18–24, 25–34 - based on survey Question c);
Gender (2: Male, Female – based on survey Question b); and Mother Tongue (3:
English, French, Other – based on survey Question D7). The 48 overlapping or
interlocking statistical weighting cells thus were derived from Region (4) x
Age (2) x Gender (2) x Mother Tongue (3) dimensions = 48 unique statistical
weighting cells. Population data for the 48 statistical weighting cells were
obtained from the most recent (2021) Census of Canada, and can be found here:
With such a large number of weighting cells, it was necessary to combine
specific cells due to the fact that sample sizes for specific cells were small
or empty, and therefore would have led to quite large weights if left separate.
Combining weighting cells is a common approach in such instances, and it
explains why the final weighted data distribution differs slightly from the
actual population distribution, along certain dimensions.
Nonetheless, it is suggested that the quantitative impact of
implementing this approach was very modest, thereby
recommending the specific statistical weighting approach as helpful. It should
also be noted that a small number of individuals were not able to be placed
into one of the 48 weighting cells due to the fact that they identified as
gender diverse or did not provide mother tongue. For tabulation purposes, these
individuals were given a weight value of 1.0.
August 2022 Post-Campaign Survey (Percentages may not sum exactly to 100%, owing to
rounding) |
|||||||
---|---|---|---|---|---|---|---|
|
2021 Census |
Quota Targets |
Surveys Completed (Unweighted) |
Surveys Completed (Weighted) |
|||
Surveys (n=) |
Surveys (%) |
(n=) |
(%) |
(n=) |
(%) |
||
Region |
|||||||
Atlantic |
5.8% |
75 |
7.5% |
65 |
6.5% |
59 |
5.9% |
Quebec |
21.3% |
230 |
23.0% |
230 |
23.0% |
213 |
21.3% |
Ontario |
39.9% |
400 |
40.0% |
401 |
40.1% |
395 |
39.5% |
West/North |
32.9% |
300 |
30.0% |
304 |
30.4% |
333 |
33.3% |
Gender1 |
|||||||
Male |
50.8% |
525 |
52.5% |
481 |
48.1% |
497 |
49.7% |
Female |
49.2% |
507 |
50.7% |
500 |
50.0% |
484 |
48.4% |
Mother Tongue |
|||||||
English |
55.4% |
Not applicable |
Not applicable |
657 |
65.8% |
556 |
55.7% |
French |
17.1% |
Not applicable |
Not applicable |
159 |
15.9% |
166 |
16.6% |
Other |
27.5% |
Not applicable |
Not applicable |
182 |
18.2% |
276 |
27.7% |
Age (Quotas) |
|||||||
18-24 |
37.8% |
476 |
47.6% |
433 |
43.3% |
397 |
39.7% |
25-34 |
62.2% |
556 |
55.6% |
567 |
56.7% |
603 |
60.3% |
1 19 respondents identified as gender diverse and are
not presented in the table.
February 2023 Pre-Campaign Survey (Percentages may not sum exactly to 100%, owing to
rounding) |
|||||||
---|---|---|---|---|---|---|---|
|
2021 Census |
Quota Targets |
Surveys Completed (Unweighted) |
Surveys Completed (Weighted) |
|||
Surveys (n=) |
Surveys (%) |
(n=) |
(%) |
(n=) |
(%) |
||
Region |
|||||||
Atlantic |
5.8% |
75 |
7.5% |
75 |
7.4% |
58 |
5.8% |
Quebec |
21.3% |
230 |
23.0% |
230 |
22.8% |
214 |
21.3% |
Ontario |
39.9% |
400 |
40.0% |
400 |
39.7% |
401 |
39.7% |
West/North |
32.9% |
300 |
30.0% |
303 |
30.1% |
335 |
33.2% |
Gender1 |
|||||||
Male |
50.8% |
525 |
52.5% |
505 |
50.1% |
505 |
50.1% |
Female |
49.2% |
507 |
50.7% |
490 |
48.6% |
490 |
48.7% |
Mother Tongue2 |
|||||||
English |
55.4% |
Not
applicable |
Not
applicable |
628 |
62.9% |
556 |
55.7% |
French |
17.1% |
Not
applicable |
Not
applicable |
212 |
21.2% |
169 |
17.0% |
Other |
27.5% |
Not
applicable |
Not
applicable |
159 |
15.9% |
273 |
27.4% |
Age (Quotas) |
|||||||
18-24 |
37.8% |
476 |
47.6% |
450 |
44.6% |
387 |
38.4% |
25-34 |
62.2% |
556 |
55.6% |
558 |
55.4% |
621 |
61.6% |
1 13 respondents identified as gender diverse and are
not presented in the table.
2 Nine respondents did not provide mother tongue data
and are not presented in the table.
Survey Participation Rate:
August
2022 Post-Campaign Survey |
|
---|---|
|
|
Total commenced survey
process: |
3,511 |
|
|
Invalid cases |
1,203 |
Invitations mistakenly sent to people who did
not qualify for the study: |
1,203 |
Incomplete or missing email addresses: |
0 |
|
|
Unresolved (U) |
0 |
Email invitations bounce back: |
0 |
Email invitations unanswered: |
0 |
|
|
In-scope non-responding units (IS) |
320 |
Non-response from eligible respondents: |
0 |
Respondent refusals: |
0 |
Language problem: |
0 |
Selected respondent not available (illness;
leave of absence; vacation; other): |
0 |
Early break-offs: |
320 |
|
|
Responding units (R) |
1,988 |
Completed surveys disqualified – quota filled: |
960 |
Completed surveys disqualified for other
reasons: |
28 |
Completed surveys: |
1,000 |
|
|
Participation Rate = R/(U + IS + R) = 1,988/(0 + 320 + 1,988) = 86.1% |
February
2023 Pre-Campaign Survey |
|
---|---|
|
|
Total commenced survey
process: |
2,524 |
|
|
Invalid cases |
416 |
Invitations mistakenly sent to people who did
not qualify for the study: |
416 |
Incomplete or missing email addresses: |
0 |
|
|
Unresolved (U) |
0 |
Email invitations bounce back: |
0 |
Email invitations unanswered: |
0 |
|
|
In-scope non-responding units (IS) |
204 |
Non-response from eligible respondents: |
0 |
Respondent refusals |
0 |
Language problem: |
0 |
Selected respondent not available (illness;
leave of absence; vacation; other): |
0 |
Early break-offs: |
204 |
|
|
Responding units (R) |
1,904 |
Completed surveys disqualified – quota filled: |
878 |
Completed surveys disqualified for other
reasons: |
18 |
Completed surveys: |
1,008 |
|
|
Participation Rate = R/(U + IS + R) = 1,904/(0 + 204 + 1,904) = 90.3% |
Given that the
online methodology utilized a non-probability sample, a margin of error cannot
be applied to the results as per the Standards for the Conduct of Government of
Canada Public Opinion Research for Online Surveys.
Any survey that is conducted is potentially subject to bias or error.
When a survey is conducted with a sample of the population, there are two
general classes of bias or error: sampling error, which is quantifiable, and
non-sampling error, which is typically not quantifiable.
Sampling error arises from the fact that interviews are conducted with
only a subset of the population, and thus is it possible that the results
obtained from this group of respondents is not reflective of the population as
a whole.
In contrast, non-sampling error encompasses a number of different types
of errors including coverage error, measurement error, non-response error, and
processing error.
No measurement of sampling error can be attributed to the current study,
given that the contact records utilized in the data collection process were
derived from an online panel of the general public, which is to say, a
non-probability sample source. Having stated that, measures were taken in the
implementation of the data collection to ensure sufficient completed surveys
were obtained from demographic groups traditionally regarded as central in
quantitative survey research, such as gender, age, region/province, and mother
tongue. The final data set for each survey wave was statistically weighted to
closely match the distribution of these dimensions as estimated in the 2021
Statistics Canada census. The statistical weights implemented were relatively
small, given that the data collected already closely matched the actual
distribution of adult Canadians between the ages of 18 and 34 along these
demographic dimensions.
With respect to non-sampling error, a number of steps were taken to
minimize bias due to these sources. All surveys utilized online interviewing
technology to ensure proper survey skip patterns were followed and to minimize
errors due to data entry and data capture. The French and English survey
instruments from each campaign themselves were pre-tested with small samples of
respondents to ensure the survey material was easily understood by respondents,
and that the resultant data were being captured properly. In terms of coverage,
the surveys were conducted with an online panel of the Canadian general public
18 years of age or older, based on a randomized sampling of panel records for
the target audience (adults 18 to 34 years of age) drawn from a commercially
available online general public panel.
ADVERTISING CAMPAIGN EVALUATION TOOL
2022 POST-CAMPAIGN SURVEY – AUGUST 2022
All sections should be asked after the ads
have run in the media.
INTRODUCTION
Thank you for taking a few minutes to
complete this survey on current issues that matter to Canadians. Si vous
préférez répondre à ce sondage en français, veuillez cliquer sur français [SWITCH TO FRENCH VERSION].
The survey is being conducted by Narrative
Research. Your participation is voluntary and your
responses will be kept entirely confidential and anonymous. The survey
takes about [BASELINE: 5 minutes / POST-CAMPAIGN: 7 minutes] to complete. This
survey is being administered according to the requirements of the Privacy Act,
the Access to Information Act, and any other relevant legislation.
START SURVEY
Click here if you wish to verify the authenticity of
this survey. To view our privacy policy, click here.
a Does anyone in your household work for any of the following organizations? SELECT ALL THAT APPLY
o
A marketing research firm
o
A magazine or newspaper
o
An advertising agency or graphic design firm
o
A political party
o
A radio or television station
o
A public relations company
o
The federal or provincial government
o
None of these organizations
IF “NONE OF THESE ORGANIZATIONS” CONTINUE,
OTHERWISE THANK AND TERMINATE.
b What is your gender?
o
Male
o
Female
o
Other
o
Prefer not to answer
c In what year were you born?
YYYY
ADMISSIBLE RANGE
1988-2004
IF > 2004, THANK AND TERMINATE
ASK D IF QUESTION C IS LEFT BLANK
d In which of the following age categories do you belong? SELECT ONE ONLY
o
less than 18 years old
o
18 to 24
o
25 to 34
o
35 or older
IF “LESS THAN 18 YEARS OLD” OR “BLANK”, OR
“35 OR OLDER” THANK AND TERMINATE
e In which province or territory do you live? SELECT ONE ONLY
o
Alberta
o
British Columbia
o
Manitoba
o
New Brunswick
o
Newfoundland and Labrador
o
Northwest Territories
o
Nova Scotia
o
Nunavut
o
Ontario
o
Prince Edward Island
o
Quebec
o
Saskatchewan
o
Yukon
o None of the above TERMINATE
IF NO PROVINCE OR TERRITORY IS SELECTED,
THANK AND TERMINATE
CORE
QUESTIONS
ASK ALL RESPONDENTS
Q1: Over the past three weeks, have you seen, read or heard any
advertising from the Government of Canada?
o
Yes
o
No=> GO TO T1A
Q3: Think about the most recent Government of Canada ad that comes to
mind. What do you remember about this ad?
CAMPAIGN QUESTIONS
ASK ALL RESPONDENTS
T1A: Over the past three weeks, have you seen,
read or heard any Government of Canada advertising about the Canadian Armed
Forces?
o
Yes
o
No=> GO TO T1D
T1B: Where have you seen, read or heard this ad about the Canadian Armed
Forces?
SELECT ALL THAT APPLY
o Print
magazine
o Medical
Journals
o Radio
o Facebook
o Instagram
o Snapchat
o Spotify
o LinkedIn
o In a
mobile app
o YouTube
o Apex
o Internet
website
o Online
news sites
o Web
search (e.g. Google, Bing)
o Other,
specify: ____________________
T1C: What do you remember about this ad?
ASK ALL RESPONDENTS
T1D: Did you do anything as a result of seeing, hearing, or reading recent
advertising about the Canadian Armed Forces?
Yes
=> POSE T1E
No
=> SKIP TO T1F
T1E: What did you do as a result of seeing,
hearing, or reading recent advertising about the Canadian Armed Forces? [SELECT ALL THAT APPLY]
o Visited
the Department of National Defence/DND website
o Visited
other website(s) (PLEASE specify which websites: _____________________)
o Telephoned
the Department of National Defence/DND
o Visited
the Department of National Defence/DND in person
o Visited
the Department of National Defence/DND social media pages
o OTHER
(PLEASE SPECIFY: ______________)
T1F: After having recently seen, heard or read
advertising about the Canadian Armed Forces, did you specifically take steps to learn more
about jobs offered by the Canadian Armed Forces?
o Yes
o No
ASK ALL RESPONDENTS
T1G: And over the past three weeks, have you
seen, heard or read any advertising specifically showing members of
the Canadian Armed Forces doing their job?
o Yes POSE T1H
o No SKIP TO T1I
T1H: What do you remember about this ad? [RECORD VERBATIM]
o Nothing
T1I: If someone you know,
such as a family member or friend, told you that they were joining the Canadian
Armed Forces, how would you view that decision? Would your reaction be …:
o Very favourable
o Somewhat favourable
o Neutral
o Somewhat unfavourable
o Very unfavourable
T1J: ASK
ALL RESPONDENTS – ROTATE STATEMENTS (Statement “A” should always be posed
first)
To what extent are you aware of …:
|
1 Not at all
informed |
2 |
3 |
4 |
5 Very informed |
---|---|---|---|---|---|
a Career or job options in the Canadian Armed Forces? |
o |
o |
o |
o |
o |
b Educational and training options within the Canadian Armed Forces? |
o |
o |
o |
o |
o |
c Career or job options specifically for women within the Canadian Armed Forces? |
o |
o |
o |
o |
o |
d Career or job options specifically for Indigenous Peoples in the Canadian Armed Forces? |
o |
o |
o |
o |
o |
e Opportunities specifically within the Reserve Force of the Canadian Armed Forces? |
o |
o |
o |
o |
o |
T1K: Over the past three weeks, have you seen or read
content related to recruitment into the Canadian Armed Forces on television
and/or social media
websites such as Facebook, YouTube, Instagram or
LinkedIn?
o
Yes
o No
AD RECALL QUESTIONS
T1L: Here is an ad that has recently been
broadcast on various media. Please
click the play button to view this ad. [INSERT VIDEO, PRINT AND RADIO ADS] [CLICK TO GO TO THE NEXT PAGE]
Over
the past three weeks, have you seen, read or heard this ad?
o
Yes
o
No=> GO TO T1N
T1M: Where have you seen, read or heard this
ad?
SELECT ALL THAT APPLY
o Print magazine
o Medical Journals
o Radio
o Facebook
o Instagram
o Snapchat
o Spotify
o LinkedIn
o In a mobile app
o YouTube
o Apex
o Internet website
o Online news sites
o Web search (e.g. Google, Bing)
o Other, specify: ___________________
T1N: What do you think is the main point
this ad is trying to get across?
T1O: Do you think this advertisement provides an authentic representation
of the Canadian Armed Forces?
o
Yes
o
No
o
Don’t know
T1P: Please indicate your level of agreement with the following statements
about this ad? RANDOMIZE STATEMENTS
|
1 Strongly Disagree |
2 |
3 |
4 |
5 Strongly Agree |
---|---|---|---|---|---|
This
ad catches my attention |
o |
o |
o |
o |
o |
This
ad is relevant to me |
o |
o |
o |
o |
o |
This
ad is difficult to follow |
o |
o |
o |
o |
o |
This
ad does not favour one political party over another |
o |
o |
o |
o |
o |
This
ad talks about an important topic |
o |
o |
o |
o |
o |
This
ad provides new information |
o |
o |
o |
o |
o |
This
ad clearly conveys that the Canadian Armed Forces have 100+ careers available |
o |
o |
o |
o |
o |
DEMOGRAPHIC
QUESTIONS
D1: Which of the following categories best describes your current
employment status? Are you…
SELECT ONE ONLY
o Working full-time (30 or more hours per week)
o Working part-time (less than 30 hours per week)
o Self-employed
o Unemployed, but looking for work
o A student attending school full-time
o Retired
o Not in the workforce (Full-time homemaker or unemployed but not looking for work)
o Other employment status
D2: What is the highest level of formal
education that you have completed? SELECT
ONE ONLY
o
Grade 8 or less
o
Some high school
o
High school diploma or equivalent
o
Registered Apprenticeship or other trades certificate or diploma
o
College, CEGEP or other non-university certificate or diploma
o
University certificate or diploma below bachelor's level
o
Bachelor's degree
o
Postgraduate degree above bachelor's level
D3: Are there any children under the age of 18 currently living in your
household?
o Yes
o No
D4: Which of the following categories best describes your total annual
household income, including income from all household members, before taxes are
deducted? SELECT ONE ONLY
o
Under $20,000
o
Between $20,000 and $40,000
o
Between $40,000 and $60,000
o
Between $60,000 and $80,000
o
Between $80,000 and $100,000
o
Between $100,000 and $150,000
o
Between $150,000 and $200,000
o
$200,000 and above
o
Prefer not to say
D5: Where were you born?
o
Born in Canada
o
Born outside Canada SPECIFY:
Specify
the country: ___________________
ASK IF D5=BORN OUTSIDE CANADA
D6: In what year did you first move to Canada?
YYYY
ADMISSIBLE RANGE:
1900-2022
D7: Are you part of an Indigenous
group, that is, First Nations, Métis or Inuk (Inuit)?
First Nations includes Status and Non–Status Indians.
o
Yes
o
No
D8: You may belong to one or more racial or cultural groups on the following
list. Are you...? SELECT UP TO TWO
o
White
o
South Asian (e.g., East Indian, Pakistani, Sri Lankan)
o
Chinese
o
Black
o
Filipino
o
Latin American
o
Arab
o
Southeast Asian (e.g., Vietnamese, Cambodian,
Malaysian, Laotian)
o
West Asian (e.g., Iranian, Afghan)
o
Korean
o
Japanese
o
Other, specify ___________________
D9: What is the language you first
learned at home as a child and still understand? SELECT UP TO TWO
o
English
o
French
o
Other language, specify ___________________
(PRE-TEST
ONLY-REMOVE BEFORE FULL LAUNCH)
D10:
Are there any questions in this survey that you found difficult to understand?
o
Yes
o
No
D11:
IF YES IN D10: Which questions did
you find difficult to understand?
RECORD VERBATIM
That concludes the survey. This survey was conducted on behalf of the Department of National Defence, of the Government of Canada. In the coming months the report will be available from Library and Archives Canada. We thank you very much for taking the time to answer this survey, it is greatly appreciated.
OUTIL D’ÉVALUATION DES CAMPAGNES PUBLICITAIRES
2022 SONDAGE D’APRÈS CAMPAGNE – AOÛT 2022
Toutes les
sections doivent être posées après la diffusion des annonces dans les médias.
INTRODUCTION
Merci de prendre
quelques minutes pour répondre à ce sondage sur des enjeux d’actualité qui
intéressent les Canadiens. If you prefer to complete this survey in English, please click English [PASSEZ A LA VERSION ANGLAISE].
Le présent sondage
est mené par Narrative Research. Votre
participation est volontaire et toutes vos réponses demeureront confidentielles.
Le sondage prend environ [SONDAGE DE RÉFÉRENCE : 5 minutes / SONDAGE D’APRÈS
CAMPAGNE : 7 minutes] à compléter. Ce sondage est conforme aux exigences de la
Loi sur la protection des renseignements personnels, Loi sur l’accès à
l’information et d’autres lois pertinentes.
DÉBUT DU SONDAGE
Cliquez ici si
vous souhaitez vérifier l’authenticité du présent sondage et ici pour
lire notre politique de confidentialité.
a Quelqu’un
au sein de votre foyer travaille-t-il pour l’une ou l’autre des organisations
suivantes?
CHOISISSEZ TOUTES LES RÉPONSES APPLICABLES.
o
une firme de recherche en marketing
o
un magazine ou un quotidien
o
une agence de publicité ou de conception
graphique
o
un parti politique
o
une station radiophonique ou de télévision
o
une firme de relations publiques
o
le gouvernement fédéral ou provincial
o
aucune de ces organisations
SI « AUCUNE
DE CES ORGANISATIONS », POURSUIVEZ. SI NON, REMERCIEZ LE RÉPONDANT ET
METTEZ FIN AU SONDAGE.
b Quel
est votre genre?
o
homme
o
femme
o
autre
o
je préfère ne pas répondre
c Quelle
est votre année de naissance?
YYYY
TRANCHE ADMISSIBLE
: 1988 À 2004
SI L’ANNÉE EST
> 2004, REMERCIEZ ET METTEZ FIN AU SONDAGE.
POSEZ LA QUESTION
D SI LA CASE À LA QUESTION C EST VIDE.
d À
quelle catégorie d’âge appartenez-vous?
NE CHOISIR QU’UNE SEUL CATÉGORIE.
o Moins de 18 ans
o 18 à 24
o 25 à 34
o 35 et plus
SI LE RÉPONDANT A
MOINS DE 18 ANS, A PLUS DE 35 ANS OU NE RÉPOND PAS, REMERCIEZ ET METTEZ
FIN AU SONDAGE.
e Dans
quelle province ou quel territoire habitez-vous?
NE CHOISIR QU’UN PROVINCE OU QU’UN TERRITOIRE.
o
Alberta
o
Colombie-Britannique
o
Manitoba
o
Nouveau-Brunswick
o
Terre-Neuve-et-Labrador
o
Territoire du Nord-Ouest
o
Nouvelle-Écosse
o
Nunavut
o
Ontario
o
Île-du-Prince-Édouard
o
Québec
o
Saskatchewan
o
Yukon
o
Aucune de ces provinces ou territoires
SI AUCUNE PROVINCE
OU AUCUN TERRITOIRE N’EST CHOISI(E), REMERCIEZ LE RÉPONDANT ET METTEZ FIN AU
SONDAGE.
QUESTIONS DE BASE
POSER À TOUS LES
RÉPONDANTS.
Q1 : Au
cours des trois dernières semaines avez-vous vu, lu ou entendu des publicités
du gouvernement du Canada?
o
oui
o
non=>
ALLER À T1A
Q3 : Pensez à la plus
récente publicité du gouvernement du Canada qui vous revient à l’esprit. De
quoi vous souvenez-vous à propos de cette publicité?
QUESTIONS
SPÉCIFICQUES À LA CAMPAGNE
POSER À TOUS LES
RÉPONDANTS.
T1A : Au cours des trois dernières semaines,
avez-vous vu, lu ou entendu une publicité du gouvernement du Canada au sujet
des Forces armées canadiennes?
o
oui
o
non=>
ALLEZ À T1D
T1B : Où
avez-vous vu, lu ou entendu cette publicitéau sujet
des Forces armées canadiennes?
CHOISISSEZ TOUTES
LES RÉPONSES APPLICABLES.
o Magazines
o Revues médicales
o Radio
o Facebook
o Instagram
o Snapchat
o Spotify
o LinkedIn
o Une application mobile
o YouTube
o Apex
o Site Internet
o Sites web de nouvelles
o Moteur de recherche (par ex., Google, Bing)
o Autre, veuillez préciser ________________
T1C : De
quoi vous souvenez-vous à propos de cette publicité?
POSER À TOUS LES
RÉPONDANTS.
T1D : Avez-vous fait quelque chose après avoir vu,
entendu ou lu la récente publicité au sujet des Forces armées canadiennes?
Oui => POSER
T1E
Non => ALLEZ
À T1F
T1E : Qu’avez-vous fait après avoir vu, entendu ou
lu la récente publicité au sujet des Forces armées canadiennes?
CHOISISSEZ TOUTES
LES RÉPONSES APPLICABLES
o
A visité le site Web du ministère de la
Défense nationale/MDN
o
Consulté un ou d’autres sites Web (veuillez
préciser)
o
A téléphoné au ministère de la Défense
nationale/MDN
o
A visité le ministère de la Défense
nationale/MDN en personne
o
A visité les pages des média sociaux du
ministère de la Défense nationale/MDN
o
Autre, (veuillez préciser)
_____________________
T1F : Après
avoir récemment vu, entendu ou lu la publicité au sujet des Forces armées
canadiennes, avez-vous entrepris des démarches précises afin d’en savoir plus
sur les emplois offerts aux Forces armées canadiennes?
o
Oui
o
Non
POSER À TOUS LES
RÉPONDANTS.
T1G : Et au cours des trois dernières semaines,
avez-vous vu, entendu ou lu une publicité illustrant précisément des membres
des Forces armées canadiennes en train de travailler?
o
Oui =>
POSER T1H
o
Non => ALLEZ À T1I
T1H : De quoi
vous souvenez-vous à propos de cette publicité? [NOTER MOT À MOT]
Rien
T1I : Si une personne de votre connaissance, comme
un membre de la famille ou un ami, vous disait qu’elle se joint aux Forces
armées canadiennes, comment percevriez-vous cette décision? Quelle serait votre
réaction?
o
Très favorable
o
Plutôt favorable
o
Neutre
o
Plutôt défavorable
o
Très défavorable
T1J : POSER À TOUS LES RÉPONDANTS - LIRE LES
ÉNONCÉS AU HASARD, A = FAUT TOUJOURS ÊTRE LE PREMIER
Dans quelle mesure êtes-vous au courant des
possibilités :
|
1 Pas du tout
informé(e) |
2 |
3 |
4 |
5 Très informé(e) |
---|---|---|---|---|---|
a de carrière ou d’emploi au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
b d’apprentissage et de formation au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
c de carrière ou d’emploi précisément pour les femmes au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
d de carrière ou d’emploi précisément pour les autochtones au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
e précisément dans la Force de réserve des Forces armées canadiennes? |
o |
o |
o |
o |
o |
T1K : Au cours des trois dernières semaines,
avez-vous vu ou lu du contenu au sujet du recrutement dans les Forces armées
canadiennes à la télévision et/ou sur les réseaux sociaux comme Facebook,
YouTube, Instagram ou LinkedIn?
o
Oui
o
Non
QUESTIONS SUR LE RAPPEL DES ANNONCES
T1L : Voici une publicité qui a récemment été
diffusée sur différents médias. Cliquez ici pour voir.
[INSÉREZ LES
PUBLICITÉS VIDÉO, IMPRIMÉE ET RADIO] [CLIQUEZ
POUR ALLER À LA PAGE SUIVANTE]
Au cours des trois dernières semaines avez-vous vu, lu
ou entendu cette publicité?
o
oui
o
non => ALLER À T1N
T1M : Où
avez-vous vu, lu ou entendu cette publicité?
CHOISISSEZ TOUTES
LES RÉPONSES APPLICABLES.
o Magazines
o Revues médicales
o Radio
o Facebook
o Instagram
o Snapchat
o Spotify
o LinkedIn
o Une application mobile
o YouTube
o Apex
o Site Internet
o Sites web de nouvelles
o Moteur de recherche (par ex., Google, Bing)
o Autre, veuillez préciser ___________________
T1N : Quel
est, selon vous, le message principal
que cette publicité tentent de véhiculer?
T1O :
Pensez-vous que cette publicité fournit une représentation authentique des
Forces armées canadiennes?
o
Oui
o
Non
o
Je ne sais pas
T1P : Dans
quelle mesure êtes-vous d’accord ou non avec les énoncés suivants au sujet de
cette publicité?
LIRE LES ÉNONCÉS AU HASARD.
|
1 Fortement en
désaccord |
2 |
3 |
4 |
5 Fortement en accord |
---|---|---|---|---|---|
Cette publicité attire mon attention |
o |
o |
o |
o |
o |
Cette publicité me concerne |
o |
o |
o |
o |
o |
Cette publicité est difficile à suivre |
o |
o |
o |
o |
o |
Cette publicité ne favorise pas un parti politique
plus qu'un autre |
o |
o |
o |
o |
o |
Cette publicité traite d’un sujet important |
o |
o |
o |
o |
o |
Cette publicité fournit de l’information nouvelle |
o |
o |
o |
o |
o |
Cette publicité indique clairement que les Forces
armées canadiennes offrent plus de 100 options de carrière |
o |
o |
o |
o |
o |
QUESTIONS DÉMOGRAPHIQUES
D1 : Laquelle de ces
descriptions correspond le mieux à votre situation d’emploi actuelle?
Êtes-vous…
NE CHOISIR QU’UNE CATÉGORIE.
o travailleur/travailleuse à temps complet (30 heures et plus par semaine)
o travailleur/travailleuse à temps partiel (moins de 30 heures par semaine)
o travailleur/travailleuse autonome
o sans emploi, mais à la recherche d’un emploi
o étudiant(e) à temps plein
o retraité(e)
o à l’extérieur du marché du travail (personne au foyer à temps plein ou sans emploi et non à la recherche d’emploi)
o autre situation
D2 : Quel est le
plus haut niveau de scolarité que vous avez atteint?
NE CHOISIR QU’UNE
SEULE OPTION.
o
huitième année ou moins
o
quelques années d’études secondaires
o
diplôme d’études secondaires ou l’équivalent
o
apprentissage enregistré ou autre certificat
ou diplôme d’une école de métiers
o
collège, cégep ou autre certificat ou diplôme
d’une institution non universitaire
o
certificat ou diplôme inférieur au
baccalauréat
o
baccalauréat
o
diplôme d’études universitaires supérieur au baccalauréat
D3 : Des
enfants de moins de 18 ans habitent-ils actuellement dans votre foyer?
o oui
o non
D4 : Laquelle des
catégories suivantes décrit le mieux la somme des revenus annuels avant impôts
de tous les membres de votre foyer?
NE CHOISIR QU’UNE
SEULE RÉPONSE.
o
moins de 20 000 $
o
entre 20 000 $ et 40 000 $
o
entre 40 000 $ et 60 000 $
o
entre 60 000 $ et 80 000 $
o
entre 80 000 $ et 100 000 $
o
entre 100 000 $ et 150 000 $
o
entre 150 000 $ et 200 000 $
o
200 000 $ et plus
o
préfère ne pas répondre
D5 : Où
êtes-vous né(e)?
o
Au
Canada
o
À
l’étranger Précisez quel pays ________________________
DEMANDEZ SI
D5=NÉ(E) À L’ÉTRANGER
D6 : En
quelle année êtes-vous arrivé(e) au Canada?
YYYY
PÉRIODE
ADMISSIBLE : 1900 à 2022
D7 : Appartenez-vous à
un groupe autochtone, soit Premières nations, Inuit ou Métis? Les membres des
Premières Nations comprennent les Indiens inscrits et les Indiens non inscrit.
o
Oui
o
Non
D8 : Il se
peut que vous apparteniez à un ou à plusieurs groupes culturels ou ethniques de
la liste suivante. Êtes-vous…? EN CHOISIR
AU PLUS DEUX
o
Blanc
o
Asiatique du sud (p. ex. Indien(ne) d’Asie,
Pakistanais(e), Sri-lankais(e))
o
Chinois
o
Noir
o
Philippin
o
Latino-américain
o
Arabe
o
Asiatique du Sud-Est (par ex., Vietnamien(ne),
Cambodgien(ne), Malaisien(ne), Laotien(ne))
o
Asiatique de l’ouest (par ex., Iranien(ne),
Afghan(e))
o
Coréen
o
Japonais
o
Autre, veuillez préciser ___________________
D9 : Quelle est la
première langue que vous avez apprise lorsque vous étiez enfant et que vous
comprenez toujours?
EN CHOISIR AU PLUS
DEUX.
o
Anglais
o
Français
o
Autre langue, veuillez préciser
___________________
SONDAGE-TEST
SEULEMENT :
D10 : Ce
sondage contenait-il des questions qui étaient difficile à comprendre?
o
Oui
o
Non
D11 : SI « OUI » EN D10 : Quelles
questions étaient difficiles à comprendre selon vous?
[NOTER MOT À MOT]
Voilà qui met fin au sondage que nous avons effectué
pour le compte du ministère de la Défense nationale, du gouvernement du Canada.
Dans les mois à venir, le rapport sera disponible de Bibliothèque et Archives
Canada. Nous vous remercions beaucoup d’avoir pris le temps d’y participer.
Votre aide nous est très précieuse.
ADVERTISING CAMPAIGN EVALUATION TOOL
BASELINE 2023 CAMPAIGN SURVEY – FEBRUARY 2023
Baseline sections should be asked before the ads have run in the media.
INTRODUCTION
Thank you for taking a few minutes to
complete this survey on current issues that matter to Canadians. Si vous
préférez répondre à ce sondage en français, veuillez cliquer sur français [SWITCH TO FRENCH VERSION].
The survey is being conducted by Narrative
Research. Your participation is voluntary and your
responses will be kept entirely confidential and anonymous. The survey
takes about [BASELINE: 5 minutes / POST-CAMPAIGN: 7 minutes] to complete. This
survey is being administered according to the requirements of the Privacy
Act, the Access to Information Act, and any other relevant legislation.
START SURVEY
Click here if you wish to verify the authenticity of
this survey. To view our privacy policy, click here.
a Does anyone in your household work for any of the following organizations? SELECT ALL THAT APPLY
o
A marketing research firm
o
A magazine or newspaper
o
An advertising agency or graphic design firm
o
A political party
o
A radio or television station
o
A public relations company
o
The federal or provincial government
o
None of these organizations
IF “NONE OF THESE ORGANIZATIONS” CONTINUE,
OTHERWISE THANK AND TERMINATE.
b What is your gender?
o
Male
o
Female
o
Other
o
Prefer not to answer
c In what year were you born?
YYYY
ADMISSIBLE RANGE
1988-2005
IF > 2005, THANK AND TERMINATE
ASK D IF QUESTION C IS LEFT BLANK, OR IF
1988 OR IF 1998 OR IF 2005 IN QUESTION C
d In which of the following age
categories do you belong? SELECT ONE ONLY
o
less than 18 years old
o
18 to 24
o
25 to 34
o
35 or older
IF “LESS THAN 18 YEARS OLD” OR “BLANK”, OR
“35 OR OLDER” THANK AND TERMINATE
e In which province or territory
do you live? SELECT ONE ONLY
o
Alberta
o
British Columbia
o
Manitoba
o
New Brunswick
o
Newfoundland and Labrador
o
Northwest Territories
o
Nova Scotia
o
Nunavut
o
Ontario
o
Prince Edward Island
o
Quebec
o
Saskatchewan
o
Yukon
IF NO PROVINCE OR TERRITORY IS SELECTED,
THANK AND TERMINATE
CORE
QUESTIONS
ASK ALL RESPONDENTS
Q1: Over the past three weeks, have you seen,
read or heard any advertising from the Government of Canada?
o
Yes
o
No => GO TO T1A
Q3: Think about the most recent Government of Canada ad that comes to
mind. What do you remember about this ad?
CAMPAIGN SPECIFIC QUESTIONS
ASK ALL RESPONDENTS
T1A: Over the past three weeks, have you seen, read or heard any Government
of Canada advertising about the Canadian Armed Forces?
o
Yes
o
No => GO TO T1G
T1B: Where have you seen, read or heard this ad about the Canadian Armed Forces?
SELECT ALL THAT APPLY
o Print magazine
o Facebook
o Instagram
o Snapchat
o TikTok
o Twitch
o LinkedIn
o In a mobile app
o Video Game
o YouTube
o Internet website
o Online news sites
o Web search (e.g. Google, Bing)
o Arena/stadium
o Doctor’s office
o Other, specify: _____________
T1C: What do you remember about this ad?
ASK ALL RESPONDENTS
T1D: Did you do anything as a result of seeing,
hearing, or reading recent advertising about the Canadian Armed Forces?
Yes => POSE T1E
No => SKIP TO T1F
T1E: What did you do as a result of seeing,
hearing, or reading recent advertising about the Canadian Armed Forces?
[SELECT ALL THAT APPLY]
o Visited the Department of National Defence/DND website
o Visited other website(s) (PLEASE specify which websites: _____________________
o Telephoned the Department of National Defence/DND
o Visited the Department of National Defence/DND in person
o Visited the Department of National Defence/DND social media pages
o OTHER (PLEASE SPECIFY: __________________
T1F: After having recently seen, heard or read
advertising about the Canadian Armed Forces, did you specifically take steps to learn more
about jobs offered by the Canadian Armed Forces?
o Yes
o No
ASK ALL RESPONDENTS
T1G: And over the past three weeks, have you seen, heard
or read any advertising specifically showing members of the Canadian Armed Forces
doing their job?
o Yes POSE T1H
o No SKIP TO T1I
T1H: What do you remember about this ad? [RECORD
VERBATIM]
o Nothing
T1I: If someone you know,
such as a family member or friend, told you that they were joining the Canadian
Armed Forces, how would you view that decision? Would your reaction be …:
o Very favourable
o Somewhat favourable
o Neutral
o Somewhat unfavourable
o Very unfavourable
T1J: ASK
ALL RESPONDENTS – ROTATE STATEMENTS (Statement “A” should always be posed
first)
To what extent are you aware of:
|
1 Not at all
informed |
2 |
3 |
4 |
5 Very informed |
---|---|---|---|---|---|
a Career or job options in the Canadian Armed Forces? |
o |
o |
o |
o |
o |
b Educational and training options within the Canadian Armed Forces? |
o |
o |
o |
o |
o |
c Career or job options specifically for women within the Canadian Armed Forces? |
o |
o |
o |
o |
o |
d Career or job options specifically for Indigenous Peoples in the Canadian Armed Forces? |
o |
o |
o |
o |
o |
e Opportunities specifically within the Reserve Force of the Canadian Armed Forces? |
o |
o |
o |
o |
o |
T1K: Over the past
three weeks, have you seen or read content related to recruitment into the
Canadian Armed Forces on television and/or social media websites such as Facebook, YouTube, Twitter, Instagram or LinkedIn?
o
Yes
o No
DEMOGRPAHIC
QUESTIONS
D1: Which of the following categories best describes your current employment
status? Are you…
SELECT ONE ONLY
o Working full-time (30 or more hours per week)
o Working part-time (less than 30 hours per week)
o Self-employed
o Unemployed, but looking for work
o A student attending school full-time
o Retired
o Not in the workforce (Full-time homemaker or unemployed but not looking for work)
o Other employment status
D2: What is the highest level of formal education that you have completed?
SELECT ONE ONLY
o
Grade 8 or less
o
Some high school
o
High school diploma or equivalent
o
Registered Apprenticeship or other trades certificate or diploma
o
College, CEGEP or other non-university certificate or diploma
o
University certificate or diploma below bachelor's level
o
Bachelor's degree
o
Postgraduate degree above bachelor's level
D3: Are there any children under the age of 18 currently living in your
household?
o Yes
o No
D4: Which of the following categories best describes your total annual
household income, including income from all household members, before taxes are
deducted?
SELECT ONE ONLY
o
Under $20,000
o
Between $20,000 and $40,000
o
Between $40,000 and $60,000
o
Between $60,000 and $80,000
o
Between $80,000 and $100,000
o
Between $100,000 and $150,000
o
Between $150,000 and $200,000
o
$200,000 and above
o
Prefer not to say
D5: Where were you born?
o
Born in Canada
o
Born outside Canada ‘SPECIFY’:
Specify the
country: ___________________
ASK IF D5=BORN OUTSIDE CANADA
D6: In what year did you first move to Canada?
YYYY
ADMISSIBLE RANGE:
1900-2023
D7: Are you part of an Indigenous
group, that is, First Nations, Métis or Inuk (Inuit)?
First Nations includes Status and Non–Status Indians.
o
Yes
o
No
D8: You may belong to one or more racial or cultural groups on the
following list. Are you...? SELECT UP TO TWO
o
White
o
South Asian (e.g., East Indian, Pakistani, Sri Lankan)
o
Chinese
o
Black
o
Filipino
o
Latin American
o
Arab
o
Southeast Asian (e.g., Vietnamese, Cambodian,
Malaysian, Laotian)
o
West Asian (e.g., Iranian, Afghan)
o
Korean
o
Japanese
o
Other, specify ___________________
D9: What is the language you first learned at home as a child and still
understand? SELECT UP TO TWO
o
English
o
French
o
Other language, specify ___________________
(PRE-TEST
ONLY-REMOVE BEFORE FULL LAUNCH)
D10:
Are there any questions in this survey that you found difficult to understand?
o
Yes
o
No
D11:
IF YES IN D10: Which questions did
you find difficult to understand?
RECORD
VERBATIM
That concludes the survey. This survey was conducted on behalf of the Department of National Defence, of the Government of Canada. In the coming months the report will be available from Library and Archives Canada. We thank you very much for taking the time to answer this survey, it is greatly appreciated.
OUTIL D’ÉVALUATION DES CAMPAGNES PUBLICITAIRES
2023 SONDAGE DE RÉFÉRENCE– FÉVRIER 2023
Les sections du
sondage de référence doivent être posées avant la diffusion des annonces dans
les médias.
Toutes les
sections doivent être posées après la diffusion des annonces dans les médias.
INTRODUCTION
Merci de prendre
quelques minutes pour répondre à ce sondage sur des enjeux d’actualité qui
intéressent les Canadiens. If you prefer to complete this survey in English, please click English [PASSEZ A LA VERSION ANGLAISE].
Le présent sondage
est mené par Narrative Research. Votre
participation est volontaire et toutes vos réponses demeureront confidentielles.
Le sondage prend environ [SONDAGE DE RÉFÉRENCE : 5 minutes / SONDAGE D’APRÈS
CAMPAGNE : 7 minutes] à compléter. Ce sondage est conforme aux exigences de la
Loi sur la protection des renseignements personnels, Loi sur l’accès à
l’information et d’autres lois pertinentes.
DÉBUT DU SONDAGE
Cliquez ici si
vous souhaitez vérifier l’authenticité du présent sondage et ici pour
lire notre politique de confidentialité.
a Quelqu’un au sein de votre foyer travaille-t-il pour l’une ou l’autre des organisations suivantes? CHOISISSEZ TOUTES LES RÉPONSES APPLICABLES.
o
une firme de recherche en marketing
o
un magazine ou un quotidien
o
une agence de publicité ou de conception
graphique
o
un parti politique
o
une station radiophonique ou de télévision
o
une firme de relations publiques
o
le gouvernement fédéral ou provincial
o
aucune de ces organisations
SI « AUCUNE
DE CES ORGANISATIONS », POURSUIVEZ. SINON, REMERCIEZ LE RÉPONDANT ET
METTEZ FIN AU SONDAGE.
b
Quel est votre genre?
o
homme
o
femme
o
autre
o
je préfère ne pas répondre
c
Quelle est votre année de naissance?
YYYY
TRANCHE ADMISSIBLE
: 1988 À 2005 SI L’ANNÉE EST > 2005, REMERCIEZ ET METTEZ
FIN AU SONDAGE.
POSEZ LA QUESTION
D SI LA CASE À LA QUESTION C EST VIDE, OU SI 1988 OU SI 1998 OU SI 2005 À Q.C.
d
À quelle catégorie d’âge appartenez-vous? NE CHOISIR QU’UNE SEUL CATÉGORIE.
o
Moins de 18 ans
o
18 à 24
o
25 à 34
o
35 et plus
SI LE RÉPONDANT A
MOINS DE 18 ANS, A PLUS DE 35 ANS OU NE RÉPOND PAS, REMERCIEZ ET METTEZ
FIN AU SONDAGE.
e
Dans quelle province ou quel territoire
habitez-vous?
NE CHOISIR QU’UN PROVINCE OU QU’UN TERRITOIRE.
o
Alberta
o
Colombie-Britannique
o
Manitoba
o
Nouveau-Brunswick
o
Terre-Neuve-et-Labrador
o
Territoire du Nord-Ouest
o
Nouvelle-Écosse
o
Nunavut
o
Ontario
o
Île-du-Prince-Édouard
o
Québec
o
Saskatchewan
o
Yukon
SI AUCUNE PROVINCE
OU AUCUN TERRITOIRE N’EST CHOISI(E), REMERCIEZ LE RÉPONDANT ET METTEZ FIN AU
SONDAGE.
QUESTIONS DE BASE
POSER À TOUS LES
RÉPONDANTS.
Q1 : Au cours
des trois dernières semaines avez-vous vu, lu ou entendu des publicités du
gouvernement du Canada?
o
oui
o
non =>
ALLER À T1A
Q3 : Pensez à la plus
récente publicité du gouvernement du Canada qui vous revient à l’esprit. De
quoi vous souvenez-vous à propos de cette publicité?
QUESTIONS
SPÉCIFICQUES À LA CAMPAGNE
POSER À TOUS LES
RÉPONDANTS.
T1A : Au cours
des trois dernières semaines, avez-vous vu, lu ou entendu une publicité du
gouvernement du Canada au sujet des Forces armées canadiennes?
o
oui
o
non => ALLEZ À T1G
T1B : Où
avez-vous vu, lu ou entendu cette publicitéau sujet
des Forces armées canadiennes? CHOISISSEZ TOUTES LES RÉPONSES APPLICABLES.
o Magazines
o Facebook
o Instagram
o Snapchat
o TikTok
o Twitch
o LinkedIn
o Une application mobile
o Jeux Vidéo
o YouTube
o Site Internet
o Sites web de nouvelles
o Moteur de recherche (par ex., Google, Bing)
o Aréna/stade
o Le bureau de médecin
o Autre, veuillez préciser ________________
T1C : De quoi
vous souvenez-vous à propos de cette publicité?
POSER À TOUS LES
RÉPONDANTS.
ON PEUT AJOUTER
ICI DES QUESTIONS PRÉCISES À LA CAMPAGNE POUR ÉVALUER LES ATTITUDES ET LES
COMPORTEMENTS.
T1D : Avez-vous
fait quelque chose après avoir vu, entendu ou lu la récente publicité au sujet
des Forces armées canadiennes?
Oui => POSER T1E
Non => ALLEZ À T1F
T1E : Qu’avez-vous
fait après avoir vu, entendu ou lu la récente publicité au sujet des Forces armées
canadiennes?
CHOISISSEZ TOUTES
LES RÉPONSES APPLICABLES
o A visité le site Web du ministère de la Défense nationale/MDN
o Consulté un ou d’autres sites Web (veuillez préciser)
o A téléphoné au ministère de la Défense nationale/MDN
o A visité le ministère de la Défense nationale/MDN en personne
o A visité les pages des média sociaux du ministère de la Défense nationale/MDN
o Autre, (veuillez préciser) __________________
T1F : Après avoir
récemment vu, entendu ou lu la publicité au sujet des Forces armées
canadiennes, avez-vous entrepris des démarches précises afin d’en savoir plus
sur les emplois offerts aux Forces armées canadiennes?
o
Oui
o
Non
POSER À TOUS LES
RÉPONDANTS.
T1G : Et au cours des
trois dernières semaines, avez-vous vu, entendu ou lu une publicité illustrant
précisément des membres des Forces armées canadiennes en train de travailler?
o
Oui =>
POSER T1H
o
Non => ALLEZ À T1I
T1H : De
quoi vous souvenez-vous à propos de cette publicité? [NOTER MOT À MOT]
Rien
T1I : Si une
personne de votre connaissance, comme un membre de la famille ou un ami, vous
disait qu’elle se joint aux Forces armées canadiennes, comment percevriez-vous
cette décision? Quelle serait votre réaction?
o
Très favorable
o
Plutôt favorable
o
Neutre
o
Plutôt défavorable
o
Très défavorable
T1J : POSER À TOUS LES
RÉPONDANTS - LIRE LES ÉNONCÉS AU HASARD, A = FAUT TOUJOURS ÊTRE LE PREMIER
Dans quelle mesure êtes-vous au courant des
possibilités :
|
1 Pas du tout
informé(e) |
2 |
3 |
4 |
5 Très informé(e) |
---|---|---|---|---|---|
a de carrière ou d’emploi au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
b d’apprentissage et de formation au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
c de carrière ou d’emploi précisément pour les femmes au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
d de carrière ou d’emploi précisément pour les autochtones au sein des Forces armées canadiennes? |
o |
o |
o |
o |
o |
e précisément dans la Force de réserve des Forces armées canadiennes? |
o |
o |
o |
o |
o |
T1K : Au cours
des trois dernières semaines, avez-vous vu ou lu du contenu au sujet du
recrutement dans les Forces armées canadiennes à la télévision et/ou sur les
réseaux sociaux comme Facebook, YouTube, Twitter, Instagram ou LinkedIn?
o
Oui
o
Non
QUESTIONS DÉMOGRAPHIQUES
D1 : Laquelle
de ces descriptions correspond le mieux à votre situation d’emploi actuelle?
Êtes-vous…
NE CHOISIR QU’UNE CATÉGORIE.
o travailleur/travailleuse à temps complet (30 heures et plus par semaine)
o travailleur/travailleuse à temps partiel (moins de 30 heures par semaine)
o travailleur/travailleuse autonome
o sans emploi, mais à la recherche d’un emploi
o étudiant(e) à temps plein
o retraité(e)
o à l’extérieur du marché du travail (personne au foyer à temps plein ou sans emploi et non à la recherche d’emploi)
o autre situation
D2 : Quel
est le plus haut niveau de scolarité que vous avez atteint?
NE CHOISIR QU’UNE
SEULE OPTION.
o
huitième année ou moins
o
quelques années d’études secondaires
o
diplôme d’études secondaires ou l’équivalent
o
apprentissage enregistré ou autre certificat
ou diplôme d’une école de métiers
o
collège, cégep ou autre certificat ou diplôme
d’une institution non universitaire
o
certificat ou diplôme inférieur au
baccalauréat
o
baccalauréat
o
diplôme d’études universitaires supérieur au
baccalauréat
D3 : Des enfants de moins de 18 ans habitent-ils
actuellement dans votre foyer?
o oui
o non
D4 : Laquelle
des catégories suivantes décrit le mieux la somme des revenus annuels avant
impôts de tous les membres de votre foyer?
NE CHOISIR QU’UNE
SEULE RÉPONSE.
o
moins de 20 000 $
o
entre 20 000 $ et 40 000 $
o
entre 40 000 $ et 60 000 $
o
entre 60 000 $ et 80 000 $
o
entre 80 000 $ et 100 000 $
o
entre 100 000 $ et 150 000 $
o
entre 150 000 $ et 200 000 $
o
200 000 $ et plus
o
préfère ne pas répondre
D5 : Où
êtes-vous né(e)?
o
Au
Canada
o
À
l’étranger Précisez quel pays
________________________
DEMANDEZ SI
D5=NÉ(E) À L’ÉTRANGER
D6 : En quelle
année êtes-vous arrivé(e) au Canada?
YYYY
PÉRIODE
ADMISSIBLE : 1900 à 2023
D7 : Appartenez-vous à
un groupe autochtone, soit Premières nations, Inuit ou Métis? Les membres des
Premières Nations comprennent les Indiens inscrits et les Indiens non inscrit.
o
Oui
o
Non
D8 : Il se peut
que vous apparteniez à un ou à plusieurs groupes culturels ou ethniques de la
liste suivante. Êtes-vous…?
EN CHOISIR AU PLUS
DEUX
o
Blanc
o
Asiatique du sud (p. ex. Indien(ne) d’Asie, Pakistanais(e),
Sri-lankais(e))
o
Chinois
o
Noir
o
Philippin
o
Latino-américain
o
Arabe
o
Asiatique du Sud-Est (par ex., Vietnamien(ne),
Cambodgien(ne), Malaisien(ne), Laotien(ne))
o
Asiatique de l’ouest (par ex., Iranien(ne),
Afghan(e))
o
Coréen
o
Japonais
o
Autre, veuillez préciser ___________________
D9 : Quelle
est la première langue que vous avez apprise lorsque vous étiez enfant et que
vous comprenez toujours?
EN CHOISIR AU PLUS
DEUX.
o
Anglais
o
Français
o
Autre langue, veuillez préciser
___________________
SONDAGE-TEST
SEULEMENT :
D10 : Ce
sondage contenait-il des questions qui étaient difficile à comprendre?
o
Oui
o
Non
D11 : SI « OUI » EN D10 : Quelles questions étaient difficiles à
comprendre selon vous?
[NOTER MOT À MOT]
Voilà qui met fin au sondage que nous avons effectué
pour le compte du Ministère de la Défense nationale, du gouvernement du Canada.
Dans les mois à venir, le rapport sera disponible de Bibliothèque et Archives
Canada. Nous vous remercions beaucoup d’avoir pris le temps d’y participer.
Votre aide nous est très précieuse.