An overlapping dual-frame (landline and cell) sample was used to minimize coverage error. The following table provides a breakdown of the number of completed surveys by sample source:
Sample Source | Sample Type | n |
---|---|---|
ASDE | Landline RDD | 235 |
Advanis | Wireless GPRS | 167 |
n=402 |
To ensure that the sample was representative, and that the results reflected the distribution of electors by age and gender, the sampling frame was based on Statistics Canada's 2021 census data and stratified by age.
Respondents were randomly selected using the landline and wireless samples. For landlines, interviewers asked to speak to the youngest person in the household who is a Canadian citizen and who was at least 18 years old at the time of the election. If that was not the initial individual answering the telephone, but another in the household, interviewers asked to speak to the eligible respondent. If that person was not available over the interview period, interviewers asked to speak to the person with the next most recent birthday. No selection procedures were used for the cell phone sample.
Once an appropriate adult was reached, voter eligibility was verified by the interviewer. To be eligible for the survey, respondents had to be Canadian citizens of at least 18 years of age on polling day and to have had an address of ordinary residence in the Durham electoral district from the first day of the revision period until election day.
Based on a sample of this size (n=402), the overall results would have a maximum margin of error of ±4.9%, 19 times out of 20.
To pre-test the questionnaire, respondents were first administered the survey and then asked about the clarity of the questionnaire. The short debrief following the survey provided an opportunity for respondents to offer feedback on the questionnaire and was conducted by telephone on March 5, 2024, following the March 4, 2024, by-election. Respondents had the choice of participating in the official language of their choice; all were completed in English. The pre-test interviews were digitally recorded and reviewed by Phoenix SPI team members and EC officials. There were no changes to the questionnaire following the pre-test; therefore, the data from the pre-test was retained in the final survey data set.
All fieldwork was conducted using computer-assisted telephone interviewing (CATI) and computer-assisted web interviewing (CAWI) technology. To minimize non-response, those who declined to complete the survey over the telephone were given the option to complete the survey online. Three (n=3) electors completed the survey online; the remaining 399 electors did so over the telephone.
The following specifications applied:
The table below presents information about the final call dispositions for this survey and the response rate: first the individual landline and wireless samples, then the overall results.
Call Disposition | Landline | Wireless | Overall |
---|---|---|---|
Out-of-scope—invalid (I) | |||
Not in service, fax/modem, business | 13,527 | 54 | 13,581 |
Unresolved (U) | |||
Busy, voice mail, no answer | 11,138 | 888 | 12,026 |
In-scope—non-responding (IS) | |||
Language problem, illness | 28 | 1 | 29 |
Selected respondent not available | 10 | 0 | 10 |
Household refusal | 1,371 | 89 | 1,460 |
Respondent refusal | 988 | 70 | 1,068 |
Qualified respondent break-off/partial complete | 22 | 7 | 29 |
In-scope—responding units (R) | |||
Does not qualify—age | 5 | 0 | 5 |
Does not qualify—citizenship | 1 | 1 | 2 |
Terminate—does not live in Durham | 23 | 60 | 83 |
Terminate—age stratum filled | 760 | 9 | 769 |
Completed the survey | 235 | 167 | 402 |
Total numbers dialed | 28,118 | 1,346 | 29,464 |
Response rate footnote 1 = R/(U+IS+R) | 7.0% | 18.3% | 7.9% |
The survey data were weighted using calibration to accurately reflect the separate age and gender distributions of eligible electors in the Durham riding. Specifically, the nested census population of males and females residing in the Durham federal electoral district who were 18–24, 25–34, 35–44, 45–64 and 65 or older were compiled as weighting frames. The survey results were then compared to the same age and gender proportions to generate survey weights that summed to the size of the sample of respondents. Any respondents who refused to provide their age and/or gender were given a neutral weight so as not to skew the weighting proportions. Weights were based on Statistics Canada's 2021 census data.
The table below shows the weighted and unweighted proportions for the variables used to create the weights.
Variable | Durham | |
---|---|---|
Unweighted | Weighted | |
Total (n) | 402 | 402 |
Gender | ||
Male | 49% | 48% |
Female | 50% | 51% |
Refusal | 1% | 1% |
Age | ||
18 to 24 | 8% | 11% |
25 to 34 | 12% | 17% |
35 to 44 | 18% | 19% |
45 to 64 | 37% | 34% |
65 or older | 25% | 19% |
Good afternoon/evening. My name is ... and I am calling from [...], a public opinion research company. Today we are conducting a study on behalf of Elections Canada. Please be assured that we are not selling or soliciting anything.
[If asked]: The survey will take about 15 minutes to complete.
[If asked about topic of survey]: The focus of this survey is on the federal by-election that took place on March 4, 2024, not the general federal election, provincial elections, or any previous elections the respondent may have voted in.
[If asked about the legitimacy of the survey]: If you would like to ensure that this survey is run by Elections Canada, you can call their toll-free number at 1-800-463-6868. Their hours of operation are Monday to Friday, from 9:00 a.m. to 5:00 p.m. (Eastern Time). You can also contact Alethea Woods, from Phoenix Strategic Perspectives, at 613-260-1700.
[If asked about the national do not call list]: Calls made for the purpose of market research, polls or surveys are not considered telemarketing calls. Organizations making these types of calls are not required to register with the National Do Not Call List. The National Do Not Call List toll-free telephone number is 1-866-580-3625.
[If asked about elections canada]: The Elections Canada website is at elections.ca. The toll-free telephone number for Elections Canada is 1-800-463-6868. Their hours of operation are Monday to Friday, from 9:00 a.m. to 5:00 p.m. (Eastern Time).
I would like to speak to the youngest person in your household who is a Canadian citizen and who is at least 18 years old. Would that be you?
I would like to speak to someone who is a Canadian citizen and is at least 18 years old. Does that describe you?
Please note that this call may be recorded for quality control or training purposes. By taking part in this survey, you consent to the use of your answers for research and statistical purposes. Any personal information collected is subject to the federal Privacy Act and will be held in strict confidence. Elections Canada will not use your responses to identify you, and none of your opinions will be attributed to you personally in any way. The anonymous database of all responses may be shared with external researchers under the strict condition that no personal information is ever distributed or made public.
Between January 29, 2024, and March 4, 2024, did you live in the federal riding of Durham?
If no: Unfortunately, this survey must be completed by Canadian citizens who lived in this riding and were eligible to vote in the March 4, 2024, federal by-election. thank and discontinue.
If answers spontaneously that lived in riding for only part of revision period: Unfortunately, this survey must be completed by Canadian citizens who lived in this riding for the entire revision period (January 29, 2024, through March 4, 2024) and were eligible to vote in the March 4, 2024, federal by election. thank and discontinue.
If unsure: review list of communities in the riding with respondent to determine if he/she was a resident of the riding. If so, continue. If not, discontinue using language in code 02. List of communities attached.
If unsure (2): Interviewer to use elections canada's online voter information service to verify riding by postal code (http://www.elections.ca/scripts/vis/finded).
May I confirm that you are a Canadian citizen?
[If Landline] IF NO: This survey must be completed by Canadian citizens who were at least 18 years old on March 4, 2024. Would there be someone in your household who is a Canadian citizen and was at least 18 years old on March 4, 2024? if yes ask to speak to that person.
In what year were you born?
[Do not read]
Record year: [4- digit number; min. 1905, max. 2024]
[Compute Age=2024-YOB]
[If Age<18, Terminate and go to THNK2]
[Show if YOB=99]
Would you be willing to indicate in which of the following age categories you belong?
[Do not read]
[Show if Age=18 or AgeGroup=01]
May I confirm that you were at least 18 years old on March 4, 2024?
[If Landline] if no: This survey must be completed by Canadian citizens who were at least 18 years old on March 4, 2024. Would there be someone in your household who is a Canadian citizen and was at least 18 years old on March 4, 2024? if yes ask to speak to that person.
[Do not read]
[Ask all]
Did you know that a federal by-election took place on March 4, 2024, in your riding?
[Do not read]
Now, I would like to ask you a few questions about voting in a federal by-election. Please answer to the best of your knowledge.
[Randomize order of next 2 questions]
If an elector is not registered on election day and wants to vote, can they register at the polling place and then vote immediately after?
[If asked about registration: "Registration means that your name is on the list of electors."]
[Do not read]
Is it possible for Canadian electors to check, update or complete their voter registration on Elections Canada's website?
[If asked about registration: "Registration means that your name is on the list of electors."]
[Do not read]
[Rotate KnowID_Identity and KnowID_Address]
In order to vote in a Canadian federal election, do voters have to present ...
A proof of IDENTITY?
[Do not read]
A proof of ADDRESS?
[Do not read]
To the best of your knowledge, what are the current ways that electors can vote in a federal election?
[Do not read]—select all that apply (multiple mentions). probe carefully to avoid suggesting answers which would give away the list. after each answer, probe "Anything else?"
notes:
If AwareBy IS 02 OR 98 OR 99, GO TO ByFairness
I would like to ask a few questions about the information you may have received in advance of the federal by election.
During the campaign, did you receive a voter information card addressed to you personally and telling you where and when to vote?
[Do not read]
Overall, how well informed do you feel you were about when, where and how to vote in the by-election?
[read scale]
[Do not read]
During the federal by-election campaign, did you see or hear advertising from Elections Canada about where, when and how to vote ...
ROTATE AdRecallA to AdRecallD
... on social media such as Facebook, Instagram or YouTube?
[Do not read]
... when you were browsing websites or on a mobile application?
[Do not read.] Includes mentions of online newspapers and articles, "on my phone", weather network.
... on the radio or an audio platform (such as Spotify)?
[Do not read]
... in a local newspaper?
[Do not read]
... in any other format?
[Do not read]
What, if anything, did you do to make sure you were registered to vote in this federal by-election? Did you …?
[Read list; accept one response]
[If respondent gives multiple answers: code 01 ahead of 02 or 03, code 02 ahead of 03]
[Do not read]
Did none of the above
How did you make sure you were registered?
[Show if RegCheck=01–03]
[Do not read. code up to 3 responses.]
[If respondent says they went online/checked website, probe to clarify if this is code 03 or 04.]
Many people don't or can't vote for a variety of reasons. Which of the following statement describes you?
[Do not read]
Show if Voted IS 01 or 02 or 03
What is the main reason you did not vote?
[Do not read. Code 1 answer]
Everyday life or health reasons
Political reasons
Electoral process–related reasons
All other reasons
Show if ReasonDidNotVote IS 01 (Too busy)
You said you were too busy to vote. If you had to choose, which of the following most closely reflects your situation? Would it be …
[Randomize 01-03]
[Read]
[Do not read]
Show if ReasonDidNotVote IS 02 (Out of town / away from home)
Were you away from home for work or personal reasons?
[Do not read]
If respondent asks why
Elections Canada is working to improve its services for electors who are away from home on voting days.
Show if ReasonDidNotVote IS 02 (Out of town / away from home)
Would you say that your travel was planned or unplanned?
[Do not read]
if respondent asks what is meant by unplanned
This means that the trip was not planned in advance—for example, you knew that you were leaving less than a week before you left.
if respondent asks why we want to know
Elections Canada is working to improve its services for electors who are out of town on voting days.
If Voted IS 01, 02, 03, 98 OR 99, GO TO ByFairness
Show if Voted IS 04
Which method did you use to vote? Was it ...
[read in order until respondent provides a response. code one answer only.]
[Do not read]
if respondent asks for clarification at answer 03 "at the local elections canada office"
Whenever there is an election, the official in charge of conducting the election in a riding opens an office. That office is open to the public for the duration of the campaign. Did you vote there before election day?
if respondents say they voted online, ask for clarification. voters can apply online to receive a ballot in the mail at home.
Show section if VoteMethod IS 01, 02, 03
Do you remember approximately what time it was when you went to vote at the [Insert based on VoteMethod=01,02,03: polling station/advance polling station/local Elections Canada office]?
Do not read
read only if necessary; code only one response
To the best of your knowledge, how long did it take you to travel to the [Insert based on VoteMethod=01,02,03: polling station/advance polling station/local Elections Canada office]?
[Do not read]
Was the [Insert based on VoteMethod=01,02,03: polling station/advance polling station/local Elections Canada office] a very reasonable, somewhat reasonable, somewhat unreasonable, or very unreasonable distance from your home?
[Do not read]
Would you say that the building where you voted was …?
[Read Scale]
[Do not read]
To the best of your knowledge, how long did it take you to vote once you arrived at the [Insert based on VoteMethod=01,02,03 polling station/advance polling station/local Elections Canada office]?
[Do not read; Record time in minutes]
[Show if VoteTime=01 (i.e., if it's a number)]
Would you say that this was a reasonable amount of time?
[Do not read. question refers to time spent to vote.]
[Show If GotVIC=01 and VoteMethod=01,02,03]
Did you bring your voter information card with you to the [insert based on VoteMethod: 01 polling station, 02 advance polling station or 03 local Elections Canada office]?
[Do not read. code one answer only]
[Show if VoteMethod=01 to 96]
Overall, was it very easy, somewhat easy, somewhat difficult or very difficult to meet the identification requirements when you voted?
[Do not read]
note: this question refers to respondent's own experience
[Show if VoteMethod=01,02,03,05]
Overall, were you very satisfied, somewhat satisfied, somewhat dissatisfied or very dissatisfied with the services provided by Elections Canada staff when you voted?
[Do not read]
If ECStaffSat IS 03 OR 04
Is there a specific reason why you were not satisfied with the services provided by Elections Canada staff?
[Open-ended]
Show if VoteMethod IS 01 to 96
Overall, was it very easy, somewhat easy, somewhat difficult or very difficult to vote?
[Do not read]
Show if VoteMethod=01 to 96
Overall, how satisfied were you with your voting experience? Would you say that you were …?
[Read Scale]
[Do not read]
[Ask all]
Thinking about the March 4 federal by-election, would you say that Elections Canada ran the election ...?
Emphasize "Elections Canada"
[Read Scale]
[Do not read]
ByFairness IS 03 or 04
Is there a specific reason why you think Elections Canada ran the election unfairly?
[Do not read]
[Open-ended]
What level of trust do you have in the accuracy of the election results in your riding? Is it …?
[Read Scale]
[Do not read]
ByTrust IS 03 or 04
Is there a specific reason your trust in the accuracy of the election results is low?
[Do not read]
[Open-ended]
[Ask All]
These last few questions will allow us to compare the survey results among different groups of respondents. Your answers will remain anonymous and confidential.
For the purposes of this survey, could you please provide your gender?
[Read list]
What language do you speak most often at home?
[Read List]
Are you First Nations, Métis or Inuk (Inuit)?
[Do not Read List; If Multiple Identities, Ask "Which Do You Primarily Identify As?"]
Indigenous IS 01 (No, not FN, Métis or Inuit (Inuk))
Were you born in Canada?
[Do not read]
CanBorn IS 02 (Not born in Canada)
In what year did you come to live in Canada?
[Do not Read]
Record year: [4-digit number; validate that (CanYear>= YOB and CanYear<=2024) or CanYear=98–99]
What is your ethnic or cultural background?
Indigenous IS 01 (No, not FN, Métis or Inuit (Inuk))
[Do not read. Code Only One Reply.]
[Use 95 for multiple ethnicities that do not fall under one category—e.g., English Chinese would be 95; German Canadian would be 01.]
[If respondent will only say "Canadian," code as 01.]
[If unsure, code response in 96 "Other group"]
What is the highest level of education that you have reached?
[Do not read. Code One Response only.]
What best describes your current employment status?
[If asked to clarify: "Are you, for example, working full-time, or in school, or retired?"]
[Do not read]
How often do you have to limit your daily activities due to a physical condition, a sensory impairment, pain or a mental health issue?
[Read list]
[Do not read]
Do you identify as having a disability?
[Do not read]
Including yourself, how many people usually live in your household?
[Do not read]
[NUMBER; Min. value 1, max. value 20]
What was the total annual income of all members of your household combined, before taxes, in 2023?
[Read List; Stop When Respondents Provide An Answer]
[Do not read]
Yob Is More Than 1900 And Less Than Or Equal To 2003
Finally, we would like to know if you voted in the September 20, 2021, federal general election?
[Read]
[Do not read]
That concludes the survey. This survey was conducted on behalf of Elections Canada. Thank you very much for your thoughtful feedback. It is much appreciated.
If you have any questions about this survey, you can contact Elections Canada through their website at elections.ca or call toll-free at 1-800-463-6868.
If you have any reason to believe that your personal information is not being handled in accordance with the Privacy Act, you have a right to complain to the Privacy Commissioner of Canada.
[If asked for contact information for the Privacy Commissioner:]
Toll-free: 1-800-282-1376
TTY: (819) 994-6591
Web: Go to www.priv.gc.ca, choose your preferred language, then click "Report a concern."
Not Eligible To Complete Survey
Thank you for your cooperation! Based on the information you have provided, unfortunately you are not eligible to complete the remainder of this survey.
Return to footnote 1 The response rate formula is as follows: [Response Rate=R/(U+IS+R)]. This means that the response rate is calculated as the number of responding units [R] divided by the number of unresolved [U] numbers plus in-scope [IS] non-responding households and individuals plus responding units [R].
Return to footnote 2 Statistics Canada. Census Profile. 2021 Census. Statistics Canada Catalogue no. 98-401-X2021001.