Prepared for the Canada Revenue Agency
Supplier name: Sage Research Corporation
Contract Number: # CW2239380
Contract value: $62,381.65
Award date: August 31, 2022
Delivery date: January 2023
Registration number: POR 032-22
For more information on this report, please email cra-arc.media@cra-arc.gc.ca.
Ce rapport est aussi disponible en français.
Executive Summary
Prepared for the Canada Revenue Agency by Sage Research Corporation
Supplier name: Sage Research Corporation
January 2023
The Canada Revenue Agency (CRA) commissioned Sage Research Corporation to conduct a qualitative public opinion research study on various aspects of the CRA’s secure online portals. Five two-hour online focus groups were conducted between November 3 and 15 2022, with one group in each of the following regions: Atlantic, Quebec, Ontario, Prairies and Pacific. For all focus groups, the qualified participant was a tax intermediary professional working in a small or medium-sized firm who acts as a representative for small or medium business clients or individual clients on tax matters.
Cette publication est aussi disponible en français sous le titre: Recherche qualitative sur les portails sécurisés de l’Agence avec des intermédiaires fiscaux.
This publication may be reproduced for non-commercial purposes only. Prior written permission must be obtained from Canada Revenue Agency. For more information on this report, please contact Canada Revenue Agency at: cra-arc.media@cra-arc.gc.ca or at:
101 Colonel By Drive Ottawa, Ontario, K1A 0K2 Canada
Catalogue Number: Rv4-164/1-2022E-PDF
International Standard Book Number (ISBN): 978-0-660-46405-3
Related Publication (Registration Number: POR 032-22):
Catalogue number Rv4-164/1-2022F-PDF (Final Report, French)
ISBN: 978-0-660-46407-7
© His Majesty the King in Right of Canada, as represented by the Minister of the Canada Revenue Agency, 2022
Given the current environment and as more Canadians make use of online services, the Canada Revenue Agency (CRA) is reaching out to tax intermediaries to explore channel preferences for tax filing and capturing their experiences when accessing and using the CRA’s secure portals (My Account, My Business Account, and Represent a Client). This research project is intended to identify and explore barriers that may impact the ability to effectively use the secure portals and determine which services/assistance could increase the overall client experience.
The objectives of this research were to:
Five two-hour online focus groups were conducted between November 3 and 15, 2022, with one group in each of the following regions: Atlantic, Quebec, Ontario, Prairies and Pacific. For all focus groups, the qualified participant was a tax intermediary professional working in a small or medium-sized firm who acts as a representative for small or medium business clients or individual clients on tax matters. Additionally, all used the CRA’s secure portals at least several times per week, either on average during the year or during tax filing season. There were five to six participants in each group, for a total of 28 participants. Participants were paid an honorarium of $225.
This research was qualitative in nature, not quantitative. As such, the results provide an indication of participants’ views about the topics explored, but cannot be statistically generalized to represent the full population. Qualitative research does, however, produce a richness and depth of response not readily available through other methods of research. It is the insight and direction provided by qualitative research that makes it an appropriate tool for exploring participants’ opinions on the CRA’s secure portals.
Results from the research will be used to support and influence business decisions, to inform the design, development, and enhancements of digital services. The findings will be shared with program areas to identify opportunities where programs, services, and large-scale projects can be adapted to better address user needs digitally.
Reaction to the single sign-in concept depended on whether the participants were considering their usage as a tax intermediary or as a business client user of the CRA’s secure portals. In terms of their usage as a tax intermediary, the majority did not see a benefit to single sign-in, as most of their usage is through Represent a Client. However, most said this would be good for business clients who have both a personal My Account (MyA) and one or more businesses – and therefore one or more My Business Accounts (MyBA). The perceived benefits for business clients included:
Small numbers of participants (one or several participants each) voiced concerns or made suggestions:
Participants were shown mock-ups of the single sign-in log-in page, the Welcome page that provides access to the user’s accounts, and a demonstration of how to switch to a different account after selecting a particular account.
Log-in page: Participants liked the design, and some particularly liked putting log-in options side-by-side, thereby reducing the need to scroll.
Welcome page and account switching: There was widespread positive reaction to the Welcome page and to the process for switching accounts from a particular account page. Positive perceptions included:
Participant suggestions included:
Participants made a variety of suggestions, including:
Overall reaction among virtually all participants to the proposed design and features was positive, and often very positive. This included both the overall look of the page, and the various features. Of particular note:
Contract value:$62,381.65 including HST
I hereby certify as Senior Officer of Sage Research Corporation that the deliverables fully comply with the Government of Canada political neutrality requirements outlined in the Communications Policy of the Government of Canada and Procedures for Planning and Contracting Public Opinion Research. Specifically, the deliverables do not include information on electoral voting intentions, political party preferences, and standings with the electorate or ratings of the performance of a political party or its leaders.
Signed
Rick Robson
Vice-President
Sage Research Corporation
To start the discussion of single sign-in, participants were read a brief description of the concept. Note that this description was revised after the first focus group because in that first group there was a bit of confusion about whether or not an authorized representative (AR) would see client accounts after a “single sign-in.” The revised description put extra emphasis on explaining that an AR continues to use Represent a Client in the usual way to access client accounts.
After the initial presentation and discussion of the concept, participants were shown a mock-up of the single sign-in log-in page, followed by a mock-up of the Welcome page a user might see. The presentation of the Welcome page included demonstration of how to switch accounts. After discussion of the Welcome page, participants were asked if they had any suggestions for what the single sign-in service should be called.
For reference, the revised concept description was:
“The new single sign-In feature will provide access to the CRA’s digital services from a single authenticated secure portal. Right now, there are separate sign-in pages for My Business Account, My Account, and Represent a Client. With the new Single Sign-in, there will be one entry point for all of these online services.
In the case of a tax professional, you would log in to this one entry point to access your Represent a Client, and any other accounts you may have. For example, you can access your My Account and if you have a My Business Account for your own business, you would also have access to that account as well.
This single entry point allows you as a tax professional to access to your Represent a Client account, and also any other personal or business accounts you may have with the CRA. Your access to client information as an authorized representative would continue to be done through the Represent a Client portal, in the usual way.”
Some participants said they would like single sign-in for themselves, while the majority said they saw no benefit for themselves based on how they use the CRA’s secure portals:
While the majority of participants were neutral towards single sign-in for themselves, most said this would be a good thing for business clients, who have both a personal My Account (MyA) and one or more businesses – and therefore one or more My Business Account (MyBA). A few commented that for an individual who has only a personal MyA, there is no benefit – nor any downside – to single sign-in: for these types of individuals, single sign-in does not really change anything.
Notably, the small number who did not react positively to the concept in terms of client reaction also did not react negatively. The issue was more that some of their clients do not like to go online and use the secure portals, but instead rely on the tax intermediary to do this. So essentially, single sign-in would have no impact on these types of clients.
The perceived benefits for business clients included:
Notably, when participants subsequently saw the example Welcome page for a user with multiple accounts, some became even more positive to single sign-in, in terms of benefits to business clients because of positive perceptions of the overall design of the page and the ease of switching accounts.
Several participants thought single sign-in could make it easier for a client to authorize them for multiple accounts. In this regard, some complained about a change the CRA made to the process a client has to go through to authorize a representative. As described by these participants, in the past a tax intermediary could get authorized by a client – e.g. a business client – by getting a signature. Under the current process, the client has to set up a MyBA and complete the authorization online at the MyBA – and the process is even lengthier for a client with multiple businesses and MBAs. This has caused difficulties in the case of clients who do not want to go through setting up an online account(s) with the CRA. These participants thought that if the client has all their accounts accessible in one place, then it will be easier for the client to authorize a representative for more than one account.
Small numbers of participants (one or several participants each) voiced concerns or made suggestions:
Participants liked the design of the single sign-in log-in page, although most did not react strongly given that it is similar in content to the current log-in page design. Some commented that the page has a “clean” design.
Some particularly liked the side-by-side layout of the sign-in partner and user ID/password options. They said that currently the sign-in options on the CRAs secure portal log-in pages are arranged vertically, which can require scrolling depending on the sign-in option being used. These participants said the proposed design is more user-friendly as it eliminates the need for scrolling.
A few participants suggested the lines separating the sign-in options be a little bit darker, to visually distinguish them a little bit more, although this was evidently not an issue for most participants.
After the single sign-in log-in page, participants were shown an example of the Welcome page a user might see. It was explained that this hypothetical user was a tax professional with a Represent a Client account, and My Business Account for several businesses that they owned. To illustrate the functionality of the page, the moderator clicked on one of the business accounts (Jones Family Landscaping). The moderator noted that the design of the My Business Account page was different from what users currently see, but that this was not for discussion. The moderator used this page to demonstrate two ways to switch to another account: (1) the account name drop-down menu on the top right to switch to a different account, and (2) the CRA link on the top left which takes the user back to the Welcome page.
There was widespread positive reaction to the Welcome page and to the process for switching accounts from a particular account page. Positive perceptions included:
Some participants commented that the overall design and ease of use further reinforced the perceived benefit of single sign-in terms of ease of access to accounts. Several said that seeing this could convince some clients who are generally not interested in going online to actually use the CRA’s secure portals because of the perceived ease of use.
Several participants said the design would help them in sessions where they are working with a client on multiple accounts, because of the ease of switching between accounts.
The large majority of participants were satisfied with the “box” design of each account and the labeling of accounts – i.e. it was easy to tell account type because the inclusion of “Business number” or “SIN”. Some commented that the icons also helped them to identify account type, although some others said they had not really paid attention to the icons. There were some suggestions:
Several participants raised questions related to the Add account box. There were two dimensions to this:
One participant, with agreement from a few others, said that while switching accounts from an account landing page is easy “once you know how”, it may not be apparent to a new user how to switch accounts. The suggestion was to add a control to the landing page that says, “Switch account.”
Participants were asked if they had any suggestions for what to call the single sign-in system.
Overall, most participants did not have suggestions, nor were they particularly engaged by the question.
Some said “single sign-in” was a straightforward name and would be good to keep. Other suggestions, mostly each made by one participant, included:
Participants were shown the following description of a concept for a centralized communications hub on secure portal pages:
The CRA plans to implement an online service to become a centralized hub for future communications and interactions with the Agency.
Other CRA services will utilize this service to display their communications and interactions with users.
This centralized hub will include the Mail section, and improvements to the Mail user interface, and it will also include other capabilities for communication and interaction with the CRA.
The moderator then read some brief examples of changes that might be made to Mail in order to help stimulate ideas from participants. The question posed to participants was what suggestions they had for the functionality of this communications hub, whether involving mail or involving other aspects of communication and interaction with the CRA. After the open-ended discussion of suggestions, the moderator probed several ideas: receiving updates from the CRA, receiving notifications of attempted contact by the CRA, and suggestions for file formats that participants would like to be able to upload. Participants were then asked for suggestions on the name of the communications hub.
The next section of the discussion was to show the proposed new design for Mail, including demonstrating some of the new features. Some of the participants’ open-ended suggestions for the communications hub pertained to features demonstrated subsequently. To avoid redundancy, these are discussed in the next section of the report, Mail. For reference, these suggestions pertained to:
Integration of phone calls into the communications hub: Several participants suggested some form of integration of phone calls with the CRA into the communications hub:
Integration of regular mail into the communication hub: Some participants suggested that communication sent by regular mail should also be incorporated into the online communication hub – e.g. by scanning the materials. This would include both material mailed by the CRA, and material mailed to the CRA. This would then provide a more complete online record of written communication with the CRA. This was also of particular interest to these participants in their capacity as tax intermediaries, because they said sometimes they do not see – or see on a timely basis – correspondence the CRA mails to a client. In this case, they can be alerted to something that is urgent and needs to be dealt with. One participant also commented that if a client moves and their address is not updated before the CRA sends a letter, posting it online as well makes sure that the letter is still received on a timely basis.
Notably, a few of these participants said that the communications hub should duplicate mailed letters, and not replace them. They preferred having this duplication just in case of a problem with one or the other channel.
Online text chat: Some participants suggested the hub include online text chat with a CRA agent. There were two rationales:
These participants did not want an AI-powered chatbot, because they felt their questions would be too specific about a particular client situation to be capable of being addressed by an AI system. That said, several said an AI-powered chatbot could be helpful for clients who are looking for general information.
A few participants expressed skepticism as to whether online text chat with an agent would be effective. Their concern was that their experience in calling the CRA with client-related questions is that it is not uncommon that the first agent who answers is not able to answer the question, and the call has to be escalated to another, “higher level” agent. Given this experience, they were skeptical about the quality of information from the agent responding to a request for text chat.
Expand cababilities for sending files to the CRA:
Ability to directly contact an appropriate agent: There are two suggestions of this sort:
Confirmations: Some participants suggested the CRA send a confirmation whenever it has received something from a client. The perceived benefits are (a) it provides reassurance that the CRA has received the material or request, thereby removing any need to phone the CRA to find out if it was received, and (b) it is proof that the CRA received the material, in the event such proof is needed at a later time. Note that this capability is included in the new design for Mail, and the example Mail page shown later to participants included a confirmation email.
Change of address: Several participants suggested that a user be able to do a change of address in the communication hub. A few said that in the past it was possible to do this online, but that is no longer the case, and said that now one has to phone the CRA in order to do a change of address.
FAQs with personalized answers: A few participants – with agreement from other participants – suggested the communication hub have some sort of short list of common questions (e.g. “top three questions”) from individuals or businesses that involve getting personalized information from the CRA, and the answers shown would contain the personalized information of the user. Examples mentioned included:
Access to forms: A few participants suggested the communication hub include access to forms for downloading.
Suggestions mentioned by one or two participants:
Notifications the CRA attempted to reach you: One participant suggested this spontaneously, and said this would be helpful given that people may not answer a call from the CRA due to concern it may be a scam call. The moderator probed interest in this idea, and many participants said this would be helpful because of the prevalence of CRA scam calls.
In this context, several participants suggested – to the agreement of others – that the notification should include an option to request a callback from the CRA. One participant further suggested that this include the ability to request a particular date/time range for the callback.
One participant suggested the notification include a number the person could call that would “skip the queue”, and connect them directly to an appropriate agent.
Updates and reminders: The moderator asked participants if they would like to receive updates and reminders on changes for the upcoming tax filing season or to the website. Note that this was not suggested spontaneously. The majority said this would be of interest, albeit more so pertaining to tax changes than to changes to the website. Some were not interested because they said they already receive information on upcoming tax changes from other sources.
With regard to the nature of updates on tax changes, several participants had suggestions:
Participants were asked if they had any suggestions for what to call communications hub.
Overall, most participants did not have suggestions, nor were they particularly engaged by the question.
Suggestions made by one or a few participants included:
The moderator probed reaction to the name, Communication Centre, and most participants agreed this would be a good name.
A few participants commented that whatever name is used, it should convey the possibility of two-way communication, as opposed to just one-way communication from the CRA. “Communication Centre” does this.
Participants were shown the proposed design for Mail, and asked for their impressions. Following this discussion, the moderator demonstrated the reading pane, mail sorting, message threading, and several features related to sending enquiries or information.
Overall reaction among virtually all participants to the proposed design and features was positive, and often very positive. This included both the overall look of the page, and the various features.
With regard to the overall look of the page, some commented that it is easier to see and know something about each message, compared to what they recall of how mail is displayed currently. There were no suggested changes to the overall graphic design of page.
The proposed Mail page has a variety of features that participants commented on. These are organized under the following headings:
Message labelling
Reading pane
Sending enquirie and information
Filtering and sorting
Message threading
Archiving
Message labelling
Positive perceptions of how messages are labelled included:
With regard to the flag feature, there were a few suggestions:
One participant suggested – with agreement from the other participants in the session – to include an option to enter a note in the message description box. They said this could be a note about the current status of the matter addressed by the email – for example, “waiting for client to submit documents”, “this has been responded to”, “this has been dealt with”, “awaiting CRA reply.” The note could be useful for themselves as the AR, or as a note to their client.
Reading pane
The moderator demonstrated how the reading pane opens up to the right of the list of messages, such that the list of messages is still visible. The moderator also showed that in the Preferences menu it would be possible to change the location of the reading pane – to the left, to the top or to the bottom (note that these options were not functional in the mock-up, so only the existence of the options could be shown).
Virtually all participants liked the way the reading pane displays next to the list of messages. Currently in the secure portals, the reading pane opens in a new window and the list of messages is no longer visible. Many said the advantage of this new way of displaying the reading pane is that it allows easier and faster scanning of different messages, as opposed to going back and forth between a view of the contents of a message and a view of the list of messages. Some commented this is particularly useful if they are not sure which specific email is the one they want, and this allows them to quickly scan different emails. Some also commented that this approach is what they are used to in their regular email program.
Participants were asked which position they would typically assign the reading pane. Almost all said they would use the default setting of the reading pane to the right of the list of messages. A few said they would “play around” with the alternatives, and one said they typically use two screens and so might switch the view depending on how they want to arrange content on the two screens.
Several participants suggested allowing the user to control, through dragging, the size of the reading pane, particularly if they want to allocate more space to the reading pane for ease of reading.
The reading pane includes in the top right corner a control labeled Print/Save, which some commented on positively. One participant suggested – to the agreement of a few other participants – that it would be useful to have a “print to PDF” option, for ease of sending a copy of the email to the client (note that Print/Save was not functional in the mock-up, so its functionality in this regard could not be demonstrated).
Sending enquiries and information
In the open-ended discussion of suggestions for the communications hub, some participants suggested enhanced capabilities to send online enquiries to the CRA. This was phrased as enquiries in general, and also enquiries about the status of something. The perceived benefit was that this would save time relative to calling the CRA and avoiding spending time on hold or talking to multiple agents to get to the right person. For similar reasons, a few participants suggested adding the ability to reply online to a CRA Mail message, to avoid having to phone or to send a reply by regular mail or fax.
In the latter part of the discussion, the moderator demonstrated three features for sending enquiries and information to the CRA:
Overall reaction was very positive to these features among virtually all participants. The core perceived benefit of these features is that they are faster and more efficient that phoning, mailing or faxing.
Reply: This was perceived very positively by participants. Some specific features commented on positively by several participants included the ability to attach documents, the 3,000 character limit allows for a reasonably long message, and the threaded format which shows the reply and the email being replied to.
Several participants suggested having the ability to copy or forward the reply to an email address – e.g. to their own email, or to a client’s email. For example, one participant said they would want this because their email set-up is central to how they manage their work. Several participants, however, did not think this would be a good thing because of security issues. They preferred managing any need to distribute an email by using the Print/Save feature, and for example forwarding a resulting PDF file.
A few participants said Reply is a good idea in principle, but were skeptical that the CRA could actually reply reasonably quickly. They thought that Reply would be heavily used, and that as a result CRA response time might be very slow.
Action icon and banner:The action icon appears on the message label in the list of messages, and the corresponding email has an action banner which includes a control to take the action being suggested.
Participants perceived this functionality very positively. The action icon is perceived to stand out and get attention. It highlights mail that the user should deal with sooner rather than later. It facilitates taking the action being suggested.
Several participants suggested that the user should have the ability to remove the action icon once the item has been dealt with.
With regard to the specific example shown which is indicating “your payment is overdue” and giving a link to make payment: several participants were concerned about a client proceeding to make a payment that is not necessary:
Submit new: There was widespread positive reaction to the Submit new feature as a way to submit enquiries online. The following shows the Submit new form, followed by images showing the drop-down menus:
Participant suggestions included:
As with the Reply feature, a few participants said that while Submit new feature is good, they were concerned that it would be so heavily used that the CRA would have difficulty managing the volume of requests.
Mail filtering and sorting
Some participants commented positively on the filtering and sorting capabilities in the controls above the list of messages. Comments included:
The following are participant suggestions for additional filtering capabilities:
With regard to mail sorting, one of the available sorting dimensions is referred to as Status. Several participants said it is unclear what this means. As one participant put it, “status is good in principle, but it doesn’t tell us anything.” They wanted to know what the status categories are on which the mail would be sorted, and it was suggested the site needs to provide a definition of “status.” One participant named several possible categories: action required, open/pending versus closed/dismissed, read versus unread. This participant also suggested allowing the user to assign a status to an email, such as the ones they mentioned, and then sort on that customized basis.
Message threading
The moderator demonstrated message threading by showing the option to select message threading in the Preferences menu, and then showing an example of a threaded message (a message thread with the newer message at the top, followed by the next older message in the thread).
Participants liked that the option is available, and in the open-ended discussion of the communication hub some had suggested adding this capability – with audit mentioned as an example. That said, participants were split in terms of whether and how they personally would use message threading:
Some participants said it is unclear exactly what the basis is for threading, and that this needs to be clarified. In the mock-up, the statement is that threading groups together mail items “with the same topic.” The issue is that the word “topic” is perceived to be ambiguous. The concern was that “topic” might be so broadly defined – e.g. the “generic” subject lines in the list of messages, such as “TFSA letter” – that mail items with no direct relationship to each other could end up being threaded together. This would be confusing, and make it harder to find emails of interest. Some suggested that threading should be done based on an assigned number – i.e. case number or reference number. One participant – with the agreement of several other participants – said they would like to be able to choose on what basis messages are threaded.
Archiving
Some participants noticed the Archived tab at the top of the list of messages, and commented that this would be useful. It was perceived as a way to “clean” the mail list, removing items that no longer require attention.
One participant commented that they were uncomfortable with this feature in a context where multiple people are accessing the mail, whether that other person be a “junior” in the tax firm, or a client. The concern was someone else may archive something that the tax professional would not have wanted archived. The participant said they would not normally be checking archived messages, and so might end up missing an important message.
One participant suggested that in conjunction with using Search, it would be convenient to be able to archive a group of related messages all at once, rather than archiving each one individually.
Several participants suggested there should be a capability to delete messages – for example, “really old stuff” in the Archived tab. This led to a few participants raising a question as to whether the CRA automatically deletes messages after a period of time. One participant suggested that in a context where messages can be deleted and multiple users access a mail account, a notification first be posted so that other users can choose not to proceed with deletion.
Other participant suggestions
Five two-hour online focus groups were conducted between November 3 and 15, 2022, with one group in each of the following regions: Atlantic, Quebec, Ontario, Prairies and Pacific. The Atlantic, Ontario, Prairies, and Pacific region focus groups were conducted in English, and the Quebec group was conducted in French. There were five to six participants in each focus group, for a total of 28 participants.
The research design included a contingency for conducting up to five online one-hour individual interviews, to be allocated to individuals identified in the normal course of recruiting who are qualified tax intermediaries, but who use adaptive technology to access the secure portals and who as a result may be better served using a one-on-one methodology adapted to their circumstances. No such individuals were identified, and therefore no individual interviews were conducted.
Recruiting for all sessions was done by Synchro Research. The sample source was Synchro’s opt-in database of people who have indicated an interest and willingness to be contacted for possible inclusion in a research study.
The honorarium for all participants was $225.
For all focus groups, the qualified participant was a tax intermediary professional who acts as a representative for multiple clients on tax matters. Requirements included:
The following were additional requirements:
The following is information about the profile of participants:
Number of employees in a participant's firm | Number of participants |
---|---|
1 | 7 |
2 to 4 | 11 |
5 to 19 | 5 |
20-99 | 5 |
Total | 28 |
Hello/Bonjour, I'm ___________ of Synchro Research, a public opinion and marketing research company. First off, let me assure you that we are not trying to sell you anything. We are organizing a focus group research project on behalf of the Government of Canada, and specifically for the Canada Revenue Agency. The focus group is with professionals who provide tax or payroll-related services to businesses and/or individuals. The purpose of the research is to get input on the CRA’s online websites that tax or payroll professionals use on behalf of clients.
May I please speak with an individual in your company who provides tax or payroll-related services directly to either businesses or individuals?
I’d like to ask you some questions to see if you would be interested in possibly taking part in this study. This will take about 5 or 6 minutes.
May I continue?
Yes | 1 |
No | 2 Thank and end the interview |
1a) In what provence or territory is your office located? (do not read list)
Pacific region | B.C | 1 | |
Yukon | 2 | ||
Pacific region | Alberta | 3 | Quotas: At least 2 Alberta, 1 Saskatchewan, 1 Manitoba> |
Saskatchewan | 4 | ||
Manitoba | 5 | ||
Northwest Territories | 6 | ||
Ontario region | Ontario | 7 | |
Nunavut | 8 | ||
Quebec region | Quebec | 9 | |
Atlantic region | New Brunswick | 10 | Quotas: At least 1 from 3 out of the 4 Atlantic provinces> |
Nova Scotia | 11 | ||
P.E.I. | 12 | ||
Newfoundland & Labrador | 13 |
1b) [Determination of preferred language and whether or not belongs to an OLMC (Official Language Minority Community]
[If in Quebec:]Préférez-vous continuer en français ou en anglais? Would you prefer that I continue in English or French? [Si préfère continuer en anglais, passez à l’écran anglais et continuez ou dites ce qui suit puis raccrochez et planifiez le rappel en anglais] We will call you back to continue this interview in English. Thank you. Goodbye. [If prefers to continue in English, qualifies as English OLMC]
[If outside Quebec:]Préférez-vous continuer en français ou en anglais? Would you prefer that I continue in English or French? [If prefers French, either switch to the French screener and continue, or say the following and then hang up and arrange French-language call-back] Nous vous rappellerons pour mener cette entrevue de recherche en français. Merci. Au revoir. [If prefers to continue in French, qualifies as French OLMC]
In this project, an individual like yourself would join several others in a two-hour online video session and give ideas and opinions. People who are invited and take part in the group discussion will receive a cash payment honorarium as thanks for their time.
As I mentioned earlier, the purpose of the research is to get input on the CRA’s online websites that tax professionals use on behalf of clients. These websites include Represent a Client, My Business Account, and My Account. In the discussion session, you would be asked your opinions about these CRA websites and ways in which they might be improved.
Your participation is voluntary and confidential. All information collected, used and/or disclosed will be used for research purposes only and administered per the requirements of the Privacy Act. Neither the names of participants nor the companies they work for will be provided to the government. Your decision to take part will not affect any dealings you may have with the Government of Canada and the Canada Revenue Agency.
May I continue?
Yes | 1 |
No | 2 Thank and end the interview |
I need to ask you some questions to see if you fit the profile of the type of people we are looking for in this research.
Note to recruiter: When terminating a call because of their profile say: Thank you for your cooperation. We already have enough participants who have a similar profile to yours, so we are unable to invite you to participate at this time. |
2) What is your position in the company?
____________________________________________________________
If an administrative assistant/secretary, ask to speak with someone who provides tax advice or tax preparation services directly to individual or business tax filers
3a) For purposes of accessing client information on CRA websites, are you an authorized representative of any small business clients?
Yes | 1 |
No | 2 |
3b) For purposes of accessing client information on CRA websites, are you an authorized representative of any individual taxpayer clients?
Yes | 1 |
No | 2 |
If "no" both Q.3a & Q.3b, thank and end interview
Monitor quotas: In each group, at least 3 who represent business clients, and at least 3 who represent individual clients. If a person represents both types, they count towards both quotas.
4) [If "yes" to Q.3a, ask:] Thinking of the business clients for whom you are an authorized representative, do you have any business clients with … (read list)
Yes | No | |
---|---|---|
Less than 100 employees | 1 | 2 |
100 or more employees | 1 | 2 |
If "no" to both "Less than 100 employees" and Q.3b, thank and end interview
5) Thinking of your own business, about how many employees does your business have including yourself and any full-time or permanent part-time employees? (Do not read)
1 (sole practitioner) | 1 | |
2-4 employees | 2 | |
5-19 employees | 3 | |
20-49 employees | 4 | |
50-99 employees | 5 | |
100 or more employees | 9 | Thank and end interview |
6) [If "yes" to Q.3a, ask:]Thinking of the business clients for whom you are an authorized representative, which of the following services do you provide to these clients? (read list)
Yes | No | |
---|---|---|
Payroll-related services | 1 | 2 |
Tax-related services | 1 | 2 |
Bookkeeping services | 1 | 2 |
7) As you know, an authorized representative uses the CRA website called Represent a Client to get access to a client’s information on either My Business Account for business clients, or My Account for individual clients.
a) On average, about how often do you use any of these CRA websites? Would you say … (read list)
A few times a month or less often | 1 | |
Once a week | 2 | |
Two to three times a week | 3 | If 3 or 4, go to Q.8 |
Four or more time a week | 4 |
[If Code 1 or 2 at Q.7a, AND "no" to Q.3b, thank and end interview]
b) [If Code 1 or 2 at Q.7a, AND "yes" to Q.3b, ask:] On average, about how often do you use any of these CRA websites on behalf of individual clients during tax-filing season? Would you say … (read list)
A few times a month or less often | 1 |
Once a week | 2 |
Two to three times a week | 3 |
Four or more time a week | 4 |
[If Code 1 or 2 at Q.7b, thank and end interview]
8) You mentioned that your office is in [province or territory from Q.1a]. In what city or town is your office located?
__________________________________________
Monitor quotas:
9a) Sometimes people with a disability use adaptive technology or devices to browse websites. When you use the CRA websites in your capacity as an authorized representative, do you need to use any adaptive technology or devices to use these websites?
Yes | 1 | Qualifies for individual interview; Ask Q.9b |
No | 1 | Go to Q.10 |
Prefer not to say |
9b) What type of adaptive technology or device do you use to access the CRA websites?
__________________________________________
Thank you. I’d like to find out if you would be interested in participating in an online individual interview on your opinions about using the CRA websites.
10) The discussion session for this project will be conducted online using a webcam, and it will require the use of a laptop, desktop computer or computer tablet connected to high speed internet. Note that you cannot use a smartphone to participate in the online session.
a) Do you have access to high speed internet that you can use for the online discussion session?
Yes | 1 |
No | 2 |
b) Do you have access to a laptop, desktop computer or computer tablet to take part in the online discussion session?
Yes, laptop or desktop | 1 | Go to Q.10d |
Yes, computer tablet | 2 | Ask Q.10c |
No | 3 | Thank and end interview |
c) What is the screen size of the computer tablet you will be using to take part in the online discussion session?
Up to 4 inches/small | 1 | Thank and end interview |
5 to 9 inches/medium | 2 | |
At least 10 inches or more/large | 3 |
d) You will need to be in a place that is quiet and free of distractions for the duration of the online session. Would you able to participate in this type of location?
Yes | 1 | |
No | 2 | Thank and end interview |
If “yes” to Q.10a and “yes to Q.10d, schedule for online group discussion
If “no” to Q.10a and “yes to Q.10d, schedule as an individual online interview
Instructions for Q.10a-d “Thank and end interview”: Based on your answers, we are unable to invite you to take part in an online discussion session, as you do not meet the technical requirements. Thank you for your interest in this research.
11a) Have you ever participated in an in-depth research interview or a focus group involving a small group of people where people were asked to discuss different topics?
Yes | 1 | |
No | 2 | Go to Q.12 |
11b) And when was the last time you attended an interview or discussion group?
6 months ago or less | 1 | Thank and end interview |
OR more than 6 months ago | 2 |
11c) In the past 5 years, how many in-depth research interviews or discussion groups have you attended? Would you say less than 5 in total, or would you say 5 or more?
Less than 5 | 1 | |
5 or more | 2 | Thank and end interview |
12) Thank you. Let me tell you some more about this study to see if you would like to take part.
a) There may be some people from the Canada Revenue Agency who have been involved in this project observing the session. However, they will not take part in the discussion in any way, and they will not be given your name nor the name of your firm. Is this acceptable to you?
Yes | 1 | |
No | 2 | Thank and end interview |
b) The session will be audio and video recorded. These recordings are used to help with analyzing the findings and writing the report. Neither your name nor the name of the company you work for will appear in the research report, and the recording will not be given to the Canada Revenue Agency. Is this acceptable to you?
Yes | 1 | |
No | 2 | Thank and end interview |
Thank you. We would like to invite you to participate in one of our online individual interviews. The session will last one hour, and after you have completed the session you will be paid $150.
Would you be willing to participate in one of these sessions?
Yes | 1 | |
No | 2 | Thank and end interview |
Arrange for a daytime session sometime [TBD]-[TBD]. Do not schedule within one hour of any group session.
We will send instructions for logging in to the online session at least two days in advance. What email address should we use?
__________________________________________
As I mentioned, you will be paid $150 after you have finished participating. We can send this to you by Interac e-transfer or by cheque, whichever you prefer. Would you prefer to receive payment by Interac e-transfer or by cheque?
Interac e-transfer | 1 |
Cheque | 2 |
GO TO Payment Details
If in Quebec and qualifies as English OLMC at Q.1b, offer session in Ontario or Atlantic
If outside Quebec and qualifies as French OLMC at Q.1b, offer session in Quebec
The session will be held on [insert date], at [insert participant’s local time]. Would you be available to attend?
Yes | 1 | |
No | 2 | Thank and end interview |
Thank you. We would like to invite you to participate in one of our online group discussions. The session will last two hours , and after you have completed the session you will be paid $225 to thank you for your participation.
For the group discussion we will be using an online software company called itracks (pronounced eye-tracks). Prior to the group discussion, we will send you a link to the company’s website for a diagnostic check, to make sure that you do not have any problems logging on to the platform for the group discussion itself. Please make sure you do this check before the group. Please let us know if you run in to any problems.
The person leading the discussion will be Rick Robson/Sylvain Laroche of Sage Research, which is a public opinion research company.
Would you be willing to attend?
Yes | 1 | |
No | 2 | Thank and end interview |
City/Date: | Date: | Time: |
---|---|---|
Ontario region | TBD | Ontario time: |
Pacific region | TBD | Pacific time: |
Prairies region | TBD | Prairies time: |
Atlantic region | TBD | Atlantic time: |
Quebec region | TBD | Quebec time: |
As I mentioned, you will be paid $225 after you have finished participating. We can send this to you by Interac e-transfer or by cheque, whichever you prefer. Would you prefer to receive payment by Interac e-transfer or by cheque?
Interac e-transfer | 1 |
Cheque | 2 |
Refer to preferred payment method
If prefer Interact e-transfer
What email address would you like the Interac e-transfer sent after you have finished participating in the session?
__________________________________________
And please confirm the spelling of your name: __________________________________________
If prefer cheque
What mailing address should we use to send you the cheque after you have finished participating in the session?
Street:________________________________________________________
City:________________________________________________________
Province:________________________________________________________
Postal code:________________________________________________________
And please confirm the spelling of your name as it should appear on the cheque ________________________________________________________
In the event you are unable to attend, let us know as soon as possible so we can find a replacement. Please call us at [Insert recruiting company phone #] and ask for [Insert recruiting company contact name]. Also note that you may not send someone else in your place if you are unable to attend.
Please also arrive 5 minutes prior to the starting time. The interview will begin promptly at [TIME].
As these are small sessions and with even one person missing, the overall success of the group may be affected, I would ask that you make every effort to attend the group. But, in the event you are unable to attend, let us know as soon as possible so we can find a replacement. Please call us at [Insert recruiting company phone #] and ask for [Insert recruiting company contact name]. Also note that you may not send someone else in your place if you are unable to attend.
Please also arrive 10 minutes prior to the starting time. The discussion will begin promptly at [TIME]. People who arrive too late to participate in the focus group will not receive the honorarium.
Someone from our office will be calling you back to confirm these arrangements. May I please have your contact information where we can reach you during the evening and during the day?
Name:__________________________________________
Evening phone:__________________________________________
Day time phone:__________________________________________
Email address:__________________________________________
Thank you very much!
Recruited by:__________________________________________
Confirmed by:__________________________________________
Note to recruiter: Should a participant require validation that this is a legitimate research project, please refer them to: [CRA contact information]
They can also go to the CRA website below which lists the public opinion research projects the CRA is doing. The name of the project is: Qualitative research on CRA’s secure portals with tax intermediaries. If they are interested, email them the title and the relevant link:
English site: http://canada.ca/por-cra
French site: http://canada.ca/arc-por
a) Introduce self: (Rick Robson of Sage Research, an independent market research company). This is a research project we’re doing on behalf of the Government of Canada, and specifically for the Canada Revenue Agency (CRA).
The CRA has three secure online portals that let people view and manage their tax information. These three secure portals are My Business Account, My Account, and Represent a Client. You will hear me also referring to these as being “websites”, but in CRA terminology, they are called “secure portals.” In our discussion, you can refer to them as websites or as secure portals, whichever you prefer.
One thing that all of you have in common is that you are tax professionals who work with clients to help them with their tax affairs, including acting as an authorized representative for some clients. So all of you have experience using the CRA’s Represent a Client website, and using that to access client tax information on either My Business Account or My Account. And of course you may also use My Business Account for your own business, or My Account for your personal taxes.
The CRA is planning to make some changes to these websites. I’m going to show you some ideas they have for changes to the websites and ask you what you think of the proposed changes, and for any suggestions you might have. So, for most of the discussion, I’ll be showing you web pages and asking for your opinions. I suggest you have some paper and pencil handy so you can jot down notes to yourself about what you think of each of the web pages. That can help you organize your thoughts for what to say in the discussion.
The results of the research will be used by the CRA to improve the new website designs in order to make them easier to use and more useful for people such as yourselves who often use these websites.
b) Review group discussion procedures:
c) Any questions?
d) Participant self-introductions: First name only, and the sorts of clients you work with as a tax professional and authorized representative: mainly business client, individual clients or both; if business, any particular focus in terms of size or type of business
a) Describe Single Sign-In concept: The new Single Sign-In feature will provide access to the CRA’s digital services from a single authenticated secure portal. Right now, there are separate sign-in pages for My Business Account, My Account, and Represent a Client. With the new Single Sign-in, there will be one entry point for all of these online services.
In the case of a tax professional, you would log in to this one entry point to access your Represent a Client account, and any other accounts you may have. For example, you can access your My Account andif you have a My Business Account for your own business, you would also have access to that account as well.
This single entry point allows you as a tax professional to access to your Represent a Client account, and also any other personal or business accounts you may have with the CRA. Your access to client information as an authorized representative would continue to be done through the Represent a Client portal, in the usual way.
b) Reaction to concept: I’ll show you what Single Sign-In might look like, but first, what are your reactions to this change to Single Sign-In, compared to how you sign in currently?
c) Show and discuss log-in page:
Introduction: I’m going to show what the Single Sign-In web pages would look like. These are not real web pages. These are mock-ups to show what they might look like. And based on your reactions, the CRA may well make changes to the pages.
Show the page: This is what the Single Sign-In log-in page might look like. (Display page using screen share)
What are your reactions to this as the Single Sign-In log-in page?
d) Show Welcome page
First describe context: I’ll now show you an example of what a user might see once they log in. This particular user is a tax professional like you. I would like you to imagine you are this hypothetical person, and I’ll give you a little bit more about the person you’re pretending to be. You also have a personal My Account. You also have several businesses that you own, such as an accounting firm, and each of these businesses has a My Business Account.
As I show you what the user would see please make some notes to yourself about things you like, things you don’t like or find unclear, and any suggestions you might have.
(Show Welcome page using screen share) This page shows the different accounts that you as this tax professional has. Each of the accounts is clickable.
1) One way is to switch to another specific account using the drop-down menu on the top right for Jones Family Landscaping. You can switch not only to your other business accounts, but also to your personal My Account and to your Represent a Client account. (Demonstrate drop-down but do not click on an account)
2) The other way to switch accounts is to go back to the page listing all the user’s accounts. You do that by clicking on Canada Revenue Agency in the top left corner. (Click on Canada Revenue Agency, and return to Welcome page)
Again, take a minute or two to make some notes to yourself about things you like, things you don’t like or find unclear, and any suggestions you might have, then we’ll talk about it as a group.
e) Continue to show Welcome page
Having now seen how the new Single Sign-in might work, what are your reactions, both to the Single Sign-in initiative as a whole, and to the pages I’ve shown you?
f) Branding: I have a question about naming related to Single Sign-in. Right now, when you access CRA tax information online, you deal with three separate “doorways”, as I’ll call them: My Business Account, My Account, and Represent a Client. With Single Sign-in, that’s all changing, and now there is just one doorway to access all your CRA accounts. Do have any suggestions for what this new, one doorway, system should be called?
The next thing I’d like to talk about is an important change the CRA is considering make to its secure portals,. At this point, this idea is a concept, and I do not have a prototype design that I can show you.
Let me tell you what the concept is.
The CRA plans to implement an online service to become a centralized hub for future communications and interactions with the Agency. Other CRA services will utilize this service to display their communications and interactions with users. This centralized hub will include the Mail section, and improvements to the Mail user interface, and it will also include other capabilities for communication and interaction with the CRA.
This centralized hub will include features like mail sorting, filtering, searching, previewing, threading, flagging, archiving, replying to audit enquiries, and confirmations, some of which I will show you shortly.
But that’s not all. And that’s where you come in. I’d like to hear your suggestions for features the CRA should include in this new centralized hub. When you think about using the CRA’s secure portals, and the types of online communication capabilities and interaction you would ideally like to have with the CRA, what are your suggestions for how online communication and interaction could be improved? These might be suggestions about the Mail user interface to make it more useful to you, or suggestions for other types of enhancements to online communication capabilities and interactions.
Probes: Functionality and ease of use of the Mail section of the secure portals
Receive updates and reminders on changes for the upcoming tax filing seasons or to the website
Notification(s) that the Agency attempted to reach you; the context – because of scam calls claiming to be from the CRA, sometimes people the CRA is trying to contact don’t respond
Any file format types you prefer to utilize on a daily basis that the agency does not allow you to upload currently
Another question I have for you is what this new centralized hub should be called. As I said earlier, the CRA plans to implement an online service to become a centralized hub for future communications and interactions with the Agency. Other CRA services will utilize this service to display their communications and interactions with users. This centralized hub will include the Mail section, and improvements to the Mail user interface, and it will also include other capabilities for communication and interaction with the CRA.
And we have been talking about your ideas for other capabilities for communication and interaction this new centralized hub might have.
Thinking about what this new centralized hub in the secure portals and what functionality it might have, what do you think this centralized hub should be called? That is, how should it be labeled on the landing pages of the secure portals, so that it describes what users will be able to do in this section?
Rationale
Likes/dislikes/concerns
Do votes on preference, as appropriate
One possible name the CRA came up with is Communications Centre. What do you think of this as a name for the centralized hub for communications and interactions with the CRA?
Likes/dislikes/concerns
Do votes on preference, as appropriate
The CRA has some ideas for changes to the Mail page. These changes would be part of creating the online centralized hub for communication and interaction with the CRA. For this purpose, I’m going to show you an example of the proposed new Mail section in the context of a My Business Account page. The reason for using a My Business Account page is that it shows the most new features. Where applicable, you would see the same sorts of new features on Represent a Client and My Account. But for our discussion, I’ll use the My Business Account page as an example.
The pages I’ll show you are just mock-ups, they’re not real web pages, and not all of the links work. Also, links to other parts of the website don’t work. But enough of the links work so that I can give you a good idea of what a user might see and be able to do.
Again, please make notes to yourself on your reactions, on things you like or don’t like, or suggestions you have.
First, let me get you to the proposed new Mail section for a My Business Account. You’ll see that there are examples of several types of mail messages (Use screen share)
In a few minutes, I’ll start demonstrating various features of the new Mail page, so I’ll be clicking on various things. But before I start clicking on things, what is your overall reaction to what you see here? Do you see anything new you particularly like? Anything you don’t like or find confusing?
I’m going to show you some of the new features the CRA is thinking of for the Mail section.
a) Ability to view letters and content on the same screen, and Ability to customize/configure mail preferences
(Note: If participants ask about the Archive tab, say: Archive is a feature that allows the user to archive older messages, so that their main mailbox can be less cluttered. However, this feature is not one that I planned to talk about today, but if you have any comments on this feature, let me know.)
I’ll start by showing you how a message is displayed when you click on it in the list of messages. (Click on TFSA letter)
In the version of Mail you’ve been using, the message opens in a new window and the list of messages is no longer visible. In this new version of Mail the message opens in a pane next to the list of messages, so you continue to see the list of messages.
In this new version of Mail you can also set your general preferences for where the reading pane is located.
(Click Preferences; do not click any options; note the options and explain can’t show how they look because don’t work on the mock-up; note that we’ll talk about Message threading later; X-out to close Preferences)
b) Sorting
The Mail page offers several options for sorting the messages, in addition to sorting by date. (Click Date to show drop-down; leave on screen while discussing).
What do you think of these sorting options? Anything unclear? Any suggestions for other sorting criteria?
Another sorting option is Threading. (Click Preferences and refer to Message Grouping/Threading; to demonstrate a threaded message, click on Threading in the hamburger menu.) As you can see, with threading turned on, messages on the same topic appear together, with the newest message on top.
What do you think of this message threading option?
Which would be your general or default preference: threading or no threading?
Would you switch this setting in some circumstances? If so, what sorts of circumstances?
c) Send enquiries or information to the CRA
The new Mail page has several features that let the user send enquiries or information to the CRA.
(Demonstrate, then discuss)
Reply: On audit-related messages, there is a Reply button in the email that lets you send enquiry, and optionally an attachment. This feature would also appear on messages from other CRA programs that have the ability to handle replies.
Demonstrate:
Action icon/Action banner: On the mock-up, you see a few emails that are flagged with the notice, “Actions may be required”, which is a new feature. And, when you click on one of these messages, the message has a link that takes you to the appropriate place on the CRA website to do the requested action.
Demonstrate:
Send account-specific enquiries: Near the top-right of the page, there is the link called Submit new
Demonstrate:
I’ve shown you several features that let you send enquiries or information to the CRA: “Reply” in the case of audit-related emails, a flag for items where action may be required and an associated link to go to the relevant part of the CRA website; and the “Submit new” feature that lets you send account-specific enquiries.
What is your overall reaction to these various new options for sending enquiries or information? (As appropriate, follow-up probes for each of the three features)
Likes/dislikes/concerns
Ease of navigation/Ease of use
Suggestions for changing how these features are shown/how they work
Other suggestions for sending or receiving enquiries or information
a) Filtering
Explanation/demonstration: Near the top of the Mail page you can see several ways to filter what mail messages are displayed:
Demonstrate:
What do you think of this new design in terms of what and how you can filter messages to display, compared to what you’re used to on CRA websites?
b) Search
This new Mail page has a search function, and that’s another way of filtering which messages are displayed.
Demonstrate:
What do you think of the addition of this search feature? Is it something you would use? If yes – in what circumstances/why; if no – why not
Do you have any other suggestions for improving CRA enquiries services and support services?
Probe: Receive updates on what’s new, e.g. on the CRA website, or legislation changes
We’re just about finished. Is there anything else related to what we’ve discussed that you want to mention before we wrap up?
The final report for this project will be available to the public and will be posted on the Library and Archives Canada website.
Thank you for coming this evening and giving us your opinions.