Scorecard (Interview Feedback Form)
A structured tool used to evaluate and assess job candidates during the interview process.
(GoodTime 2024)
Intro
Goodtime provides interview scheduling automation and integrates with ATS systems like Greenhouse and Workday to pull candidate information and schedule interviews. These ATS systems also offer feedback forms (scorecards) with interview guides, questions, and focus areas to help interviewers conduct effective evaluations. However, we’ve received a lot of feedback about usability issues with these scorecards and found that interviewers aren’t using them effectively. In response, we’ve decided to address these challenges and improve the overall experience.
I led the design process for this project from start to finish. As the only designer on the project, I created the design roadmap, conducted research, and delivered the final designs to the development team.
Role
Lead Product Designer / Product Strategy, User Research, User Interviews, UX, UI Design
Company
GoodTime
Period
Jun 2024
Problem
Recruiters often aim to gather scorecards efficiently and move the candidate quickly to the next step, speeding up the overall hiring process. They also want interviewers to be well-prepared for assessments of candidates. Many ATS (Applicant Tracking Systems) offer scorecards and interview kits, but oftentimes recruiters and interviewers share feedback of dissatisfaction. At GoodTime, I aim to identify the specific needs of our users and provide a solution through a scorecard that effectively addresses these challenges.
Research
User Interviews
I conducted interviews with over 20 recruiting coordinators and interviewers to identify the challenges and issues faced during the interview process.
Key Findings
Limited Time for Interview Prep and Candidate Review
Many interviewers lack the time to prepare, often skipping interview prep guides and resume reviews.
Interviewers Stick to Their Preferred Note-Taking Methods
Interviewers take notes in their familiar style during the interview and refine them afterward to create a scorecard.
Scorecard Submission Delays Due to Interviewer Overload
Interviewers are often so busy that they delay or forget to submit their scorecards.
The Goal
Quality of Interview
Delivers easy-to-follow interview guidance to enhance overall interview quality.
Easy Access
Delivers easy-to-follow interview guidance to enhance overall interview quality.
Save Time
Enables interviewers to quickly create and easily submit high-quality feedback.
Workflow
For a seamless scorecard experience, I have structured the scorecard form creator, scorecard+notetaker, and evaluation pages. I have also enabled users to import their existing scorecard setups from their ATS through integrations and export the results to their ATS.
Scorecard creator for hiring managers and recruiters.
Note-taker for interviewers.
Evaluation tool that can be reviewed by both recruiters and hiring managers.
Final Design
Solution 1
Scorecard Note Taker for Interviewers
Solution 2
Scorecard Evaluation for Recruiting Coordinators
Solution 1. Scorecard Note Taker for Interviewers
Scorecard Note Taker & AI
Problem
Interviewers often rely on their own note-taking tools instead of using scorecards during interviews, which can result in them missing important questions or crucial information needed for the evaluation.
Automatic execution
Before the interview, users will receive the scorecard access link through calendar invitations, Slack, or email reminders. When users join the video call using our provided link, the scorecard notetaker will automatically open.
Problem
Interviewers must manually refine their notes and transfer them to a scorecard, which not only slows down the submission process but also adds unnecessary complexity.
I designed a scorecard that functions as a note-taker, allowing interviewers to take notes and complete their scorecards simultaneously. This note-taker includes interview questions provided by recruiters to ensure high-quality interviews. Additionally, I incorporated an AI feature to streamline the note refinement process.
AI-Powered Note Refinement
Candidate Information
Problem
When asked about interview challenges, many interviewers mentioned they often don’t have enough time to review candidate information beforehand, leading them to keep the candidate’s resume open during the interview. Some interviewers also struggle to initiate smooth dialog with candidates.
To address this, we’ve added a feature that summarizes the candidate’s information in the top right corner of the scorecard, allowing interviewers to quickly scan it while the interview is in progress.
Work History & Education
Mutual Connections
During interviews, mutual connections can sometimes help facilitate smoother conversations and may also assist with conducting candidate referrals. However, opinions from user interviews varied regarding whether this feature should be displayed. As a result, we’ve made it an optional feature that users can enable or disable through settings.
Interview Kit
Problem
Interviewers often don't have enough time to adequately prepare for the focus areas and requirements for the position.
The guide provides a description of the role and highlights key focus areas for the interviewer. To make this process more efficient, we've implemented an AI-powered summary of the interview guide, allowing interviewers to quickly grasp key focus points.
Interview Guide
The interview plan outlines the steps and interviewers involved, helping interviewers focus on key areas. It ensures a smooth flow from start to finish and allows interviewers to structure their questions based on previous or upcoming interviews. Many interviewers have provided positive feedback on the value of having an interview plan.
Interview Plan
AI Summary & ATS Integration
We found that many interviewers take extra time to finalize the scorecard, requiring them to set aside time for this task, which often leads to delays.
Problem
Overall Comment via AI Summary
GoodTime's homegrown AI compiles interview notes and attributes scores to generate a summary with sections detailed by keywords, helping to streamline the scorecard submission process.
All interview kits, candidate details, and processes are synced and displayed via ATS Integration, allowing interviewers to submit their scorecards directly to their own ATS.
ATS Integration
Solution 2. Scorecard Evaluation for Recruitors
Evaluation Summary
Reviewing and evaluating all the scorecards is time-consuming.
Problem
AI Evaluation Summary
We compile interviewer feedback and run the Goodtime homegrown AI to generate a candidate evaluation summary, outlining their strengths and areas for improvement, highlighting key areas. This has helped recruiters quickly grasp the overall assessment of each candidate.
After the initial design mockup and user testing, we discovered that while summaries were helpful, it was equally important to know which interviewer mentioned specific points, as the credibility of the summary was crucial to users. As a result, I created the quotes functionality tying each keyword and summary to the interviewer, providing clear evidence for each point.
Quotes
Interviewer’s Scorecard
Recruiters face inefficiencies in reviewing scorecards due to the need to open multiple pages, which disrupts process productivity. Moreover, the absence of reminders for interviewers who haven't submitted their scorecards delays timely decision-making, emphasizing the need for a more streamlined solution.
Problem
By accessing each interviewer’s scorecard without opening new pages, recruiters can see detailed feedback, including specific comments, ratings, and insights contributing to the overall evaluation. This feature allows for a more thorough and transparent review process.
Check Interviewers Scorecard
Reminder & Round up
You can send reminders to interviewers who have not yet submitted their scorecards. If a meeting is needed for decision-making, you can use GoodTime's scheduling system to check available times and schedule the meeting directly.
Conclusion
feature on for
12,000
Users
63%
Willing to pay
Users
Want to use
86%
Users
Currently, GoodTime Scorecard has completed the integration with one ATS and is in beta testing, partially available to around 12,000 users. We introduced the product through webinars and demos, and 63% of attendees expressed a willingness to pay for the feature, while 86% showed interest in using it.
We plan to increase pricing by adding a scorecard to our existing packages from 2025, which we expect will increase revenues by more than 13% for the company.