City of Boston's Certification Application and Service Redesign
My Role:
UX Researcher, UX Designer, & Service Designer
Team:
1 Project Manager, 1 UX/UI Lead, 2 UX researchers, 2 UX/UI designers
Timeframe:
6 Weeks
Tools:
FIGMA, Google Suite, Trello, UXPressia
WHO: DEPARTMENT OF SUPPLIER DIVERSITY
The Dept of Supplier Diversity is a city-led initiative committed to ensuring equal opportunities for businesses owned by individuals from underrepresented groups. Their aim is to foster an inclusive environment where diversity thrives in city contracts.
WHAT: DIVERSITY BUSINESS ENTERPRISE CERTIFICATION
Their key project is the Diversity Business Enterprise (DBE) Certification. This certification recognizes businesses owned by individuals from underrepresented groups, validating their status and increasing their opportunities for city contracts.
Background
Problem
Only 35.7% of users submit error-free certification applications, with a 26.4% accuracy rate.
Certification application before redesign
Solution
Mobile-responsive redesign
Created an expert-guided support service blueprint for precise submissions
Certification post redesign.
Role and Responsibilities
Facilitated mapping exercises, refined journey map, analyzed application data.
Generative Research
Understanding diverse needs in certification, highlighting areas for redesign and service evolution
I chose to triangulate with three methods because no single approach alone provides comprehensive insights. I began with usability testing to pinpoint design issues and understand the reasons behind them. Quantitative analytics quantified frequency, while qualitative interviews delved into user motivations and journey context.
Application Analytics
Problem: Only 9% submit an application, and just 5% get accepted.
To understand the magnitude of the problem, I conducted a detailed analysis of application analytics. Over a one-month period, I examined 21 applications.
I identified that users struggled particularly with financial jargon heavy questions, such as gross receipts.
This analysis allowed me to pinpoint where users faced challenges and what steps in the process needed improvement.
Usability Testing
Problem: 60% of users find the application confusing and unhelpful.
I tested the existing application with 5 BIPOC business owners remotely via Zoom. My goal was to evaluate the current design and understand the "why" behind the drop-off rate.
During the tests, users expressed confusion over specific instructions. They struggled with understanding terms like "gross receipts" and what documents were needed. Instructions were not user-friendly and not findable during the application. This confusion contributed significantly to the high drop-off rate.
By evaluating the existing design, I could see that users were frustrated and confused by the lack of clear guidance. These insights highlight the critical issues in the current application process, underscoring the need to address these pain points.
User Interviews
67% of Users Confused by Eligibility Criteria
I conducted interviews with 6 BIPOC business owners remotely via Zoom. I aimed to understand how and where users finished their applications. I wanted to see if they got stuck, and if so, how they got unstuck.
I found users began confused and initially didn't jump right in because they felt overwhelmed. Users found it difficult to determine eligibility with the existing design.
Personas
2 Distinct Personas Emerged from the Research.
I found two personas during research: the Principle Pathfinder (someone who owns the business) and the Strategic Liaison (someone who helps the owner apply). These interviews helped my team understand user needs, such as what kind of device they use.
The personas illustrated that these users were high school graduates with limited college and business knowledge, and they needed help getting started.
Sample Persona
Journey Mapping
All Users Initially Rejected; 83% Sought Help from Office Hours
I wanted to understand the full user journey for certification. My goal was to see where we could cut out steps or promote resources.
Journey maps aligned the team and revealed that promoting programs like office hours is key to helping more users get certified.
Potential solutions must address the following factors to avoid user drop-off:
Users are unsure about their eligibility and need a clear method to verify.
Users abandoned the application due to overwhelming business jargon.
Promote service programs to get user to improve application conversions
Help users understand the bidding process.
Sample Journey Map
Mapping Workshop via UXPressia Aligned Team on Problems and Solutions
I facilitated a mapping exercise with UX designers and other stakeholders related to our certification application.
My goal was to get everyone aligned with the journey map. I feared that doing the mapping alone would not engage others, and the map would just become "wallpaper."
Fishbone Mapping
Team Alignment Through Fishbone Diagram
I facilitated a fishbone mapping workshop to unify the team and align stakeholders. This functioned as a northstar, guiding us throughout the design process.
The fishbone diagram helped identify key problems and their causes. It ensured everyone was on the same page.
This workshop fostered collaboration and clarity. The diagram was essential for team alignment.
Product & Service Design
Designing products and services to clarify jargon and foster business inclusivity
It was evident that a multifaceted approach would deliver the most comprehensive user experience improvements, and this led us to devise a three-tier solution:
Desktop Redesign: Most users connect with us on desktop. So, we've refreshed its look and improved how it works, using your feedback.
Mobile Responsive Design: Most users connect with us on tablet. So, we've refreshed its look and improved how it works, using your feedback.
Service Blueprint Development: We saw a chance to make our office hours help more people. So, we've created a plan to increase its reach and offer more direct support.
Project Prioritization
My team engaged in a collaborative effort to design an MVP (Minimum Viable Product), and prioritized the following features:
Application Submission: Easily submit applications on both desktop and mobile.
Eligibility Quiz: Introduced as an engagement tool, this feature facilitates users in initiating their application process, accessible via desktop and mobile.
Service Design Blueprint: Connect users with financial experts to get your documents right the first time.
Desktop Redesign
With our work, we created an interactive prototype.
We believed leveraging the aesthetic-usability effect would boost appeal. A more inviting design might promote task completion through perceived ease.
The current application primarily uses a grayscale design, offering limited user feedback. A navigation bar was added to orient the user.
Mobile Design
Data shows 70% of users wanted a mobile-friendly option. Desktops weren't always feasible for them.
Tool Tips
We introduced contextual help to address data-confirmed jargon issues. We embedded department resources, to help users breakdown the application process.
Eligibility Questionare
According to our data, 70% of users were uncertain about which certification to choose initially.
Using this insight, we introduced an eligibility quiz, ensuring users select the correct certification.
This approach aims to enhance user reduce the drop rate and increase conversions of applications submissions.
Service Blueprint
Data-driven insights revealed that financial queries hindered user progress. Users consistently struggled with the application's complex financial jargon.
Simply redesigning the form wasn't the solution. Based on this data, connecting users with financial experts emerged as our solution.
This a service blueprint outlining the department’s new program connecting users with local BIPOC accountants.
Moreover, it introduces community-led assistance for application preparation. This approach aims to minimize errors and reduce drop-offs, ensuring a smoother certification process for everyone.
Evaluative Research
Improving app intuitiveness, while decreasing user error
Budget constraints steered our usability testing approach. While benchmarking via an ease-of-use or System Usability Score would've been ideal, we had to opt for a more economical software solution. Our mission was clear: optimize insights with available resources.
Methodology
Two groups:
Mobile Group: A group of 9 users engaged with a high-fidelity mobile prototype
Desktop Group: A group of 10 users engaged with a high-fidelity desktop prototype
Unmoderated: I utilized the Maze platform, I was able to monitor user progress in an unmoderated setting.
Quantitative Metrics: task success rate, time, misclick, and bounce rate.
Usability Test Prompts
Eligibility Screening: You are a Hispanic male who owns an LLC in Boston with another Asian owner that earns an estimated annual revenue of $150,000. You would like to find out what certification you qualify for before you apply.
Complete Main Application: Now that you know what you qualify for, finish the application for the certifications you qualified for. Assume you have all of your documents prepared and ready to upload.
Review Application for Errors: Review your application for errors and then submit.
Congratulation page: When can you expect to hear back from the City of Boston regarding your certification application?
Check Pending Application in Account: Check the status of the application you just submitted (This task was tested on desktop ONLY).
Desktop Test Results
Our desktop usability testing revealed critical insights, specifically highlighting user difficulties in locating the quiz to determine their certification eligibility.
Mobile Test Results
The mobile usability test revealed that users were having issues mis-clicking buttons, such as accidentally pressing “save and exit” rather than “next”.
Conclusion
Our journey with the department culminated in the creation of an effective prototype, ready to be handed off to the Department of Innovation and Technology, and a service blueprint.
While our original task was to redesign the form, we found that the solution was more than a mere product—it was a service. Our client was thrilled with this holistic approach, extending an invitation for future collaborations.
This project underscored a crucial learning experience: sometimes, exceptional products demand equally, if not more, superior services to truly make an impact.
Next steps
While our redesigned application is under development, our attention turns to boosting user engagement. A key strategy is refining the city's reminder emails, using UX writing and content strategy. Our goal: motivate users to attend office hours and complete their certification application.
Other Best Work
Aligning Business Goals with Information Architecture
Content Design, UX Research, E-commerce, UX Writing, Content Strategy, Information Architecture
UX Design for Community Engagement
UX/UI, UX Research, Mobile Application Design