Case Study · Paylocity

Payroll

Company Paylocity
Product Run Payroll (Payroll Refresh, Phase II)
My Role UX Researcher
Methods Moderated Usability Testing · SUS · Prototype Evaluation
Participants 10 payroll administrators
💰
Paylocity Run Payroll screen screenshot

Overview

Payroll is the core of Paylocity's product: the workflow HR administrators rely on every pay period to review timecards, process pay, resolve errors, and submit payroll on time. As part of a broader "Payroll Refresh," the team was redesigning this experience to close usability gaps and modernize a workflow that hadn't kept pace with the rest of the product.

I led the Phase II usability study, evaluating a redesigned prototype of the full run-payroll experience, from starting payroll through to submission, with a mix of current customers and non-customers.

The Problem

Running payroll is high-stakes and time-sensitive: errors are costly, and admins need to feel confident every step of the way. Internally, Sales had also flagged payroll as a weak point in demos. In 2023, only 28% of Sales Consultants considered payroll "competitive," improving to 65% by March 2024, but with clear room left to improve.

The team needed to know whether the redesigned prototype actually closed the gaps admins experienced in the current product, particularly around navigation, comparing payrolls, and the dated UI, without requiring changes outside existing system and technical constraints.

Research Goals

Research Approach

I ran 60-minute moderated usability sessions with 10 payroll administrators (5 current Paylocity customers and 5 non-customers) across healthcare, automotive, manufacturing, and higher education. Each participant worked through a series of realistic tasks in an interactive prototype covering the full run-payroll journey: checking outstanding approvals, reviewing timecards, creating a batch, adjusting pay, resolving errors, comparing payrolls, and submitting for approval. Sessions ended with a System Usability Scale (SUS) survey and an open discussion of their experience, challenges, and expectations.

Key Findings

75.5

SUS score, above the industry standard (68), with room to reach the design-iteration goal of 85.

40%

complete success rate on "import timesheets," one of the lowest-scoring tasks in the study.

50%

complete success rate on "resolve errors." Language and feedback issues left admins unsure if fixes had worked.

40%

complete success rate on "fix variance." Small text made differences between payrolls easy to miss.

The study surfaced issues across nearly every stage of the workflow:

Recommendations & Impact

Recommendations were scoped to be testable within existing technical constraints, and organized so Product could prioritize by effort and impact:

These findings and recommendations were shared with Product for prioritization in the following quarter, with the highest-impact changes, particularly around approvals placement and error resolution language, queued for validation in the next round of usability testing.

Reflections

What stood out most in this study was how often the "right" answer depended on context the design alone couldn't communicate, like the fact that admins in variable-payroll industries don't find payroll comparisons useful, while others do. It reinforced that "redesign the UI" isn't enough; you have to design for the variety of mental models and workflows admins bring with them, especially in a product as deeply embedded in someone's routine as payroll.

I also came away with a sharper appreciation for how much small language choices matter in high-stakes flows. A single word like "Dismiss" was enough to make several admins hesitate before completing a task they otherwise understood perfectly well.

← Marketplace Design Work →