Case Study · Paylocity

Marketplace

Company Paylocity
Product Client-Facing Integration Marketplace
My Role UX Researcher
Methods Moderated Usability Testing · Interviews · SUS
Participants 23 HR admins, 2 rounds
🛒
Paylocity Marketplace integration page screenshot

Overview

Paylocity's Marketplace lets customers discover, evaluate, purchase, and implement third-party integrations, everything from 401(k) providers to benefits administration tools, directly within their HR & Payroll platform. It's designed to work as a self-service storefront: customers find a partner, request the integration, and work with a Partner Implementation Team to get it set up.

I led research to understand the entire end-to-end Marketplace experience, including discovery, evaluation, purchase, and implementation, across two rounds of moderated usability testing and interviews with 23 HR administrators.

The Problem

Marketplace was a strategic priority: the business wanted to grow self-service Marketplace revenue and reduce the load on Sales and Support teams who were fielding integration requests manually. But Marketplace was originally designed with a narrow user in mind, HR admins, while in reality, a much wider range of people were interacting with it, from brokers to developers to enterprise IT leads.

Leadership needed to know: where in the journey, discovery, evaluation, purchase, or implementation, were customers getting stuck, and why?

Research Goals

Research Approach

I ran two rounds of moderated, remote usability studies and interviews:

Participants were HR admins responsible for finding and executing integrations, managing recruiting, benefits enrollment, or personnel records. The group included 16 current Paylocity customers and 7 non-customers, spanning Financial Services, IT Services, Health, Manufacturing, Property Management, and Education, at companies ranging from 20 to 1,000 employees.

Key Findings

80

SUS score, above the industry average of 68, but masking real usability gaps in discovery and purchase.

50%

of participants couldn't successfully find Marketplace on their own; the other 50% failed the task entirely.

88%

completed "find an integration" successfully once inside Marketplace. The entry point was the real blocker.

75

perceived usefulness score, reflecting how well participants felt Marketplace met their needs once they got there.

Despite a strong topline SUS score, four core issues consistently blocked customers from discovering, evaluating, purchasing, and implementing integrations successfully:

"A few months ago, I had an Ease integration, and I didn't get an email letting me know… and the salesperson reached back out to me months later… and said it was done. There was definitely a breakdown in communication."

Jamille Hamlet, Human Resources Manager, Planned Parenthood

Recommendations & Impact

I grouped recommendations by where in the journey they'd have the most impact, prioritizing short-term fixes the team could act on quickly alongside longer-term investments:

These recommendations were prioritized with the Product and Partner Integration teams for near-term implementation, and shared with the Vision Design team to inform the longer-term Marketplace roadmap.

Reflections

The biggest lesson from this project was how much a strong topline metric (an 80 SUS score, above the industry average) can mask underlying friction. Half of participants couldn't even find Marketplace, a problem no usability score on the "inside" of the product would ever surface. It reinforced how important it is to test the entire journey, including the parts that happen before someone reaches the product, not just the polished flows inside it.

It also underscored a recurring theme across enterprise research: customers don't think in terms of product taxonomy ("Marketplace"), they think in terms of their own workflows ("I need to configure an integration"). Designing, and naming things, around the customer's mental model rather than the org chart is something I now bring into every research plan.

← Back to home Next: Payroll →