How to test consumer understanding of wealth disclosures in-house

Mid-sized wealth managers often assume that satisfying the Consumer Duty requires hiring external research agencies to run costly focus groups, but Compliance Consultant has demonstrated that regulated firms can test consumer understanding internally with proportional, structured methods. Compliance officers can systematically validate complex financial disclosures by combining targeted qualitative interviews, automated textual friction checks, and direct file audits. Rather than relying on assumptions or legalese, wealth firms can meet the Financial Conduct Authority (FCA) expectations for the consumer understanding outcome by testing whether retail clients comprehend decision-critical risks before signing.

The Court of Appeal ruling in the Johnson case established that burying critical terms in the small print fails the legal and regulatory threshold for consumer protection, regardless of whether disclosures use plain English. In wealth management, providing sixty pages of detailed fee schedules and structured product caveats no longer proves that a retail investor understood the financial implications of an advice package. The regulatory expectation has moved from disclosure delivery to proven comprehension.

The regulatory baseline for consumer understanding in wealth management

The FCA's supervisory focus has shifted toward evidentiary proof of customer outcomes. In the Year 2 Consumer Duty Board Reports review, the regulator observed that while firms have matured in gathering customer data, many still present operational metrics rather than genuine outcome-focused scrutiny. Boards are required to ask probing questions about whether clients genuinely understand what they buy, the ongoing charges they pay, and the constraints of their investment strategies.

Relying on standard signature blocks that declare the client has "read, understood, and agreed to the terms" offers zero regulatory defense. As examined in legal analyses of the Johnson case disclosure obligations, regulators and courts dismiss blanket disclaimers when the customer journey obscures key commercial incentives or structural product risks. The FCA mandates that firms ensure communications enable retail customers to make timely, informed decisions throughout the product lifecycle.

For wealth management firms, this baseline introduces operational friction. Advisors frequently balance complex portfolio mechanics, discretionary management agreements, multi-layered custody charges, and complex fund structures against strict Conduct of Business Sourcebook (COBS) disclosure rules. To remain compliant, firms must demonstrate that disclosures communicate risks in a manner that the target market can digest and act upon.

At Compliance Consultant, our work carrying out independent suitability file reviews across UK investment firms reveals that documentation packages often satisfy technical technicalities while failing core comprehension tests. Passing an FCA supervisory visit or building a defensible annual board report requires firms to systematically test their disclosures against real client behavior.

Practical in-house testing methods for investment firms

Mid-sized firms do not need twenty-person research panels or bespoke behavioral labs to produce credible consumer testing data. A balanced compliance testing framework combines high-volume technical screening with targeted qualitative inquiries.

The objective is to establish an iterative testing cycle: identify high-risk disclosure points, screen them for baseline friction, and test them with a sample of actual or representative customers.

A proportionate compliance testing strategy maps these tools to the complexity and risk profile of the communication. Routine administrative notices require basic readability checks, whereas discretionary mandate risk warnings and complex fee breakdowns require direct qualitative validation.

Running qualitative customer interviews without an external agency

Direct interviews provide the most rigorous evidence of actual comprehension. As highlighted by user experience specialists at CXPartners, testing for comprehension requires a distinct methodology: you cannot simply show a disclosure to a customer and ask, "Did you understand this?" Most respondents will instinctively answer yes to avoid appearing financially unsophisticated.

To extract defensible data, compliance teams must test for playback. The interviewer asks the customer to explain the document's consequences back to them in their own words, simulating the real decision-making context.

Step 1: Cohort Selection
- Select 5 to 8 participants who represent the product target market.
- Include at least two individuals who exhibit vulnerability characteristics (e.g., lower financial literacy, life-event distress).

Step 2: Contextual Setup
- Present the core disclosure document (e.g., Ex-Ante Costs & Charges illustration).
- Allow the participant to review the document as they would at home, without coaching.

Step 3: Comprehension Playback Prompts
- "Looking at page 2, what would happen to your overall return if the underlying asset falls by 10%?"
- "In your own words, what total annual fee will be deducted from your portfolio if your assets do not grow?"
- "If you needed to access £20,000 of your capital next week, what penalties or restrictions apply?"

Step 4: Objective Scoring & Failure Logging
- Record whether the participant accurately articulated the commercial reality.
- Log points of cognitive friction, hesitation, or misinterpretation directly into your risk register.

Conducting four to six forty-minute interviews on a specific disclosure template reveals nearly all primary structural ambiguities. If four out of five respondents cannot accurately state the cumulative impact of platform fees, advisory fees, and underlying fund costs after reading your fee schedule, the document fails the Consumer Duty understanding test. The firm must redraft the communication, re-evaluate layout hierarchy, and re-test before deploying it across the client base.

Using automated text analysis for baseline communication checks

Before putting communications in front of retail clients, compliance teams must clear out technical jargon and structural friction. Major market participants have demonstrated the viability of automated linguistic evaluation. For instance, platform provider Nucleus used AI to assess over 1,000 customer communications, finding that legacy collateral suffered from acute cognitive friction, ambiguity aversion, and poor visual framing.

Automated analysis helps compliance officers audit large document inventories without manual line-by-line reviews. These tools rapidly flag structural problems that depress investor comprehension:

• Cognitive friction: Sentences exceeding twenty-five words, passive sentence constructions, and layered sub-clauses that obscure the core proposition.
• Ambiguity aversion: Vague terminology regarding turnaround times, variable cost calculation formulas, or conditional withdrawal terms that cause investors to abandon or misjudge the decision.
• Information hierarchy deficits: Critical downside risks presented in identical font size, weight, and visual prominence as operational footnotes.

Wealth managers should run all standard pre-sales literature, periodic valuation templates, and suitability boilerplates through text analysis systems prior to legal sign-off. Flagging a reading score below standard secondary education levels allows the compliance team to reject unclear drafts before advisors distribute them to investors.

However, textual analysis serves strictly as a filtering stage. A clean readability score proves only that a text is grammatically readable; it does not confirm that an investor grasps the practical consequences of a transaction.

What most wealth managers get wrong about consumer understanding

In our advisory work supporting regulated financial firms, Compliance Consultant frequently encounters two flawed assumptions that undermine internal testing programmes.

Confusing readability with comprehension

A common compliance shortcut involves running client brochures through a Flesch-Kincaid calculator, obtaining an acceptable readability score, and cataloguing the document as compliant. This approach creates false security.

A disclosure can score well on readability metrics while remaining misleading or incomprehensible in practice. For instance:

"The portfolio invests in derivative contracts that may result in losses exceeding your initial capital."

This sentence scores well for basic linguistic readability: the vocabulary is relatively common and the sentence structure is simple. Yet retail investors with standard financial literacy frequently fail to understand how they can lose more money than they invested.

Testing must assess whether the reader grasps the real-world operational consequence, not just whether the sentences are short.

Testing the disclosure, not the decision

Firms often isolate a single document, such as a Key Information Document (KID) or an Ex-Ante Costs and Charges disclosure, and test whether a reader can navigate it. While individual document clarity matters, the FCA evaluates whether the customer had the necessary information, delivered at the proper stage, to make an informed financial choice.

If a wealth management firm provides an immaculate fee disclosure three minutes prior to executing a discretionary mandate agreement, the timing invalidates the document's technical clarity. The client experiences cognitive overload and signs under situational pressure.

Internal testing protocols must examine the sequence: Was the document delivered with sufficient time to digest? Did surrounding advisory conversations neutralize or contradict the written caveats?

Testing must mirror the actual customer decision journey rather than artificial file reviews.

Translating test results into board-level metrics

Consumer understanding testing cannot exist in an operational silo; it must actively drive governance and risk mitigation. Senior Managers holding SMF16 (Compliance Oversight) and board directors bear personal regulatory accountability for demonstrating that Consumer Duty metrics reflect true consumer outcomes.

We apply the engage, execute, embed methodology to ensure compliance processes take root across the entire firm. Under this approach, we engage by establishing regulatory requirements before infrastructure is built; execute by driving process and organisational change in parallel with technology development; and embed by integrating compliance into real-world operations through testing and scaling. This systematic approach ensures that comprehension findings directly inform broader governance.

Feeding data into your complaints MI

Comprehension testing failures must be mapped directly alongside incoming customer dispute logs. When an interview cohort demonstrates confusion over ongoing platform charges, compliance should immediately cross-reference that finding against historical customer complaints.

Firms should link these processes using structured analytical models. When a firm identifies recurring friction points, compliance officers must follow established frameworks to translate complaint root causes into Consumer Duty board metrics. Documenting that an onboarding disclosure issue identified during qualitative testing correlates with customer disputes allows the firm to demonstrate closed-loop risk management.

Furthermore, testing cohorts must capture vulnerable consumer segments. To remain compliant, wealth managers should ensure their reporting ties into a broader strategy for building a Consumer Duty complaints MI pack that tracks vulnerable customer outcomes. Disclosures that pass comprehension checks among experienced private wealth clients often fail when tested against individuals navigating cognitive decline, bereavement, or acute digital access limitations.

Updating the Consumer Duty Board Report

The annual Consumer Duty Board Report must move beyond reporting policy review completion percentages. The FCA explicitly penalises firms that present activity metrics as outcome evidence.

A defensible board pack presents testing data as a core risk indicator:

Metric 1: Comprehension Verification Rate
- Target: >85% accurate playback on critical product risks across tested cohorts.
- Current Status: 72% on Structured Return Mandates (Triggered remediation).

Metric 2: Cognitive Friction Audit Coverage
- Target: 100% of standard client disclosures screened through automated text analysis.
- Remediation: 14 legacy valuation letter templates rewritten to reduce sentence complexity.

Metric 3: Vulnerable Cohort Comprehension Variance
- Target: <5% difference in comprehension scoring between mainstream and vulnerable testing cohorts.
- Status: 12% gap identified on pension consolidation transfer risks (Action plan assigned to Head of Advice).

When board directors review quantitative comprehension data alongside remedial action plans, they can demonstrate active supervision to FCA supervisory teams. The compliance monitoring programme shifts from reactive file checking to empirical governance.

Strengthening your compliance monitoring framework

Establishing internal testing procedures requires structured oversight, clear accountability, and tested documentation templates. Mid-sized firms do not need the bloated cost structures of global consultancies to achieve this standard.

Compliance Consultant works with UK wealth managers, payment institutions, and boutique investment firms to build practical, audit-ready compliance infrastructure. Through our tiered retainers, we deliver experienced regulatory support at transparent, predictable fees:

• Silver Retainer (Compliance Professional): Tailored for established firms requiring proactive compliance oversight. Includes eight hours of monthly advisory support, digital templates including the Compliance Risk Register with Heat Mapping, Regulatory Horizon Scanning Tracker, SMCR Responsibilities Mapping Playbook, and the Consumer Duty / Operational Resilience Toolkit. Available at £895 per month (quarterly billing) or £795 per month (annual billing of £9,540 per year, saving 11%).
• Gold Retainer (Compliance Partner): Designed for firms requiring an embedded compliance partner with board-level engagement. Includes sixteen hours of monthly advisory support, a dedicated named compliance consultant, a four-hour response guarantee, direct mobile access, quarterly board reports, FCA supervisory visit preparation, and complete access to our exclusive digital library—including the Fair Value Assessment Framework, Section 166 Preparation Toolkit, and Conduct Rules Breach Investigation Toolkit. Available at £1,495 per month (quarterly billing) or £1,345 per month (annual billing of £16,140 per year, saving 10%).

Even our comprehensive Gold retainer costs less than 17% of employing a full-time compliance manager, saving over £84,000 per year while removing single-point-of-failure risk.

To evaluate your consumer testing framework or review your Consumer Duty compliance infrastructure, contact our team on UK Freephone 0800 689 0190, international line 0208 243 8620, or email info@complianceconsultant.org with the subject "Retainer Discovery Call" to book a free 30-minute discovery consultation. You can also review our advisory services directly at Compliance Consultant.