Show CrUX field data alongside lab Web Vitals#4794
Open
soulgalore wants to merge 1 commit into
Open
Conversation
A lab run measures one device, one network, one location — often a fast, cached, well-connected one. That makes the lab Web Vitals look healthier than what real users actually experience, and a regression real users already feel can stay invisible in the lab numbers. sitespeed.io already collects CrUX field data when configured, but it lived on a separate tab, so nobody compared the two. This puts the CrUX field p75 directly under the lab median in the Google Web Vitals card for TTFB, FCP, LCP, CLS and INP, graded against the same Good/Needs-improvement/Poor thresholds. The field line is matched to the device you tested (mobile run → PHONE, desktop → DESKTOP, falling back to ALL when the matching form factor wasn't collected) and always labels which form factor it used, so the two numbers are never silently mismatched. When the lab grades a metric better than the field does, the card flags it as "lab is more optimistic than real users" — the cue that your test conditions are hiding a real-world regression. Co-authored-by: Claude noreply@anthropic.com
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
A lab run measures one device, one network, one location — often a fast,
cached, well-connected one. That makes the lab Web Vitals look healthier than
what real users actually experience, and a regression real users already feel
can stay invisible in the lab numbers. sitespeed.io already collects CrUX field
data when configured, but it lived on a separate tab, so nobody compared the two.
This puts the CrUX field p75 directly under the lab median in the Google Web
Vitals card for TTFB, FCP, LCP, CLS and INP, graded against the same
Good/Needs-improvement/Poor thresholds. The field line is matched to the device
you tested (mobile run → PHONE, desktop → DESKTOP, falling back to ALL when the
matching form factor wasn't collected) and always labels which form factor it
used, so the two numbers are never silently mismatched. When the lab grades a
metric better than the field does, the card flags it as "lab is more optimistic
than real users" — the cue that your test conditions are hiding a real-world
regression.
Co-authored-by: Claude noreply@anthropic.com