A/B testing impact

Performance impact by ab_testing provider.

Field data PhoneDesktopAll Scope All sites Q2 2026 edition · All devices field outcomes
Metric LCP INP CLS
1

At a glance the headline numbers for A/B testing impact

Performance impact by ab_testing provider.

8
Providers ranked
After min-sites filter
21,139
Sites in sample
Combined across all items
104ms
Best INP (p75)
Google Optimize
The State of Web Vitals · Q2 2026 · 189,915 sites · all devices field datacorewebvitals.io/state-of-cwv
2

The ranking sorted by INP at p75, fastest first

# Provider INP p75 Passing Sites
1 Google Optimize 104ms 95.9%
19,960
2 AB Tasty 169ms 85.9%
109
3 VWO 179ms 80.3%
433
4 Convert 181ms 86.4%
192
5 LaunchDarkly 197ms 75.7%
131
6 Optimizely 205ms 73.0%
137
7 Kameleoon 211ms 70.8%
112
8 Dynamic Yield 295ms 47.2%
65
The State of Web Vitals · Q2 2026 · 189,915 sites · all devices field datacorewebvitals.io/state-of-cwv
3

Passing INP per provider which group passes the INP most often

ProviderSitesPassing INPp75
Google Optimize 10.5% 19,960 96% 104ms
Convert 0.1% 192 86% 181ms
AB Tasty 0.1% 109 86% 169ms
VWO 0.2% 433 80% 179ms
LaunchDarkly 0.1% 131 76% 197ms
Optimizely 0.1% 137 73% 205ms
Monetate 0% 26 71% 213ms
Kameleoon 0.1% 112 71% 211ms
Split.io 0% 9 63% 226ms
Statsig 0% 2 50% 362ms
Dynamic Yield 0% 65 47% 295ms
Evolv ai 0% 1 444ms
Good Needs Improvement Poor Sorted best-passing first · median colored by its own rating · pass = good INP (200ms at p75) · one value per site

96% of Google Optimize sites pass INP. Kameleoon trails 25 points behind, leaving 29% of its sites failing. computed

The State of Web Vitals · Q2 2026 · 189,915 sites · all devices field datacorewebvitals.io/state-of-cwv
4

All five vitals at once the whole category without toggling - cell is the pass rate, small number the p75

LCP
INP
CLS
FCP
TTFB
VWO 0.2%
782.4s
80179ms
840.05
721.9s
551.2s
AB Tasty 0.1%
782.3s
86169ms
720.12
711.9s
61988ms
Statsig 0%
1002.1s
50362ms
1000.02
1001.8s
100514ms
Evolv ai 0%
02.8s
0444ms
00.27
02.4s
01.7s
Google Optimize 10.5%
822.2s
96104ms
860.05
751.8s
551.3s
Convert 0.1%
702.7s
86181ms
800.08
751.8s
561.4s
Kameleoon 0.1%
772.4s
71211ms
710.12
721.9s
531.1s
Dynamic Yield 0%
702.6s
47295ms
630.19
751.8s
61967ms
LaunchDarkly 0.1%
493.9s
76197ms
730.11
492.7s
551.2s
Split.io 0%
333.3s
63226ms
440.34
442.6s
56884ms
Optimizely 0.1%
692.8s
73205ms
800.09
642.2s
461.3s
Monetate 0%
882.3s
71213ms
770.08
771.7s
381.0s
60%95%+ passing Cell: pass rate, small number = p75 · faded rows: under 100 sites

One row per provider, one column per vital - the cell is the share of sites passing, the small number the p75. No toggling needed to see where the category actually differs.

Google Optimize leads on INP: 96% of its sites pass. Kameleoon trails at 71%. computed

The State of Web Vitals · Q2 2026 · 189,915 sites · all devices field datacorewebvitals.io/state-of-cwv
Related signals Maps (4) → CDN (16) → Chat & messaging (17) → Bot detection (8) → Chrome field data from 189,915 sites, representing millions of real page loads · How we measured
Live queries (3) — admin only
Query #1: 27.3 ms
SELECT 1 AS ok FROM site_providers LIMIT 0;
Query #2: 340.5 ms
SELECT CAST(p.key AS VARCHAR) AS e, COUNT(*) AS sites,
  COUNT(*) FILTER (WHERE s.crux."all".lcp IS NOT NULL) AS all_lcp_n,
  quantile_disc(s.crux."all".lcp, 0.5) AS all_lcp_median,
  quantile_disc(s.crux."all".lcp, 0.75) AS all_lcp_p75,
  COUNT(*) FILTER (WHERE s.crux."all".lcp <= 2500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".lcp IS NOT NULL), 0) AS all_lcp_good,
  COUNT(*) FILTER (WHERE s.crux."all".lcp > 2500 AND s.crux."all".lcp <= 4000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".lcp IS NOT NULL), 0) AS all_lcp_ni,
  COUNT(*) FILTER (WHERE s.crux."all".lcp > 4000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".lcp IS NOT NULL), 0) AS all_lcp_poor,
  COUNT(*) FILTER (WHERE s.crux."all".inp IS NOT NULL) AS all_inp_n,
  quantile_disc(s.crux."all".inp, 0.5) AS all_inp_median,
  quantile_disc(s.crux."all".inp, 0.75) AS all_inp_p75,
  COUNT(*) FILTER (WHERE s.crux."all".inp <= 200) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".inp IS NOT NULL), 0) AS all_inp_good,
  COUNT(*) FILTER (WHERE s.crux."all".inp > 200 AND s.crux."all".inp <= 500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".inp IS NOT NULL), 0) AS all_inp_ni,
  COUNT(*) FILTER (WHERE s.crux."all".inp > 500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".inp IS NOT NULL), 0) AS all_inp_poor,
  COUNT(*) FILTER (WHERE s.crux."all".cls IS NOT NULL) AS all_cls_n,
  quantile_disc(s.crux."all".cls, 0.5) AS all_cls_median,
  quantile_disc(s.crux."all".cls, 0.75) AS all_cls_p75,
  COUNT(*) FILTER (WHERE s.crux."all".cls <= 0.1) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".cls IS NOT NULL), 0) AS all_cls_good,
  COUNT(*) FILTER (WHERE s.crux."all".cls > 0.1 AND s.crux."all".cls <= 0.25) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".cls IS NOT NULL), 0) AS all_cls_ni,
  COUNT(*) FILTER (WHERE s.crux."all".cls > 0.25) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".cls IS NOT NULL), 0) AS all_cls_poor,
  COUNT(*) FILTER (WHERE s.crux."all".fcp IS NOT NULL) AS all_fcp_n,
  quantile_disc(s.crux."all".fcp, 0.5) AS all_fcp_median,
  quantile_disc(s.crux."all".fcp, 0.75) AS all_fcp_p75,
  COUNT(*) FILTER (WHERE s.crux."all".fcp <= 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".fcp IS NOT NULL), 0) AS all_fcp_good,
  COUNT(*) FILTER (WHERE s.crux."all".fcp > 1800 AND s.crux."all".fcp <= 3000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".fcp IS NOT NULL), 0) AS all_fcp_ni,
  COUNT(*) FILTER (WHERE s.crux."all".fcp > 3000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".fcp IS NOT NULL), 0) AS all_fcp_poor,
  COUNT(*) FILTER (WHERE s.crux."all".ttfb IS NOT NULL) AS all_ttfb_n,
  quantile_disc(s.crux."all".ttfb, 0.5) AS all_ttfb_median,
  quantile_disc(s.crux."all".ttfb, 0.75) AS all_ttfb_p75,
  COUNT(*) FILTER (WHERE s.crux."all".ttfb <= 800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".ttfb IS NOT NULL), 0) AS all_ttfb_good,
  COUNT(*) FILTER (WHERE s.crux."all".ttfb > 800 AND s.crux."all".ttfb <= 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".ttfb IS NOT NULL), 0) AS all_ttfb_ni,
  COUNT(*) FILTER (WHERE s.crux."all".ttfb > 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."all".ttfb IS NOT NULL), 0) AS all_ttfb_poor,
  COUNT(*) FILTER (WHERE s.crux."phone".lcp IS NOT NULL) AS phone_lcp_n,
  quantile_disc(s.crux."phone".lcp, 0.5) AS phone_lcp_median,
  quantile_disc(s.crux."phone".lcp, 0.75) AS phone_lcp_p75,
  COUNT(*) FILTER (WHERE s.crux."phone".lcp <= 2500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".lcp IS NOT NULL), 0) AS phone_lcp_good,
  COUNT(*) FILTER (WHERE s.crux."phone".lcp > 2500 AND s.crux."phone".lcp <= 4000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".lcp IS NOT NULL), 0) AS phone_lcp_ni,
  COUNT(*) FILTER (WHERE s.crux."phone".lcp > 4000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".lcp IS NOT NULL), 0) AS phone_lcp_poor,
  COUNT(*) FILTER (WHERE s.crux."phone".inp IS NOT NULL) AS phone_inp_n,
  quantile_disc(s.crux."phone".inp, 0.5) AS phone_inp_median,
  quantile_disc(s.crux."phone".inp, 0.75) AS phone_inp_p75,
  COUNT(*) FILTER (WHERE s.crux."phone".inp <= 200) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".inp IS NOT NULL), 0) AS phone_inp_good,
  COUNT(*) FILTER (WHERE s.crux."phone".inp > 200 AND s.crux."phone".inp <= 500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".inp IS NOT NULL), 0) AS phone_inp_ni,
  COUNT(*) FILTER (WHERE s.crux."phone".inp > 500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".inp IS NOT NULL), 0) AS phone_inp_poor,
  COUNT(*) FILTER (WHERE s.crux."phone".cls IS NOT NULL) AS phone_cls_n,
  quantile_disc(s.crux."phone".cls, 0.5) AS phone_cls_median,
  quantile_disc(s.crux."phone".cls, 0.75) AS phone_cls_p75,
  COUNT(*) FILTER (WHERE s.crux."phone".cls <= 0.1) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".cls IS NOT NULL), 0) AS phone_cls_good,
  COUNT(*) FILTER (WHERE s.crux."phone".cls > 0.1 AND s.crux."phone".cls <= 0.25) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".cls IS NOT NULL), 0) AS phone_cls_ni,
  COUNT(*) FILTER (WHERE s.crux."phone".cls > 0.25) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".cls IS NOT NULL), 0) AS phone_cls_poor,
  COUNT(*) FILTER (WHERE s.crux."phone".fcp IS NOT NULL) AS phone_fcp_n,
  quantile_disc(s.crux."phone".fcp, 0.5) AS phone_fcp_median,
  quantile_disc(s.crux."phone".fcp, 0.75) AS phone_fcp_p75,
  COUNT(*) FILTER (WHERE s.crux."phone".fcp <= 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".fcp IS NOT NULL), 0) AS phone_fcp_good,
  COUNT(*) FILTER (WHERE s.crux."phone".fcp > 1800 AND s.crux."phone".fcp <= 3000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".fcp IS NOT NULL), 0) AS phone_fcp_ni,
  COUNT(*) FILTER (WHERE s.crux."phone".fcp > 3000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".fcp IS NOT NULL), 0) AS phone_fcp_poor,
  COUNT(*) FILTER (WHERE s.crux."phone".ttfb IS NOT NULL) AS phone_ttfb_n,
  quantile_disc(s.crux."phone".ttfb, 0.5) AS phone_ttfb_median,
  quantile_disc(s.crux."phone".ttfb, 0.75) AS phone_ttfb_p75,
  COUNT(*) FILTER (WHERE s.crux."phone".ttfb <= 800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".ttfb IS NOT NULL), 0) AS phone_ttfb_good,
  COUNT(*) FILTER (WHERE s.crux."phone".ttfb > 800 AND s.crux."phone".ttfb <= 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".ttfb IS NOT NULL), 0) AS phone_ttfb_ni,
  COUNT(*) FILTER (WHERE s.crux."phone".ttfb > 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."phone".ttfb IS NOT NULL), 0) AS phone_ttfb_poor,
  COUNT(*) FILTER (WHERE s.crux."desktop".lcp IS NOT NULL) AS desktop_lcp_n,
  quantile_disc(s.crux."desktop".lcp, 0.5) AS desktop_lcp_median,
  quantile_disc(s.crux."desktop".lcp, 0.75) AS desktop_lcp_p75,
  COUNT(*) FILTER (WHERE s.crux."desktop".lcp <= 2500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".lcp IS NOT NULL), 0) AS desktop_lcp_good,
  COUNT(*) FILTER (WHERE s.crux."desktop".lcp > 2500 AND s.crux."desktop".lcp <= 4000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".lcp IS NOT NULL), 0) AS desktop_lcp_ni,
  COUNT(*) FILTER (WHERE s.crux."desktop".lcp > 4000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".lcp IS NOT NULL), 0) AS desktop_lcp_poor,
  COUNT(*) FILTER (WHERE s.crux."desktop".inp IS NOT NULL) AS desktop_inp_n,
  quantile_disc(s.crux."desktop".inp, 0.5) AS desktop_inp_median,
  quantile_disc(s.crux."desktop".inp, 0.75) AS desktop_inp_p75,
  COUNT(*) FILTER (WHERE s.crux."desktop".inp <= 200) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".inp IS NOT NULL), 0) AS desktop_inp_good,
  COUNT(*) FILTER (WHERE s.crux."desktop".inp > 200 AND s.crux."desktop".inp <= 500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".inp IS NOT NULL), 0) AS desktop_inp_ni,
  COUNT(*) FILTER (WHERE s.crux."desktop".inp > 500) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".inp IS NOT NULL), 0) AS desktop_inp_poor,
  COUNT(*) FILTER (WHERE s.crux."desktop".cls IS NOT NULL) AS desktop_cls_n,
  quantile_disc(s.crux."desktop".cls, 0.5) AS desktop_cls_median,
  quantile_disc(s.crux."desktop".cls, 0.75) AS desktop_cls_p75,
  COUNT(*) FILTER (WHERE s.crux."desktop".cls <= 0.1) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".cls IS NOT NULL), 0) AS desktop_cls_good,
  COUNT(*) FILTER (WHERE s.crux."desktop".cls > 0.1 AND s.crux."desktop".cls <= 0.25) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".cls IS NOT NULL), 0) AS desktop_cls_ni,
  COUNT(*) FILTER (WHERE s.crux."desktop".cls > 0.25) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".cls IS NOT NULL), 0) AS desktop_cls_poor,
  COUNT(*) FILTER (WHERE s.crux."desktop".fcp IS NOT NULL) AS desktop_fcp_n,
  quantile_disc(s.crux."desktop".fcp, 0.5) AS desktop_fcp_median,
  quantile_disc(s.crux."desktop".fcp, 0.75) AS desktop_fcp_p75,
  COUNT(*) FILTER (WHERE s.crux."desktop".fcp <= 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".fcp IS NOT NULL), 0) AS desktop_fcp_good,
  COUNT(*) FILTER (WHERE s.crux."desktop".fcp > 1800 AND s.crux."desktop".fcp <= 3000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".fcp IS NOT NULL), 0) AS desktop_fcp_ni,
  COUNT(*) FILTER (WHERE s.crux."desktop".fcp > 3000) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".fcp IS NOT NULL), 0) AS desktop_fcp_poor,
  COUNT(*) FILTER (WHERE s.crux."desktop".ttfb IS NOT NULL) AS desktop_ttfb_n,
  quantile_disc(s.crux."desktop".ttfb, 0.5) AS desktop_ttfb_median,
  quantile_disc(s.crux."desktop".ttfb, 0.75) AS desktop_ttfb_p75,
  COUNT(*) FILTER (WHERE s.crux."desktop".ttfb <= 800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".ttfb IS NOT NULL), 0) AS desktop_ttfb_good,
  COUNT(*) FILTER (WHERE s.crux."desktop".ttfb > 800 AND s.crux."desktop".ttfb <= 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".ttfb IS NOT NULL), 0) AS desktop_ttfb_ni,
  COUNT(*) FILTER (WHERE s.crux."desktop".ttfb > 1800) * 1.0 / NULLIF(COUNT(*) FILTER (WHERE s.crux."desktop".ttfb IS NOT NULL), 0) AS desktop_ttfb_poor
                    FROM site_providers p
                    JOIN sites s ON s.origin = p.origin
                    WHERE p.category = 'ab_testing'
                      AND p.key IS NOT NULL AND CAST(p.key AS VARCHAR) <> ''
                    GROUP BY p.key;
Query #3: 27.3 ms
SELECT COUNT(*) AS n FROM sites;
JSON file lookups (5)
20260625/meta.json 0.04 ms
20260625/types.json 0.74 ms
20260625/loaf-scripts.json 0.46 ms
20260625/menu.json 0.19 ms
20260625/providers.json 2.89 ms