▤The Test Group experiment running Open the partner account
paid
Affiliate disclosure. The partner link in the masthead and in the band beside the copy on this page is a sponsored link to a partner operator, and this site may be paid if you open an account through it, at no extra cost to you. It carries rel="sponsored noopener" and opens in a new tab. A desk about how a screen is measured and tested should not leave its own funding unsaid: one link funds the site, no operator and no product is named, rated or recommended anywhere on it, and this site runs no analytics of its own on its readers.
The Test Group / The consent line
The readers a dashboard cannot see

The consent line, and the bias it leaves behind

A consent banner is not only a legal step; it is a filter on the data. The readers who decline are removed from the denominator, and if they behave differently the reported rate describes the readers who stayed rather than the readers who came. On the samples the difference is 5.10% against 2.30%.

Desk spec
accept analytics
68.4%
unmeasured
31.6%
measured rate
5.10%
population rate
4.22%
the eventOne interaction, written down. A click carries a name, a time, an account, a session and what was on the screen, and it is kept whether or not the reader chose to be measured.
the funnelThe order the steps happen in. A landing visit becomes an account, an account becomes a deposit page, and 100,000 visits end in 2,074 first bets - a 2.1% path the whole loop is aimed at.
the armsTwo versions of one screen shown at the same time, and a rate for each. 4.30% against 5.16% is a 0.86-point lift, and the interval decides whether it is a result or a coincidence.
Direct answer

A consent line decides who is measured. Readers who decline non-essential analytics are excluded from the event log, so every rate computed from it is a rate on the consenting group. On the samples the consenting 68.4% behave at 5.10% and the unmeasured 31.6% at 2.30%, so the true population rate is 4.22% and the dashboard overstates it by 20.9%.

Who is removed, and whether it matters

Excluding a random slice of visitors would change the rate by nothing. Excluding a slice that behaves differently changes it by everything, and the readers most likely to decline are usually the more cautious ones - which on a gambling site means the ones least likely to deposit.

Sample H - 100,000 visits, split by what the banner produced
GroupVisitsShareDeposit rate
accepted analytics68,40068.4%5.10%
declined non-essential21,60021.6%2.30%
made no choice10,00010.0%not measured
unmeasured in total31,60031.6%2.30% assumed, from the decliners
sample H - the measured rate against the population rate measured rate, on the 68.4% who accept = 5.10% assumed rate on the 31.6% who do not = 2.30% population rate = 0.684 x 5.10 + 0.316 x 2.30 = 3.4884 + 0.7268 = 4.2152 -> 4.22% overstatement = 5.10 / 4.2152 = 1.2099 -> 20.9% so a dashboard reading 5.10% is describing a population whose real rate is 4.22%, and no page in the product says so. the two arms of sample A were both measured on the consenting group, which is why the lift survives the bias even though the level does not.

What is measured with and without a choice

Consent is not a single switch over all recording. Some of it is treated as necessary to deliver the page and some as optional, and the line between the two is drawn by the operator and by the law where the reader is.

Sample H - the categories, and what each is used for
CategoryNeeds a choice?What it produces
a session identifier to keep a login workingno, necessarythe account stays signed in
a security record of a deviceno, necessarythe signal behind a takeover check
a page view counted in aggregateusually yesthe top of the funnel
a clickstream tied to an accountyesthe funnel's middle steps
a session replayyes, and rarely namedthe recording described on this site
cross-site advertising datayesnothing the desk's loop needs
the loop's own inputsyesthe whole experiment depends on a choice the reader may refuse
sample H - what the refusal costs the measurement visitors who refuse or never choose = 31.6% deposit rate among them, assumed = 2.30% deposits the dashboard never counts = 31,600 x 0.023 = 727 deposits it does count = 68,400 x 0.051 = 3,488 so 727 of 4,215 deposits, or 17.2%, are invisible an experiment run only on the visible 3,488 can move the measured rate by a fifth of a point without moving the real one at all, and the holdout of sample E is the only part of the loop that would notice.
The rates are invented and the legal column is deliberately general, because the rule differs by country. What is not general is the arithmetic: a group that refuses is a group that is not counted, and a rate computed without it is a rate on the remainder. A reader who declines should assume they are simply absent from the numbers rather than represented in them.
What a consent choice does and does not do
  • Declining removes you from the counts; it does not remove the events already recorded.
  • Declining usually applies going forward, not retroactively.
  • A necessary category is defined by the operator and can be broader than a reader expects.
  • A replay may be bundled into an analytics category rather than named separately.
  • Changing the choice is usually possible, and worth doing if the first one was made under pressure.

Read next