Can't analyze A/B tests in GA4 if more than 22.000 users (HyperLogLog) [Experimentation / CRO]

Описание к видео Can't analyze A/B tests in GA4 if more than 22.000 users (HyperLogLog) [Experimentation / CRO]

Have you heard the news too? You can't do A/B test analysis in GA4 like you did with Universal Analytics (UA).

It has to do with sessions (UA) vs user (GA4) count. The HyperLogLog method in GA4 has about 2% inaccuracy rate as soon as your tests have more than 22.000 visitors (12.000 visitors per variant). So from that point on, you'll need to analyze in a different way.

Take note, be aware of this. If you're working with big clients or doing CRO within a big organization, you need to get raw data from BigQuery.

Комментарии

Информация по комментариям в разработке