Page MenuHomePhabricator

Increase group by toggle sampling percentages on French, Portuguese and Chinese to 100%
Closed, ResolvedPublic

Description

In T396789: [Epic] Run and analyse an experiment for the group by toggle for Watchlist/RecentChanges/RelatedChanges we added a grouping toggle experiment to the RecentChanges/Watchlist/RelatedChanges pages for the following wikis:

Greek Wikipedia, Bengali Wikipedia, Urdu Wikipedia, Czech Wikipedia: 100 %
French Wikipedia: 10 %
Portuguese Wikipedia, Chinese Wikipedia: 25 %

However, our sampling numbers are lower than we'd like so we're increasing the traffic to
Chinese, French, and Portuguese wikis to 100%.

Event Timeline

Kgraessle renamed this task from Increase group by toggle sampling percentages on French, Portuguese and Chinese to 100% to Increase group by toggle sampling percentages on French, Portuguese and Chinese to X%.Aug 26 2025, 6:16 PM
Kgraessle moved this task from Ready to In Progress on the Moderator-Tools-Team (Kanban) board.

User-notice

On September 3rd, 2025 we'll be increasing the sampling percentages of our group by toggle experiment on Chinese, French, and Portuguese wikis.
This is to ensure we will have enough data to make an informed decision in evaluating the experiment results. The percentage we're updating each wiki to is 100.

Kgraessle renamed this task from Increase group by toggle sampling percentages on French, Portuguese and Chinese to X% to Increase group by toggle sampling percentages on French, Portuguese and Chinese to 100%.Aug 26 2025, 6:31 PM
Kgraessle updated the task description. (Show Details)

User-notice

On September 3rd, 2025 we'll be increasing the sampling percentages of our group by toggle experiment on Chinese, French, and Portuguese wikis.
This is to ensure we will have enough data to make an informed decision in evaluating the experiment results. The percentage we're updating each wiki to is 100.

@Kgraessle, should this be added to the upcoming tech news? I can see the draft for TechNews and the time. However, I want to confirm that I can add it to the upcoming one. Thank you!

User-notice

On September 3rd, 2025 we'll be increasing the sampling percentages of our group by toggle experiment on Chinese, French, and Portuguese wikis.
This is to ensure we will have enough data to make an informed decision in evaluating the experiment results. The percentage we're updating each wiki to is 100.

@Kgraessle, should this be added to the upcoming tech news? I can see the draft for TechNews and the time. However, I want to confirm that I can add it to the upcoming one. Thank you!

@UOzurumba
Yes, this should be added to the upcoming one (Monday Sept 1).

hi @Kgraessle - the following update was run on the production database around UTC 19:30 today:

UPDATE instruments SET sample_rate='{"1":["elwiki","bnwiki","urwiki","cswiki","ptwiki","zhwiki","frwiki"],"default":0}' WHERE id=37;

The MediaWiki endpoint shows all target wikis set to a sample rate of 1:
https://mpic.wikimedia.org/api/v1/experiments?format=config&authority=mediawiki

The xLab UI shows your experiment with target wikis at 100%:
https://mpic.wikimedia.org/read/fy24-25-we-1-7-rc-grouping-toggle

And there's a slight uptick in the event produce rate for the product_metrics.web_base stream starting around UTC 19:45:
https://grafana.wikimedia.org/goto/u4KIFF9Hg?orgId=1