-
Notifications
You must be signed in to change notification settings - Fork 20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
BD-4004 New segment calculation page & additional segmentation edits #9073
base: develop
Are you sure you want to change the base?
Conversation
@@ -78,7 +78,21 @@ The **Messaging Use** section shows which segments, currently enabled campaigns, | |||
### Historical membership | |||
The **Historical Membership** section shows how the size of your segment changed over time. Use the dropdown to filter segment membership by date range. | |||
|
|||
The historical segment membership count is an estimate, similar to how the segment size is an estimate before you click **Calculate Exact Statistics**. Braze estimates the membership count by querying users in a random bucket range. This means that on one day, the membership count could be based on users with a random bucket number of 111–120, and on another day, users with a random bucket number of 8,452–8,455. Therefore, the graph might show slight fluctuations on each date due to different amounts of users landing within the random bucket ranges. | |||
The historical segment membership count is an estimate, similar to how the segment size is an estimate before you select **Calculate Exact Statistics**. Braze estimates the membership count by querying users in a random bucket range daily at 4 am in your company time zone. This means that on one day, the membership count could be based on users with a random bucket number of 111–120, and on another day, users with a random bucket number of 8,452–8,455. Therefore, the graph might show slight fluctuations on each date due to different amounts of users landing within the random bucket ranges. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just to clarify that we are not just showing the number of users that match within that bucket range.
The historical segment membership count is an estimate, similar to how the segment size is an estimate before you select **Calculate Exact Statistics**. Braze estimates the membership count by querying users in a random bucket range daily at 4 am in your company time zone. This means that on one day, the membership count could be based on users with a random bucket number of 111–120, and on another day, users with a random bucket number of 8,452–8,455. Therefore, the graph might show slight fluctuations on each date due to different amounts of users landing within the random bucket ranges. | |
The historical segment membership count is an estimate, similar to how the segment size is an estimate before you select **Calculate Exact Statistics**. Braze estimates the membership count by querying users in a random bucket range daily at 4 am in your company time zone and extrapolated to estimate the total count. This means that on one day, the membership count could be based on users with a random bucket number of 111–120, and on another day, users with a random bucket number of 8,452–8,455. Therefore, the graph might show slight fluctuations on each date due to different amounts of users landing within the random bucket ranges. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hey @bclarke-braze could you clarify how this works?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah, so we take the set of criteria and a random set of bucket numbers as stated above and then we get X amount of users back. So for example, we may check bucket numbers 0-99 and get back 4 users. Because there are 10K buckets, we then essentially multiply 4 by 100 because we were only looking at 1/100 of the user base. So, we'd say the count of users is 400.
Then, based on all the variables, including app group size, we determine a margin of error. The smaller the percentage of users who match in a bucket range and the smaller the bucket range, the larger the margin of error.
The range of bucket numbers we choose is based on the size of the app group. The larger the app group, the fewer buckets we search. We run the query on roughly 50K users, and as stated above, the bucket range may change each day. Unless the amount of users changes drastically, the same amount of buckets would be used each day. So, technically it's not likely to run the query on 10 buckets one day and 14 the next
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks Brian!!
Why are you making this change? (required)
Add information to historical segment membership docs, including reasons for significant changes. The information comes from a SF KB article listed in the Jira ticket below.
Related PRs, issues, or features (optional)
BD-4004
Feature release date (optional)
Contributor checklist
Submitting for review
If your PR meets the above requirements, select Ready for review, then add a reviewer:
@braze-inc/docs-team
in a comment below.braze-inc/docs-team
instead.Thanks for contributing! We look forward to reading your work.