-
Notifications
You must be signed in to change notification settings - Fork 0
Release notes for 26/05 #267
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
chris-absmartly
wants to merge
5
commits into
master
Choose a base branch
from
26/05-2
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
5 commits
Select commit
Hold shift + click to select a range
10489fe
added release notes for May 2026
chris-absmartly 99f9859
renamed Custom Assignemnt (exclusion rules)
chris-absmartly 459e147
docs(experiments): nest Custom Assignments under Audiences section
chris-absmartly 7df56e0
docs(release-notes): update metric changelog screenshot
chris-absmartly e23acb6
docs(release-notes): link activity_per_period to its full doc
chris-absmartly File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,90 @@ | ||
| import Image from "../../../src/components/Image"; | ||
|
|
||
| # May 2026 | ||
|
|
||
| ## Overview | ||
|
|
||
| This release brings a long-awaited **Metric Changelog**, introduces the new **activity_per_period** metric type, | ||
| and ships several quality-of-life improvements across the Explore Metrics tab, experiment list, and Events dashboard. | ||
|
|
||
| --- | ||
|
|
||
| ## Metrics | ||
|
|
||
| ### Metric Changelog | ||
|
|
||
| Every metric now has a full **change log** that captures every modification made over its lifetime, so you always know **what changed, who changed it, and when**. | ||
|
|
||
| Open the change log from any metric to see a chronological timeline of changes, with the most recent at the top. Each entry shows: | ||
|
|
||
| - **Who** made the change, with avatar and name | ||
| - **When** it happened (relative time, with the exact timestamp on hover) | ||
| - **Which metric version** the change produced | ||
| - **A short summary** of the change (e.g. _Changed owners_, _Added metadata_) | ||
| - **Field-level before/after diffs**, grouped into collapsible sections such as **Identity**, **Details**, **Definition** **Goal**, with clear add/remove indicators | ||
|
|
||
| This gives teams a complete audit trail for metric governance which is useful for reviews, debugging unexpected results, and understanding the history behind a metric. | ||
| The same change log will soon be available for other assets like **experiments** and **features**. | ||
|
|
||
| <Image maxWidth="40rem" centered img="release-notes/metric-changelog.png" alt="Metric changelog showing chronological changes with who, when, and field-level diffs" /> | ||
|
|
||
| --- | ||
|
|
||
| ### New Metric Type: `activity_per_period` | ||
|
|
||
| We've added a new metric type, **[activity_per_period](/docs/web-console-docs/goals-and-metrics/metrics/metric-types/activity-per-period)**, that measures user activity over a configurable time window (for example, _sessions per week_ or _orders per month_). | ||
| It's designed for cases where you care about the **frequency** of an action per user across a rolling period, rather than a single count or ratio. | ||
|
|
||
| See the [Activity per Period documentation](/docs/web-console-docs/goals-and-metrics/metrics/metric-types/activity-per-period) for more information. | ||
|
|
||
| ### Improved Metrics Discoverability | ||
|
|
||
| Finding the right metric on the **Explore Metrics** tab is now much easier. | ||
| We've improved how metrics surface in the list, making it faster to locate the metrics you care about when investigating an experiment. | ||
|
|
||
| --- | ||
|
|
||
| ## Events | ||
|
|
||
| ### Keyboard Navigation in the Event Details Dialog | ||
|
|
||
| The **Event Details** dialog now supports keyboard arrow navigation, so you can step through events without reaching for the mouse. A small change that makes browsing through long event lists noticeably faster. | ||
|
|
||
| --- | ||
|
|
||
| ## Experiments | ||
|
|
||
| ### Custom Assignments (Early Beta) | ||
|
|
||
| We're opening up an **early beta** of **Custom Assignments** — a new way to define who should be **excluded from an experiment** and always served a specific variant instead. | ||
|
|
||
| Custom Assignments (also known as **exclusion rules**) are useful for: | ||
|
|
||
| - **Testing & QA** — force yourself or your team into a specific variant to verify the experience, without being counted as a participant. | ||
| - **Internal or beta users** — ensure groups like internal employees or beta testers always see a chosen variant, without polluting experiment data. | ||
|
|
||
| Excluded visitors see the configured variant but **are not tracked as participants**, so the experiment statistics stay clean. | ||
|
|
||
| See the [Custom Assignments documentation](/docs/web-console-docs/experiments/creating-an-experiment#custom-assignments-exclusion-rules) for details on how to configure them. | ||
|
|
||
| :::caution Early Beta — JavaScript SDK Only | ||
| Custom Assignments are currently in **early beta** and are **only available for the JavaScript SDK**. The feature is behind a flag and requires an **SDK update** before it can be used. | ||
| If you'd like to enable it for your account, please **[reach out to our team](mailto:support@absmartly.com)** and we'll help you get set up. | ||
| ::: | ||
|
|
||
| ### Group Experiment List by Experiment | ||
|
|
||
| You can now **group the experiment list by experiment**, making it easier to navigate large lists | ||
| especially when working with experiment families or multiple iterations of the same test. | ||
|
|
||
| --- | ||
|
|
||
| ## Bug Fixes | ||
|
|
||
| This release also includes a number of security, stability and reliability improvements based on feedback from users. | ||
|
|
||
| --- | ||
|
|
||
| ## Questions or Feedback? | ||
|
|
||
| We're always happy to help, so reach out if you have any questions or want to explore how to make the most of these new capabilities. | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
57 changes: 57 additions & 0 deletions
57
...web-console-docs/goals-and-metrics/metrics/metric-types/activity-per-period.mdx
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,57 @@ | ||
| --- | ||
| sidebar_position: 8 | ||
| --- | ||
|
|
||
| # Activity per Period | ||
|
|
||
| ## Overview | ||
|
|
||
| An `Activity per Period` metric measures **how frequently** a user performs a goal action across a configurable time window | ||
| — for example, _sessions per week_ or _orders per month_. | ||
|
|
||
| Unlike a simple `Goal Count`, which sums all events per user, `Activity per Period` normalises activity into a **rate per period**, making it easier to compare user engagement over time and across cohorts of different exposure lengths. | ||
|
|
||
| You can configure: | ||
|
|
||
| - the **goal event** to track | ||
| - the **period length** (e.g. day, week, month) | ||
| - whether the period starts: | ||
| - from the user's first exposure to the experiment, or | ||
| - from the user's first occurrence of the goal event | ||
|
|
||
| ## Examples | ||
|
|
||
| ```javascript | ||
| context.track("session_start", { | ||
| source: "homepage", | ||
| device: "mobile" | ||
| }); | ||
| ``` | ||
|
|
||
| Imagine you want to measure **average sessions per week per user** during your experiment. | ||
|
|
||
| You can create a `Sessions per Week` metric by: | ||
| - Selecting the `session_start` goal | ||
| - Setting the `Period` to 7 days | ||
| - Choosing whether periods start from the user's first exposure or first session | ||
|
|
||
| The metric then computes, for each user, the number of goal events per period, and aggregates the result across the experiment population. | ||
|
|
||
| **More examples** | ||
|
|
||
| - `Orders per Month`: | ||
| Average number of purchases per user per 30-day period. | ||
|
|
||
| - `Articles Read per Week`: | ||
| Average number of articles read per user, per 7-day period. | ||
|
|
||
| - `Active Days per Week`: | ||
| Average number of distinct days a user was active in a 7-day window. | ||
|
|
||
| ## Good to know | ||
|
|
||
| - Useful when you care about **frequency** of an action rather than total volume or simple conversion. | ||
| - More robust than `Goal Count` when users have different exposure lengths — the per-period normalisation makes long-tenured and short-tenured users directly comparable. | ||
| - Filters on the goal event apply before the per-period rollup (for example: _purchases per week_ restricted to a specific category). | ||
| - Changing the period length alters the meaning of the metric and will require a new version. | ||
| - Ideal for experiments aimed at **engagement, habit formation, or retention frequency** — onboarding flows, notifications, recommendation systems, or loyalty mechanics. |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Clarify the section list formatting.
The list of collapsible sections appears to be missing proper punctuation or formatting between "Definition" and "Goal". This should likely be either:
📝 Proposed fix (if separate sections)
📝 Committable suggestion
🤖 Prompt for AI Agents