Threads: How to measure (Analytics)

[daniellekirkwood]

How to measure the success and impact of Threads once launched.

Notes

Prioritised list of product questions that it would be cool if we could answer:

Question	Notes	MVP?
How many users have started a Thread	This we can track client-side	Yes
How many users have responded to a Thread	This we can track client-side	Yes
How often has the Thread panel been opened and where was it opened from?	This we can track client-side	Yes
How often is the Filter used in the Thread panel	This we can track client-side	Yes
How many Threads have been started	This we may struggle to know as we only have access to the Post-Hog Opt-in crowd which is not representative of all Element/Matrix. Can we learn this from Server side?	Maybe
What is the average length of a Thread (message responses, exclude reactions)	This we won't be able to know client-side without connecting a response to the root message (and hashing) which we do not think is high-priority enough for MVP Threads	No
Ideally avg length of Thread includes minimum length and maximum length	See above	No
How many Threads in a room	This we may struggle to know as Post-Hog can only give user info, not Room info. Can we learn this server-side?	No
How many Threads have been attempted but abandoned (user clicks to start thread but doesn’t complete task)	We have no way to measure an "abandon" today. We can get what we need from other questions.	No

---

Things we will implement in order to answer the top questions

How many users have started a Thread

• Discuss with team how we do this to ensure same measure cross platform

How many users have responded to a Thread

• Discuss with team how we do this to ensure same measure cross platform

How often has the Thread panel been opened and where was it opened from?

• Discuss with team how we do this to ensure same measure cross platform

How often is the Filter used in the Thread panel

• Discuss with team how we do this to ensure same measure cross platform

How many Threads have been started

• Discuss if there's a way to do this not client-side

---

This issue currently appears on all 3 Epics for P0 Threads as the implementation for measuring will need to match cross-platform

• Threads: Analytics element-web#20486
• Threads: Analytics element-android#4910
• Threads: Analytics element-ios#5365

[daniellekirkwood]

@gsouquet added you as an assignee as I have updated the issue with the list of product questions.
Happy to chat about which are realistic/manageable and scale down from this if needed.

[daniellekirkwood]

Discussion January 11, 2022

Notes moved to the Notes document linked in issue description

[daniellekirkwood]

@gsouquet this is currently assigned to you as I would love your help compiling the info we need in order to track these events; Name conventions etc. Feel free to post/discuss the answers here or in our room 👍

[daniellekirkwood]

Happy that we close this issue as all platforms have implemented analytics tracking and we are able to see the data in posthog.