-
-
Notifications
You must be signed in to change notification settings - Fork 157
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Tracking issue: Self-reporting to collect real-world statistics #2909
Comments
The use of Prometheus is not.mandatory, just a current tool we use fwiw. Prometheus has the issue that it mandates a pull model, it wants to pull metrics from (cloud) servers. For this issue and also for chatmail measurements we rather need a push model and using email for that is natural. Data an then be made available to Prometheus or some of us can try to render something directly out of the data. I don't think there needs to be a very customizable UI for the visualization but if it comes "for free" then why not. |
May be interesting to collect:
|
@link2xt Why are they interesting? At some point we'll need a discussion about which metrics are worth having, so I'll start (ping @adbenitez who proposed most of the metrics below). The reason to collect data is that we want to know which usability problems to prioritize, and to help us with some future decisions. I put a "?" to all the metrics where I can't think of any decision where this metric might be useful, but maybe there is some? number of messages Number of accounts configured Max number of members in a group Feel free to directly edit this comment here with pro and con arguments. Also, I didn't include most of the metrics that are already in my first account, because most of them seem helpful to me, but feel free to also open a discussion about whether they are helpful. |
Part of deltachat/deltachat-android#2909 For now, this is only sending a few basic metrics.
Depends on chatmail/core#5129 Part of #2909
closing as there is no concrete actionable item left for android in this issue tracker. if needed, reopen a new issue or reopen eg. at https://github.com/deltachat/interface/issues where some cross-platform things are discussed/tracked |
I'll update the issue description here whenever there is some new discussion on the topic. Below we can have an "unordered" discussion.
Goal: Collect realworld statistics on usage of verified chats and other parts of Delta Chat by allowing the user to send us some anonymized info. Not only will this be be opt-in, but also the user will be able to see what will be sent, and control when it is sent.
Timeline: Feb 2024
Metrics I think will be interesting
Can be extracted from the db today
I checked the boxes of whatever metrics I already implemented.
Additional metrics we could collect during usage
Note that before implementing these, we'll have to check whether having this information on the phone could be dangerous, e.g. maybe having created a lots of groups could make you suspicious, since you're probably some sort of leader? Probably I'm overthinking it, though.
UX details
Technical details
Use OpenMetrics as the data format and Prometheus to visualize them. To create the file, format strings are probably enough; if not, https://lib.rs/keywords/openmetrics (or https://crates.io/search?q=openmetrics) may be interesting.
Alternatives
The text was updated successfully, but these errors were encountered: