Measuring value generated by a running hub

Measuring value generated by a running hub#

We want ensure that our communities are receiving value from our interactive computing platform service. Our proxy for measuring the value from running hubs is by counting members of a community who are actively logging in and engaging in interactive sessions.

We measure MAUs (Month Active Users) as the number of accounts that have logged in to JupyterHub in the preceeding 30 days but this is not equivalent to the number of users who have started and engaged in an interactive sessions. As well, we want to ensure that value is being delivered to community members and that we are not only measuring activity by 2i2c staff and the community representatives.

A hub service is generating value if at least five separate, non-2i2c users, have engaged with the hub in the proceeding two week period.

Here are two Grafana dashboards that can be used to measure value generated from a running hub:

Engagement - Details#

Grafana - Engagement Details

../../../_images/engagement-detail.png

Selecte the cluster and hub in the top left. Adjust the time range (top-right) to the period of interest.#

This dashboard shows the number of individual sessions and the total number user used by each user. The Images table in the bottom left shows which docker image is is most commonly used for this hub.

Engagement - Summary#

Grafana - Engagement Summary

../../../_images/engagement-summary.png

Time to First Value#

We define Time to First Value (TFV) for a hub as the number of days between when the hub request was made to P&S and at least five separate, non-2i2c, account have engaged in an interactive session.