Rewards Analytics and Distribution Dashboard for Quantification Review¶

This document processes the outputs of the praise reward system and performs an analysis of the resulting token reward distribution.

Praise Data Visualization¶

Rating distribution¶

Since praise gets valued on a scale, we can take a look at how often each value of the scale gets assigned by quantifiers. Note: This metric disregards scores of praise marked as a duplicate, since the score of the original is already being taken into account.

Top 10 highest rated contributions¶

The ten highest rated contributions for this round were the following:

Praise Reward Distribution¶

We can now take a look at the distribution of the received praise rewards. You can toggle the inclusion of the different sources by clicking on the legend.

Praise Giving Distribution¶

We can also take a look at the amount of praise different users gave.

Praise Flows¶

Now for something more fun: let's surface the top "praise flows" from the data. Thanks to @inventandchill for this awesome visualization! On one side we have the top 15 praise givers separately, on the other the top 25 receivers. The people outside the selection get aggregated into the "REST FROM" and "REST TO" categories.

Quantifier Data¶

Now let's take a closer look at the quantification process and the quantifiers:

Praise Outliers¶

To aid the revision process, we highlight disagreements between quantifiers.

Outliers sort by spreads¶

This graphic visualizes controversial praise ratings by sorting them by the "spread" between the highest and lowest received score.

Please keep in mind that this is a visual aid. If there are several praise instances with similar spread and quant score, all but one end up "hidden" on the chart. For an exhaustive list, take a look at the exported file "praise_outliers.csv" .

Praise score by quantifier -- outliers among the quantifiers?¶

Let's see how different quantifiers behaved by showing the range of praise scores they gave.

To interpret the box plot:

Bottom horizontal line of box plot is minimum value
First horizontal line of rectangle shape of box plot is First quartile or 25%
Second horizontal line of rectangle shape of box plot is Second quartile or 50% or median.
Third horizontal line of rectangle shape of box plot is third quartile or 75%
Top horizontal line of rectangle shape of box plot is maximum value.

Score displacement: tendency to under/over-scoring?¶

Scoring correlation: how similiar am I scoring with others?¶

Agreement on duplication¶

Praise instances with disagreements in duplication are collected in 'results/duplication_examination.csv'. To compare, look at the last 4 columns: 'DUPLICATE MSG 1/2/3' and 'ORIGINAL MSG'.

Agreement on dismissal¶

Praise instances with disagreements in dismissal are collected in'results/dismissal_disaggreed.csv'. You can further look into who dismissed and who did not.

Avg. score	To	Reason
103.06	Mount Manu#3530	for having transcribed praise for so many weeks, take the time to focus and meticulously write down praise voiced in our community calls
102.75	wslyvh#1059	for single handedly developing Tokenlog which the TEC has relied on for so many of our decisioning
84.67	iviangita#3204	for transcribing several months of praise given verbally during community calls -- a tedious and thankless task that brought a lot more praise into the system than would otherwise be ingested. I think that volume of praise input has helped us to better understand the system and will help to iterate it.
75.25	Mert Ozd#6679	for product managing the proposal inverter, including faciliating the weekly meetings, working through UX and designs issues and making sure payments are organized
61.5	ALOYSIOUS#3049	for graciously spending their time, evenings and weekends, gracefully dispelling my delusions and lovingly helping me through mental health crises of innumerable variety. The kindness, care, and insight they offer not only me, but every member of every layer they interact with is the sort of dedication to the betterment of humxnity that will invariably save us from ourselves, and shape the future we collectively hope to see. They are nothing short of a lifesaver. Thank you Alo. 💜
53.67	zhiwei#1356	for development on Reward System's RAD(Rewards Analytics Dashboard)
48.0	EFRA#7972	for working on #PraiseSunday visual for TE Academy and delivering it during a Saturday! Thanks so much - and hope you had a lovely weekend (:
48.0	Zeptimus#3359	For preparing an introduction to TE in spanish!!!! the first one in this langague :)
48.0	enti#1546	for adding all of the TEC's events into Discord by hand - every week.
46.5	GideonRo#3175	for facilitating a critical, and slightly contentious conversation around financial sustainability with tact and poise. He also demonstrated courage and ideal leadership by offering multiple perspectives; the objective withdrawn voice, and his own subjective perspective. That is true leadership in my opinion, and could/should be emulated in other WGs. Demonstrating courage amongst other leaders by speaking your own truth is the ultimate demonstration of leadership and necessarily provides immeasurable value. 👏