[nltk_data] Downloading package stopwords to /root/nltk_data...
[nltk_data]   Package stopwords is already up-to-date!

Rewards Analytics and Distribution Dashboard for Quantification Review¶

This document processes the outputs of the praise reward system and performs an analysis of the resulting token reward distribution.

Out[6]:

Distribution report for round-15

  • This period covers praise given between 2023-01-02 and 2023-01-31.
  • We allocated a total of 76637.33333333333 GIV tokens for rewards.
  • Duplicate praise received a weighting of 0.1 the value of the original praise.
  • We assigned 3 quantifiers per praise instance.
  • Praise receiver names were not hidden behind pseudonyms during quantification

Praise Data Visualization¶

Rating distribution¶

Since praise gets valued on a scale, we can take a look at how often each value of the scale gets assigned by quantifiers. Note: This metric disregards scores of praise marked as a duplicate, since the score of the original is already being taken into account.

Top 10 highest rated contributions¶

The ten highest rated contributions for this round were the following:

Out[9]:
Avg. score To Reason
89.0 cotabe#0 for not only his leadership and stewardness but for the impressive work with FLII. I was just telling somone about how impressive it is to take on and set up Giveth for an entire expo by himself basically...🤯
77.66666666666667 oyealmond#0 for bringing Lucile to inspire us and for collaborating so smoothly on the Giveth Ambassador program.. the pieces are falling into place nicely and the excitement is building. Thank you for putting so much effort into this
73.33333333333333 oyealmond#0 for being such an awesome and invaluable contributor, always supportive. I know I can count on you. Also for awesome last minute repre on twitter space for Gitcoin grant. You are such a rockstar and I love working with you!
73.33333333333333 oyealmond#0 for being stunning at what she does, all the Twitter management, events coordination, comms support, and proactive mindset. I love working with you; you bring value and good vibes to the team.
70.66666666666667 yass.o#0 for working hard this week to ensure our Alpha round grant is heard and known about in ever corner of this big, beautiful planet! :boost:1026905158317252699 :GIVpower:1026905095356563567 :Swag:923632607059648582 :GIV:923418911511281715 :logo:809539267248259092 :NICE:1019312700871938141 :GIVETH:923641348798693416 :GIVstream:923427489819263006 :gardens:923424115925319732
69.0 cotabe#0 for working really hard to present new GIVeconomy and fundraising initiatives weekly, while still stewarding the calls and taking on FLII head on
69.0 HBesso31🐙#4560 for engaging on the forum and giving such amazing feedback on the sproject page design. Seeing community members spend so much time giving thoughtful feedback gives me a lot of energy to keep pushing to make things better... cause people care :-D https://forum.giveth.io/t/improving-single-project-screen/983/3?u=griff
66.33333333333333 oyealmond#0 for all the amazing twitter work - on-the-fly hosting the twitter space, writing tweets all week for grants, GM, twitter spaces etc - she is putting so much work into making our twitter & event amazing and it shows
66.33333333333333 yass.o#0 for taking on the Fundraising call, Gitcoin Alpha outreach management, multiple grants, router outreach, jumping on calls at all hours of the day/night and still bringing the same lighthearted compasion but stern drive daily
62.0 cotabe#0 for bringing Lucile to inspire us and for collaborating so smoothly on the Giveth Ambassador program.. the pieces are falling into place nicely and the excitement is building. Thank you for putting so much effort into this

Praise Reward Distribution¶

We can now take a look at the distribution of the received praise rewards. You can toggle the inclusion of the different sources by clicking on the legend.

Praise Giving Distribution¶

We can also take a look at the amount of praise different users gave.

Praise Flows¶

Now for something more fun: let's surface the top "praise flows" from the data. Thanks to @inventandchill for this awesome visualization! On one side we have the top 15 praise givers separately, on the other the top 25 receivers. The people outside the selection get aggregated into the "REST FROM" and "REST TO" categories.

Out[13]:

Quantifier Data¶

Now let's take a closer look at the quantification process and the quantifiers:

Praise Outliers¶

To aid the revision process, we highlight disagreements between quantifiers.

Outliers sort by spreads¶

This graphic visualizes controversial praise ratings by sorting them by the "spread" between the highest and lowest received score.

Please keep in mind that this is a visual aid. If there are several praise instances with similar spread and quant score, all but one end up "hidden" on the chart. For an exhaustive list, take a look at the exported file "praise_outliers.csv" .

Praise score by quantifier -- outliers among the quantifiers?¶

Let's see how different quantifiers behaved by showing the range of praise scores they gave.

To interpret the box plot:

  • Bottom horizontal line of box plot is minimum value

  • First horizontal line of rectangle shape of box plot is First quartile or 25%

  • Second horizontal line of rectangle shape of box plot is Second quartile or 50% or median.

  • Third horizontal line of rectangle shape of box plot is third quartile or 75%

  • Top horizontal line of rectangle shape of box plot is maximum value.

/usr/local/lib/python3.9/site-packages/numpy/lib/function_base.py:2691: RuntimeWarning:

invalid value encountered in true_divide

/usr/local/lib/python3.9/site-packages/numpy/lib/function_base.py:2692: RuntimeWarning:

invalid value encountered in true_divide

Score displacement: tendency to under/over-scoring?¶

Scoring correlation: how similiar am I scoring with others?¶

Agreement on duplication¶

Out[22]:

Among 991 praises, 169 (17.05%) do not agree on duplication

Praise instances with disagreements in duplication are collected in 'results/duplication_examination.csv'. To compare, look at the last 4 columns: 'DUPLICATE MSG 1/2/3' and 'ORIGINAL MSG'.

Agreement on dismissal¶

Out[25]:

Among 991 praises, 7 (0.71%) do not agree on dismissal

Praise instances with disagreements in dismissal are collected in'results/dismissal_disaggreed.csv'. You can further look into who dismissed and who did not.