I'm working on a ladder system that will have let's say 100 contestants pitted against each other. But these contestants do not battle each other as groups or individually. Instead, they battle each other based on their own individual performance.
For example. A beer brewing competition. Each beer made by each contestant is not being compared directly against another beer. But instead each beer will be rated on 4 stats. Taste, Look, Smell, Feel.
The problem is, some contestants may only submit 1 beer and some may submit a lot more beers.
If contestant #1 submitted only 1 beer but it rated really high in all 4 stats but contestant #2 submitted 6 beers that rated fairly high in all stats, if I just averaged for each contestant, #1 would win. In this situation it should be taken into account that contestant #2 submitted 6 beers in the same time frame.
I'm looking for an algorithm or rating system that takes into account the quantity as well. Or even if the elo system could work in this situation, some help on how to tweak / use it properly to balance the competition considering some contestants may have less submissions than others.