Brick Insights Sets Statistics FAQ

FAQ

Building this site means making a lot of small, invisible decisions. Lets make them visible.

Let's start with the most important question.
Are all reviewers here?

No. So far I've found 106 reviewers of interest, and out of those I've checked 71. Some didn't make the cut - 37 to be exact. You can follow along on this Trello card. Here's my current progress:

General questions

What is Brick Insights?

Brick Insights is a review aggregator for LEGO sets. We gather reviews from all over the net and bundle them together on a single set page. By doing this we hope to tell you if a set is good or not, so you can figure out if it's worth your money.

Why did you create this site?

It started with me walking through the store and looking at some sets, and I kept asking myself if I should buy it. I made some initial mockups called shouldibuythisset.com, where I discovered a few important factors, and reviews were a huge part. It all went from there.

Have you had any inspiration building this site?

Most definitely! The initial direction is greatly inspired by game review aggregator OpenCritic, and much functionality is shamelessly copied from that site and adjusted to work for LEGO sets.

Are you a statistician?

No, I'm just a LEGO nerd doing my best. If I've made any errors, please let me know!

How can I support the site?

The #1 thing that you can do to support Brick Insights is to let me you know you like it. Tell me what I do well and what I can do better on communities like /r/lego, Eurobricks and Flickr.

The #2 thing is to tell other people about the site and keep coming back.

The #3 thing is to write reviews. On your blog, on forums, on community sites - we need reviews for this site to be interesting. Make them thoughtful, make them as critical as they need to be.

That might sound silly, but Brick Insights is a very personal project. Little things like page views are small in isolation, but in aggregation, they help me learn and validate if I'm moving in the right direction with this site.

If you like what I'm doing so much you're interested in making a financial contribution someway, reach out to me at hello@brickinsights.com and we'll discuss it. Much appreciated!

Scores and calculations

What does it take for a set to get a score?

At least two scored reviews. This means a set can have reviews without being scored. We discovered that individual reviewers skewed the comparison if we a set only needed one scored review. We might tweak this number as we go along.

Are non-numeric reviews taken into account in the scores?

No, they're not. Sites like Rebrickable and The Brother's Brick that doesn't issue a score are not used when calculating the rating - only explicit scores are.

Some reviewers have letter gradings. How are these converted?

Indeed, some reviewers prefer letter gradings. I had discussions with Just2Good, a prolific reviewer who uses these, and we decided the following conversion would be suitable:

  • A+ = 100
  • A = 90
  • B+ = 80
  • B = 70
  • C+ = 60
  • C = 50
  • D+ = 40
  • D = 30
  • F = 20

In our index the following reviewers use letter grading as their primary method of rating: Just2Good.

Why are the sets marked as yellow, red and green?

It's an indication of how good they are, statistically speaking. Here's our article on statistical distribution in the LEGO world.

What does PPP and PPM mean? Why are they useful?

PPP stands for Price Per Part. PPM stands for Price Per Minifig. Different figs and parts have different costs, but these values can be good indicators as to whether or not you get the most for your money.

How do you calculate PPP and PPM?

A set needs to have at least 5 parts and a retail price. Once we have that, we simply divide the price with the number of parts.

Why is PPP and PPM in USD?

Convenience. The site could calculate PPP and PPM for all known currencies, but that would lead to us showing 24 different results which would clutter the set page. We might revisit this decision later on, but having these values in USD gives a good enough overview for now.

The reviewers

What does it take for my site to be included here?

It's an investment to build the technology to get your reviews on Brick Insights, so we're looking for sites that are into this for the long haul. If you've reviewed sets for 6+ months, have more than 10-20 reviews and create good reviews™ you're welcome to get in touch. Bonuses: if your site has a good API it's much easier to get the information, but it's possible to work around that.

What is a good review™?

A good review™ is well written, use well-lit and clear images, and is more than just a description of the set - it contains a well-expressed opinion. A review does not need to contain a score. Some leeway are given to older sets where reviews are rare.

In addition to this, we currently only accept reviews written in English. If we figure out a good way we'd love to add other languages as well in the future.

Do you accept forums?

Forums are tricky, since the quality varies wildly between posts. At this point in time we only accept forums that have programs to help people become better reviewers. At this moment that's only Eurobricks, and even then we only index good reviews™ as described above.

Where can I find a list of all reviewers?

Can a reviewer have multiple reviews for each set?

Yes, if they represent two different authors and viewpoints. This is common for forums like Eurobricks, for instance, but less likely to happen for magazines and blogs like Bricknerd.

Some reviewers represent multiple reviews. Why?

Brickset, Amazon, Brickpicker and LEGO Shop are examples of this. We do it for two reasons: pragmatism and community bias. We can't extract individual reviews from all of them, and as such it's better to handle all such sites similarly. Brickset, for instance, allows us to extract all reviews individually, but Amazon does not - but they both get to contribute one score. A positive side effect of this is that the score thus represents what the community on a particular site thinks about the set, and prevents a single community to completely dominate the average score.

Credits

Where does the set data come from?

When it comes to set data, images and categorisation Brickset is the place to go. All set data is used from them, imported daily via their API. It's a fantastic site that made this one possible, so go there and check it out!

Where does the reviews come from?

From people like you and me, through various sources. Check out our reviewer list for details. I'm eternally grateful for all of them! It's hard to write great reviews - they deserve all the credit they can get.

You've got some neat icons - where did you get them?

Most of them are from Iconmnstr. Some are from the Noun Project. Both are excellent resources.

Who are you, mysterious FAQ-man?

I'm Linus! A Swedish web guy who also happens to be an AFOL.