Brick Insights Sets Statistics FAQ

FAQ

Building this site means making a lot of small, invisible decisions. Lets make them visible.

Let's start with the most important question.
Are all reviewers here?

No. So far I've found 117 reviewers of interest, and out of those I've checked 77. Some didn't make the cut - 35 to be exact. You can follow along on this Trello card. Here's my current progress:

General questions

What is Brick Insights?

Brick Insights is a review aggregator for LEGO sets. We gather reviews from all over the net and bundle them together on a single set page. By doing this we hope to tell you if a set is good or not, so you can figure out if it's worth your money.

Why did you create this site?

It started with me walking through the store and looking at some sets, and I kept asking myself if I should buy it. I made some initial mockups called shouldibuythisset.com, where I discovered a few important factors, and reviews were a huge part. It all went from there.

Have you had any inspiration building this site?

Most definitely! The initial direction is greatly inspired by game review aggregator OpenCritic, and much functionality is shamelessly copied from that site and adjusted to work for LEGO sets.

Are you a statistician?

No, I'm just a LEGO nerd doing my best. If I've made any errors, please let me know!

How can I support the site?

The #1 thing that you can do to support Brick Insights is to let me you know you like it. Tell me what I do well and what I can do better on communities like /r/lego, Eurobricks and Flickr.

The #2 thing is to tell other people about the site and keep coming back.

The #3 thing is to write reviews. On your blog, on forums, on community sites - we need reviews for this site to be interesting. Make them thoughtful, make them as critical as they need to be.

All of these things are small. It might sound silly, but Brick Insights is a very personal project. Little things like page views are small in isolation, but in aggregation, they help me learn and validate if I'm moving in the right direction with this site.

If you like what I'm doing so much you're interested in making a financial contribution someway, reach out to me at hello@brickinsights.com and we'll discuss it. Much appreciated!

Is this site making you rich?

Hah! No, not at all. It costs me money every month, but I enjoy working on it so that's okay. I get a small commission when you buy things after clicking on links to Amazon and LEGO Shop, which help cover some costs. So please do that! :)

Scores and calculations

What does it take for a set to get a score?

At least two scored reviews. This means a set can have reviews without being scored. We discovered that individual reviewers skewed the comparison if a set only needed one scored review. We might tweak this number as we go along.

Are non-numeric reviews taken into account in the scores?

No, they're not. Sites like Rebrickable and The Brother's Brick that doesn't issue a score are not used when calculating the rating - only explicit scores are.

Some reviewers have letter gradings. How are these converted?

Indeed, some reviewers prefer letter gradings. I had discussions with Just2Good, a prolific reviewer who uses these, and we decided the following conversion would be suitable:

  • A+ = 100
  • A = 90
  • B+ = 80
  • B = 70
  • C+ = 60
  • C = 50
  • D+ = 40
  • D = 30
  • F = 20

On Brick Insights, the following reviewers use letter grading as their primary method of rating: Just2Good.

Why are ratings marked as yellow, red and green?

It's an indication of how good they are, statistically speaking. Here's our article on statistical distribution in the LEGO world.

How can you tell if a review is a recommendation or not?

Oh boy, it wasn't easy to figure out a good way to do this! Brick Insights consider a review a recommendation if:

  • The set is explicitly and without reservations recommended in the review, or
  • If the score given is significantly higher than the median score given by that reviewer

If we couldn't figure it out - yet - we mark the review as "Unknown" and don't include it in our recommended by % reviewers calculation. Here are the possible recommendation types:

  • Unknown
  • Recommended: reviewer explicitly recommends this set
  • Indifference: reviewer neither explicitly says recommend or avoid
  • Avoid: reviewer explicitly dislikes this set
  • Recommended: reviewer scored this set significantly higher than usual
  • Indifference: reviewer scored this set around their average
  • Avoid: reviewer scored this set lower than usual

My goal with this feature is to find the really awesome sets. It should be pretty difficult to get a recommended rating, so expect this to be tweaked as we go along.

Why aren't all reviews marked as recommended/not recommended?

Time! I added that feature in 2019, after importing a huge number of reviews. I've updated all reviews for sets from 2019 and forward, but doing so for all reviews - ever - is simply too time consuming. Sets with a score is calculated as recommended or not automatically, however.

What does PPP and PPM mean? Why are they useful?

PPP stands for Price Per Part. PPM stands for Price Per Minifig. Different figs and parts have different costs, but these values can be valuable indicators as to whether or not you get the most for your money.

How do you calculate PPP and PPM?

A set needs to have at least 5 parts and a retail price. Once we have that, we simply divide the price with the number of parts.

The same is done for minifigs.

Why is PPP and PPM in USD?

Convenience. The site could calculate PPP and PPM for all known currencies, but that would lead to us showing 24 different results which would clutter the set page. We might revisit this decision later on, but having these values in USD gives a good enough overview for now.

What values are adjusted for inflation? How? And what does that mean?

Since late 2019 Brick Insights also display older monetary values adjusted to inflation. If you don't know what inflation is, it's basically a way to say that money changes value over time. Say you paid $20 for something in 2017. In 2018, that same item might cost $21 or $19 depending on inflation. Here's a good article if you want to understand what this means and how to calculate it. Think of inflation adjusted values on Brick Insights as what would this set cost if I wanted to buy it today. This is the value we use when we calculate the average for each category and explore LEGO cost over time.

For all of you savvy types, we use the yearly average from this site which is collected from the US Bureau of Labor Statistics.

The reviewers

What does it take for my site to be included here?

It's an investment to build the technology to get your reviews on Brick Insights, so we're looking for sites that are into this for the long haul. If you've reviewed sets for 6+ months, have more than 10-20 reviews and create good reviews™ you're welcome to get in touch. Bonuses: if your site has a good API it's much easier to get the information, but it's possible to work around that.

What is a good review™?

A good review™ is well written, use well-lit and clear images, and is more than just a description of the set - it contains a well-expressed opinion. A review does not need to contain a score. Some leeway are given to older sets where reviews are rare.

In addition to this, we currently only accept reviews written in English. If we figure out a good way we'd love to add other languages as well in the future.

Do you accept forums?

Forums are tricky, since the quality varies wildly between posts. At this point in time we only accept forums that have programs to help people become better reviewers. At this moment that's only Eurobricks, and even then we only index good reviews™ as described above.

Where can I find a list of all reviewers?

Can a reviewer have multiple reviews for each set?

Yes, if they represent two different authors and viewpoints. This is common for forums like Eurobricks, for instance, but less likely to happen for magazines and blogs like Bricknerd.

Some reviewers represent multiple reviews. Why?

Brickset, Amazon, Brickpicker and LEGO Shop are examples of this. We do it for two reasons: pragmatism and community bias. We can't extract individual reviews from all of them, and as such it's better to handle all such sites similarly. Brickset, for instance, allows us to extract all reviews individually, but Amazon does not - but they both get to contribute one score. A positive side effect of this is that the score thus represents what the community on a particular site thinks about the set, and prevents a single community from completely dominating the average score.

Credits

Where does the set data come from?

When it comes to set data, images and categorisation Brickset is the place to go. All set data is used from them, imported daily via their API. It's a fantastic site that made this one possible, so go there and check it out!

We add additional data from a couple of other sources as well, most notably lego.com, Bricklink and Amazon.

Where does the reviews come from?

From people like you and me, through various sources. Check out our reviewer list for details. I'm eternally grateful for all of them! It's hard to write great reviews - they deserve all the credit they can get.

You've got some neat icons - where did you get them?

Most of them are from Iconmnstr. Some are from the Noun Project. Both are excellent resources.

Who are you, mysterious FAQ-man?

I'm Linus! A Swedish web guy who also happens to be an AFOL.