The LEGO brick machine sorts LEGO blocks using AI [wideo]


I understand such solutions.

You can create a lot of amazing constructions from LEGO bricks. All you need is a little imagination, willingness and of course the blocks themselves. We have already seen even built from LEGO full-size Bugatti Chiron. hand prostheses for children whether compatible with USB memory blocks, not to mention all those buildings and vehicles that can be constructed using the default LEGO sets, such as Star Wars Death Star. Nevertheless, the latest creation from Danish blocks beats all previous ones.

A software engineer, but also a lover of artificial intelligence and video game developer – Daniel West – created a sorting machine for LEGO blocks made of … LEGO blocks. Universal LEGO Sorting Machine, because that is its name, can sort any type of famous blocks according to their category, placing them in one of 18 containers.

Universal LEGO Sorting Machine was created from more than 10,000 LEGO bricks, and additionally contains, among others, 6 LEGO engines, 9 servos and Raspberry Pi. What's more, artificial intelligence helps in the sorting process.

And what does this process look like? Of course, first place the blocks to be sorted in the appropriate part of the machine. These are then transported by belt conveyors to the vibrating feeder, which ensures a constant, even flow of blocks to the machine's scanner.

lego sorting out

Then the camera of the sorting machine records the image of blocks passing through the scanner, and Raspberry Pi processes the recorded material and sends it to Daniel West's laptop. With the help of artificial intelligence in the form of a convolution neural network, images of blocks from this material are classified into different categories. Ultimately, SI sends the results of its work to a machine that directs individual blocks to different containers.

sorted blocks

Universal LEGO Sorting Machine identifies and assigns one brick every two seconds to the appropriate container. So she doesn't work too fast, but for it can sort absolutely all types of blocks from the catalog of a Danish company.

Daniel West managed to quickly train the artificial intelligence of the machine thanks to three-dimensional models of LEGO blocks available on various websites such as Rebrickable. The universality of these models meant that photos of real bricks were enough to improve the algorithm.

Source: Daniel West