I understand such solutions.
A software engineer, but also a lover of artificial intelligence and video game developer – Daniel West – created a sorting machine for LEGO blocks made of … LEGO blocks. Universal LEGO Sorting Machine, because that is its name, can sort any type of famous blocks according to their category, placing them in one of 18 containers.
Universal LEGO Sorting Machine was created from more than 10,000 LEGO bricks, and additionally contains, among others, 6 LEGO engines, 9 servos and Raspberry Pi. What's more, artificial intelligence helps in the sorting process.
And what does this process look like? Of course, first place the blocks to be sorted in the appropriate part of the machine. These are then transported by belt conveyors to the vibrating feeder, which ensures a constant, even flow of blocks to the machine's scanner.
Then the camera of the sorting machine records the image of blocks passing through the scanner, and Raspberry Pi processes the recorded material and sends it to Daniel West's laptop. With the help of artificial intelligence in the form of a convolution neural network, images of blocks from this material are classified into different categories. Ultimately, SI sends the results of its work to a machine that directs individual blocks to different containers.
Universal LEGO Sorting Machine identifies and assigns one brick every two seconds to the appropriate container. So she doesn't work too fast, but for it can sort absolutely all types of blocks from the catalog of a Danish company.
Daniel West managed to quickly train the artificial intelligence of the machine thanks to three-dimensional models of LEGO blocks available on various websites such as Rebrickable. The universality of these models meant that photos of real bricks were enough to improve the algorithm.
Source: Daniel West