A group of Russian and Italian scientists have created a neural network based on polymeric memristors — devices that can potentially be used to build fundamentally new computers
Scientists from the Kurchatov Institute, MIPT, the University of Parma (Italy), Moscow State University, and Saint Petersburg State University have created a neural network based on polymeric memristors – devices that can potentially be used to build fundamentally new computers. According to the researchers, these developments will primarily help in creating systems for machine vision, hearing, and other sensory organs, and also intelligent control systems for various devices, including autonomous robots.
The authors of the new study focused on a promising area in the field of memristive neural networks – polymer-based memristors – and discovered that creating even the simplest perceptron is not that easy. In fact, it is so difficult that up until the publication of their paper in the journal Organic Electronics, there were no reports of any successful experiments (using organic materials). The experiments conducted at the Nano-, Bio-, Information and Cognitive Sciences and Technologies (NBIC) centre at the Kurchatov Institute by a joint team of Russian and Italian scientists demonstrated that it is possible to create very simple polyaniline-based neural networks. Furthermore, these networks are able to learn and perform specified logical operations.
A memristor is an electric element similar to a conventional resistor. The difference between a memristor and a traditional element is that the electric resistance in a memristor is dependent on the charge passing through it, therefore it constantly changes its properties under the influence of an external signal: a memristor has a memory and at the same time is also able to change data encoded by its resistance state! In this sense, a memristor is similar to a synapse – a connection between two neurons in the brain that is able, with a high level of plasticity, to modify the efficiency of signal transmission between neurons under the influence of the transmission itself. A memristor enables scientists to build a “true” neural network, and the physical properties of memristors mean that at the very minimum they can be made as small as conventional chips.
Some estimates indicate that the size of a memristor can be reduced up to ten nanometers, and the technologies used in the manufacture of the experimental prototypes could, in theory, be scaled up to the level of mass production. However, as this is “in theory”, it does not mean that chips of a fundamentally new structure with neural networks will be available on the market any time soon, even in the next five years.
The plastic polyaniline was not chosen by chance. Previous studies demonstrated that it can be used to create individual memristors, so the scientists did not have to go through many different materials. Using a polyaniline solution, a glass substrate, and chromium electrodes, they created a prototype with dimensions that, at present, are much larger than those typically used in conventional microelectronics: the strip of the structure was approximately one millimeter wide (they decided to avoid miniaturization for the moment). All of the memristors were tested for their electrical characteristics: it was found that the current-voltage characteristic of the devices is in fact non-linear, which is in line with expectations. The memristors were then connected to a single neuromorphic network.
A current-voltage characteristic (or IV curve) is a graph where the horizontal axis represents voltage and the vertical axis the current. In conventional resistance, the IV curve is a straight line; in strict accordance with Ohm’s Law, current is proportional to voltage. For a memristor, however, it is not just the voltage that is important, but the change in voltage: if you begin to gradually increase the voltage supplied to the memristor, it will increase the current passing through it not in a linear fashion, but with a sharp bend in the graph and at a certain point its resistance will fall sharply.
Then if you begin to reduce the voltage, the memristor will remain in its conducting state for some time, after which it will change its properties rather sharply again to decrease its conductivity. Experimental samples with a voltage increase of 0.5V hardly allowed any current to pass through (around a few tenths of a microamp), but when the voltage was reduced by the same amount, the ammeter registered a figure of 5 microamps. Microamps are of course very small units, but in this case it is the contrast that is most significant: 0.1 ?A to 5 ?A is a difference of fifty times! This is more than enough to make a clear distinction between the two signals.
After checking the basic properties of individual memristors, the physicists conducted experiments to train the neural network. The training (it is a generally accepted term and is therefore written without inverted commas) involves applying electric pulses at random to the inputs of a perceptron. If a certain combination of electric pulses is applied to the inputs of a perceptron (e.g. a logic one and a logic zero at two inputs) and the perceptron gives the wrong answer, a special correcting pulse is applied to it, and after a certain number of repetitions all the internal parameters of the device (namely memristive resistance) reconfigure themselves, i.e. they are “trained” to give the correct answer.
The scientists demonstrated that after about a dozen attempts their new memristive network is capable of performing NAND logical operations, and then it is also able to learn to perform NOR operations. Since it is an operator or a conventional computer that is used to check for the correct answer, this method is called the supervised learning method.
Needless to say, an elementary perceptron of macroscopic dimensions with a characteristic reaction time of tenths or hundredths of a second is not an element that is ready for commercial production. However, as the researchers themselves note, their creation was made using inexpensive materials, and the reaction time will decrease as the size decreases: the first prototype was intentionally enlarged to make the work easier; it is physically possible to manufacture more compact chips. In addition, polyaniline can be used in attempts to make a three-dimensional structure by placing the memristors on top of one another in a multi-tiered structure (e.g. in the form of random intersections of thin polymer fibers), whereas modern silicon microelectronic systems, due to a number of technological limitations, are two-dimensional. The transition to the third dimension would potentially offer many new opportunities.
What do we mean by “fundamentally different computers”?
The Latest on: Memristive neural networks
via Google News
The Latest on: Memristive neural networks
- Storage Pioneer on What the Future Holds for In-Memory AIon January 18, 2021 at 11:42 am
In five years or so, what I would like to see is the emergency of non-volatile memristive technology, probably as low power consumption inference engines for many edge applications. I also see more ...
- Luke Jameson January 12, 2021 at 10:20 pm
Luke James is a core contributing tech journalist with All About Circuits and Electronics Point, where he covers cybersecurity, IoT, and machine learning trends. He graduated from the University of ...
- Neural networks : the official journal of the International Neural Network Societyon January 2, 2021 at 4:00 pm
Effect of diverse recoding of granule cells on optokinetic response in a cerebellar ring network with synaptic plasticity.
- Building Memristors For Neural Netson December 11, 2020 at 4:00 pm
Thirty years ago, neural nets on a chip were created by a few companies around Boston, until someone realized these neural nets could be simulated on a desktop PC much more efficiently.
- What is neuromorphic computing? Everything you need to know about how it is changing the future of computingon December 8, 2020 at 11:16 am
Spiking neural networks can convey information in both ... is one way to allow the brain-based systems to learn. Along with memristive technologies, including phase change memory, resistive ...
- Recent Newson March 22, 2019 at 1:56 pm
The paper, titled "Neuromorphic SLAM Architecture Using Gated-Memristive Synapses," explores the use of ... The paper discusses random weights in convolutional neural networks and will be presented at ...
via Bing News