A group of Russian and Italian scientists have created a neural network based on polymeric memristors — devices that can potentially be used to build fundamentally new computers
Scientists from the Kurchatov Institute, MIPT, the University of Parma (Italy), Moscow State University, and Saint Petersburg State University have created a neural network based on polymeric memristors – devices that can potentially be used to build fundamentally new computers. According to the researchers, these developments will primarily help in creating systems for machine vision, hearing, and other sensory organs, and also intelligent control systems for various devices, including autonomous robots.
The authors of the new study focused on a promising area in the field of memristive neural networks – polymer-based memristors – and discovered that creating even the simplest perceptron is not that easy. In fact, it is so difficult that up until the publication of their paper in the journal Organic Electronics, there were no reports of any successful experiments (using organic materials). The experiments conducted at the Nano-, Bio-, Information and Cognitive Sciences and Technologies (NBIC) centre at the Kurchatov Institute by a joint team of Russian and Italian scientists demonstrated that it is possible to create very simple polyaniline-based neural networks. Furthermore, these networks are able to learn and perform specified logical operations.
A memristor is an electric element similar to a conventional resistor. The difference between a memristor and a traditional element is that the electric resistance in a memristor is dependent on the charge passing through it, therefore it constantly changes its properties under the influence of an external signal: a memristor has a memory and at the same time is also able to change data encoded by its resistance state! In this sense, a memristor is similar to a synapse – a connection between two neurons in the brain that is able, with a high level of plasticity, to modify the efficiency of signal transmission between neurons under the influence of the transmission itself. A memristor enables scientists to build a “true” neural network, and the physical properties of memristors mean that at the very minimum they can be made as small as conventional chips.
Some estimates indicate that the size of a memristor can be reduced up to ten nanometers, and the technologies used in the manufacture of the experimental prototypes could, in theory, be scaled up to the level of mass production. However, as this is “in theory”, it does not mean that chips of a fundamentally new structure with neural networks will be available on the market any time soon, even in the next five years.
The plastic polyaniline was not chosen by chance. Previous studies demonstrated that it can be used to create individual memristors, so the scientists did not have to go through many different materials. Using a polyaniline solution, a glass substrate, and chromium electrodes, they created a prototype with dimensions that, at present, are much larger than those typically used in conventional microelectronics: the strip of the structure was approximately one millimeter wide (they decided to avoid miniaturization for the moment). All of the memristors were tested for their electrical characteristics: it was found that the current-voltage characteristic of the devices is in fact non-linear, which is in line with expectations. The memristors were then connected to a single neuromorphic network.
A current-voltage characteristic (or IV curve) is a graph where the horizontal axis represents voltage and the vertical axis the current. In conventional resistance, the IV curve is a straight line; in strict accordance with Ohm’s Law, current is proportional to voltage. For a memristor, however, it is not just the voltage that is important, but the change in voltage: if you begin to gradually increase the voltage supplied to the memristor, it will increase the current passing through it not in a linear fashion, but with a sharp bend in the graph and at a certain point its resistance will fall sharply.
Then if you begin to reduce the voltage, the memristor will remain in its conducting state for some time, after which it will change its properties rather sharply again to decrease its conductivity. Experimental samples with a voltage increase of 0.5V hardly allowed any current to pass through (around a few tenths of a microamp), but when the voltage was reduced by the same amount, the ammeter registered a figure of 5 microamps. Microamps are of course very small units, but in this case it is the contrast that is most significant: 0.1 ?A to 5 ?A is a difference of fifty times! This is more than enough to make a clear distinction between the two signals.
After checking the basic properties of individual memristors, the physicists conducted experiments to train the neural network. The training (it is a generally accepted term and is therefore written without inverted commas) involves applying electric pulses at random to the inputs of a perceptron. If a certain combination of electric pulses is applied to the inputs of a perceptron (e.g. a logic one and a logic zero at two inputs) and the perceptron gives the wrong answer, a special correcting pulse is applied to it, and after a certain number of repetitions all the internal parameters of the device (namely memristive resistance) reconfigure themselves, i.e. they are “trained” to give the correct answer.
The scientists demonstrated that after about a dozen attempts their new memristive network is capable of performing NAND logical operations, and then it is also able to learn to perform NOR operations. Since it is an operator or a conventional computer that is used to check for the correct answer, this method is called the supervised learning method.
Needless to say, an elementary perceptron of macroscopic dimensions with a characteristic reaction time of tenths or hundredths of a second is not an element that is ready for commercial production. However, as the researchers themselves note, their creation was made using inexpensive materials, and the reaction time will decrease as the size decreases: the first prototype was intentionally enlarged to make the work easier; it is physically possible to manufacture more compact chips. In addition, polyaniline can be used in attempts to make a three-dimensional structure by placing the memristors on top of one another in a multi-tiered structure (e.g. in the form of random intersections of thin polymer fibers), whereas modern silicon microelectronic systems, due to a number of technological limitations, are two-dimensional. The transition to the third dimension would potentially offer many new opportunities.
What do we mean by “fundamentally different computers”?
The Latest on: Memristive neural networks
via Google News
The Latest on: Memristive neural networks
- Neural networks : the official journal of the International Neural Network Societyon February 28, 2021 at 4:00 pm
Approximate neural optimal control with reinforcement learning for a torsional pendulum device.
- Chaos (Woodbury, N.Y.)on February 26, 2021 at 4:01 pm
Double excitation multi-stability and multi-pulse chaotic vibrations of a bistable asymmetric laminated composite square panels under foundation force. Publisher's Note: "Predicting phase and ...
- Building Memristors For Neural Netson February 24, 2021 at 4:00 pm
Thirty years ago, neural nets on a chip were created by a few companies around Boston, until someone realized these neural nets could be simulated on a desktop PC much more efficiently.
- Bioinspired multisensory neural network with crossmodal integration and recognitionon February 18, 2021 at 3:10 am
The integration and interaction of vision, touch, hearing, smell, and taste in the human multisensory neural network facilitate high-level cognitive functionalities, such as cross ...
- Design of defect-chemical properties and device performance in memristive systemson February 3, 2021 at 4:00 pm
all being milestones in assembles of global networks such as internet of things and creation of artificial intelligence. Memristive cells are energy efficient and scalable to almost atomic level, ...
- Transiently chaotic simulated annealing based on intrinsic nonlinearity of memristors for efficient solution of optimization problemson February 2, 2021 at 4:00 pm
Besides, other neural network hardware based on memristive devices have also been demonstrated, including long short-term memory (13), reinforcement learning (14), and Hopfield networks for ...
- Integrated neuromorphic computing networks by artificial spin synapses and spin neuronson January 28, 2021 at 11:53 pm
One long-standing goal in the emerging neuromorphic field is to create a reliable neural network hardware implementation that has low energy consumption, while providing massively parallel ...
- Neuromorphic Chip Biz Heats Upon January 20, 2021 at 4:00 pm
“With neural networks, you can do things in parallel with efficient ... For its part, CEA-Leti is developing a memristive-based device array for use in spike-based coding. The array is based on a ...
via Bing News