卒業生とその進路

Physical Computing Systems: Theory, Implementation and Functionality


カン ショウカ

2023 年度 卒 /博士(工学)
令和4〜5年度 日本学術振興会特別研究員

博士論文の概要

Unconventional computing (UC) is a novel formalism as a post-Moore solution that stems from a perspective of smaller, faster, and more energy-efficient methodology. Exploring unbounded physical phenomena serving as computing resources is the main goal of UC research, but it is difficult to take these findings as guidelines due to the diversity of physical phenomena and the lack of a unified paradigm. Before UC formalism can grow and refine into a unified formal theory, it is necessary to explore the computational paradigms available for existing physical devices, but the most important aim should be providing guidance for future system design. One UC paradigm that utilizes dynamic systems, reservoir computing, is widely discussed due to its arbitrary and diverse physical implementations. An important objective of this paper is to comprehensively analyze different schemes of RC structure design and nonlinear function selection, and to observe their respective effects on information processing. The ultimate purpose is to validate the usability of proposing schemes and design rule, then develop a small, simple, fast and low power-consumption physical device based on them. Additionally, attempts to find a suitable UC paradigm for existing devices according to their own characteristics is also necessary for future system design.

First, I defined a simple structure of reservoir from its mathematical definition matrix and give it the simplest form of realization, that is, one pair of diodes. Instead of treating RC as a ”black box” like most schemes of physical RC design, I realized a simple controllable physical system by external parameters so as to provide I-V curve of diodes with dynamics and to observe their effects. This scheme originates from the design idea of independent processing nodes, and on this basis, the influence of nonlinear function of processing node and node arrangement structure are explored respectively. Nodes structure has greater effects on NARMA2 task, short-term memory capacity task and classification task than its nonlinear function. A large number of random and strong connections between nodes ensure the echo state duration of original information in the network, which is conducive to short-term memory capacity and tasks requiring high memory capacity but interferes with the classification of processed information. Reservoir with sparser and weaker connections on the other hand solves both NARMA2 task and classification task well. Our parallel-group structure works the same with such network in the performance of both NARMA2 and classification task, indicating that a sparse interconnectivity of all nodes that are commonly accepted in reservoir can be replaced by regular connections of segmental nodes. Besides, even parallel-node structure showed acceptable accuracy on classification task, although it could not solve the NARMA task well. This opens up a new path for the design and selection of physical RC systems in the future because the parameters of the parallel structure are directly reflected in the definition matrix of reservoir and thus can be better correlated with inherent parameters of the physical system, facilitating the adjustment and control of the system.

Then, a new physical device, sets of planar parallel electrodes, is designed based on the parallel structure to further verify its practicability. The size and distribution of the electrodes cannot be changed, which means that the structure of the reservoir is fixed. Solution that dripped to the surface of the electrodes provides different nonlinear functions owing to their specific I-V characteristic, and the slightly different electrochemical reactions occurred on different electrodes act as the feedback gain of processing nodes. It is shown in short-term memory capacity results that no matter what solution is added on the surface, there is a certain degree of interaction between the adjacent electrodes, which implies the feedforward gain in the parallel-group structure described. Therefore this device exhibited a prediction error matching that of parallel-group structure in the same NARMA2 task. Compared to distilled water, solution with complex REDOX reactions display more dynamical I-V characteristics, which aid in reproduction of periodic signals but pose a challenge in solving higher-order nonlinear problems. In the approximation of those higher-order nonlinear problems, protons contribute greatly to the computational power of this system. This is concluded because system lost computing power when the solvent was replaced by nonprotonic solvent.

Next I demonstrated how to apply appropriate UC paradigm to existing physical systems based on their own characteristics. I explored the feasibility of performing stochastic computing paradigm on a SWNT/POM network with stochastic transfer process of charges inside. At the level of real device, the magnitude of output current was controlled by the voltage on the grid under the condition of a stable source-drain voltage. The output current showed sinusoidal under the control voltage of sinusoidal excitation. In addition, the spike density of the output current increased with the number of times applying the gate voltage of the same magnitude. Above observations are realized in experiment and the results are repeatable. On the simulation level, I achieved the gradual growth or decay of the current spike density along epoch with big VG or small VG Each epoch includes 3 clock cycles for input stimulus and 256 clock cycles for weights updating. Such results show a great potential of SWNT/POM network device to replace encoders, decoders and memory in fully-implemented hardware circuits for stochastic computing. Then I explored how to use the improved readout circuit on a dopant network (i.e., boron dopants in silicon) generating memory effect to process temporal and spatial signals. It is found that the dopant network has a similar effect on spatio-temporal signal processing as the maximum pooling operation, thus the data processed by dopant network can be used directly on linear classifier. The number of neurons required for classification is much smaller than the size of convolutional neural networks, representing the great advantage of dopant network as a convolution kernel.

Overall, the performed research has provided new insights into the design and utilization of physical computing systems. Starting from simple design principle and small device, the theory of UC is explored and supplemented, and a different way is pointed out for the future system design and development. The design and assessment of different physical UC schemes can be improved based on the outcome of this research.

学術論文

  1. Kan S., Asai T., Nakajima K., and Akai-Kasaya M., "Physical implementation of reservoir computing through electrochemical reaction," Advanced Science, vol. 9, no. 6, 2104076 (2022).
  2. Akai-Kasaya M., Takeshima Y., Kan S., Nakajima K., Oya T., and Asai T., "Performance of reservoir computing in a random network of single-walled carbon nanotubes complexed with polyoxometalate," Neuromorphic Computing and Engineering, vol. 2, no. 1, 014003 (2022).
  3. Kan S., Sasaki Y., Asai T., and Akai-Kasaya M., "Applying a molecular device to stochastic computing operation for a hardware AI system design," Journal of Signal Processing, vol. 25, no. 6, pp. 221-225 (2021).
  4. Kan S., Nakajima K., Takeshima Y., Asai T., Kuwahara Y., and Akai-Kasaya M., "Simple reservoir computing capitalizing on the nonlinear response of materials: Theory and physical implementations," Physical Review Applied, vol. 15, no. 2, 024030 (2021).
  5. Yi C., Li Y., Hai Z., Li Y., Kan S., Chen J., Chen X., Zhuiykov S., Cui D., and Xue C., "Facile-synthesized NiCo2O4@MnMoO4 with novel and functional structure for superior performance supercapacitors," Applied Surface Science, vol. 452, pp. 413-422 (2018).

招待講演/セミナー

  1. Hagiwara N., Kan S., Asai T., and Akai-Kasaya M., "Construction of a neural network using organic materials and ions," The 29th International Workshop on Active-Matrix Flatpanel Displays and Devices (AM-FPD), Ryukoku University Avanti Kyoto Hall, (On line), Japan (Jul. 5-8, 2022).
  2. Hagiwara N., Kan S., Asai T., and Akai-Kasaya M., "Construction of a neural network using organic materials and ions," Proceeding:The 29th International Workshop on Active-Matrix Flatpanel Displays and Devices (AM-FPD), pp. 86-89, Ryukoku University Avanti Kyoto Hall, (On line), Japan (Jul. 5-8, 2022).
  3. Kan S., Nakajima K., Asai T., and Akai-Kasaya M., "Simple reservoir computing capitalizing on the nonlinear response of materials: theory and physical implementations," Joint Symposium of JSPS-DST Bilateral Research on Charge- and Spin-Blockade in Ultrathin-Layers of Single Molecule Magnets, online, Japan (Feb. 24, 2021).

国際会議

  1. Kan S., "Dopant-atom network processing unit serves as convolution kernels," In-material Computing Workshop for Young Researchers, p. 16, O-4, Hokkaido Jichiro Kaikan, Sapporo, Japan (Nov. 14, 2023).
  2. Kan S., Sasaki Y., Asai T., and Akai-Kasaya M., "Applying a molecular device to stochastic computing operation for a hardware AI system design," RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing 2021, pp. 49-52, Online (Mar. 1-3, 2021).
  3. Kan S., Nakajima K., Asai T., and Akai-Kasaya M., "Reservoir computing properties in spiking neural network models with modular topology," The 9th RIEC International Symposium on Brain Functions and Brain Computer, Online, Japan (Dec. 5, 2020).
  4. Kan S., Nakajima K., Asai T., and Akai-Kasaya M., "Availability of nonlinear response of materials using in the construction of simple reservoir computing," 2020 International Symposium on Nonlinear Theory and Its Applications, pp. 489-492, Online, Japan (Nov. 16-19, 2020).

受賞

  1. Kan S., "Dopant-atom network processing unit serves as convolution kernels," インマテリアルコンピューティング若手研究会 - 優秀ポスター賞, Nov. 14, 2023.
  2. Kan S., 令和5年度北海道大学大学院情報科学院 - 学院長賞(博士), 2023年9月25日.
  3. Kan S., 2022 Chinese Government Award for Outstanding Self-financed Students Abroad - China Scholarship Council, Jul. 4, 2023.
  4. Kan S., "Novel architecture design of echo state network and performance analysis of information processing," 第10回分子アーキテクトニクス研究会 - 若手優秀講演賞, 2019年11月8日.

国内学会

  1. Kan Shaohua, 中嶋 浩平, 浅井 哲也, 赤井 恵, "A physical system that enables reservoir computing through electrochemical reactions," In-Materio Neuromorphic Computing, Nambu Yoichiro Hall, Osaka University, (On line), 2022年7月27日.
  2. Kan Shaohua, ⽵嶌 勇樹, 中嶋 浩平, 浅井 哲也, 赤井 恵, "An Electrochemical Reaction Reservoir Computing realized by Multiple Data Acquisition System," 第68回応用物理学会春季学術講演会, (オンライン開催), 2021年3月16-19日.
  3. Kan Shaohua, 中嶋 浩平, 浅井 哲也, 赤井 恵, "Availability of nonlinear response of materials using in the construction of simple reservoir computing," 第81回応用物理学会秋季学術講演会, 9p-Z28-11, (オンライン開催), 2020年9月8-11日.
  4. Kan Shaohua, 中嶋 浩平, 浅井 哲也, 赤井 恵, "Availability of nonlinear response of materials using in the construction of simple reservoir computing," 電子情報通信学会複雑コミュニケーションサイエンス研究会, (オンライン開催), 2020年8月3-4日.
  5. ⽵嶌 勇樹, Kan Shaohua, 桑原 裕司, 中嶋 浩平, 浅井 哲也, 赤井 恵, "ポリ酸溶液を用いたリザーバコンピューティング," 第67回応用物理学会春季学術講演会, 上智大学四谷キャンパス, (東京), 2020年3月12-15日.
  6. Kan Shaohua, 中嶋 浩平, 浅井 哲也, 赤井 恵, "Novel architecture design of echo state network and performance analysis of information processing," 第10回分子アーキテクトニクス研究会, P-24, 九州国立博物館, (福岡), 2019年11月7-8日.