Iranian Journal of Physics Research

Optimization by classical and quantum reinforced algorithms

Document Type : Review Article

Author

Abolfazl Ramezanpour

Department of Physics, College of Science, Shiraz University, Shiraz 71454, Iran

https://doi.org/10.47176/ijpr.26.1.12229
Abstract
A wide range of fundamental problems in science—including the determination of equilibrium states in physical systems and the training and analysis of neural networks—can be cast as optimization problems. However, the intrinsic complexity of these systems, particularly near critical points and phase transitions, often renders the computation of even approximate solutions highly demanding. Methods originating from statistical physics, especially those developed for the study of disordered and complex systems, have contributed significantly to the development of more efficient computational strategies for such tasks. In this review, we review key concepts and algorithmic approaches inspired by classical and quantum statistical mechanics, with an emphasis on recent theoretical developments and practical applications. Particular attention is devoted to reinforcement-based optimization methods and their role in improving solution quality, as well as the implications of reinforcement mechanisms for noise mitigation in quantum systems. We conclude by outlining several open challenges and promising directions for future research.

Keywords

Optimization
Algorithms
Reinforcement
Subjects
1.       M Mezard, A Montanari. Information, physics, and computation. Oxford University Press (2009).
2.       CH Papadimitriou, K Steiglitz. Combinatorial optimization: algorithms and complexity. Courier Corporation (1998).
3.       S Kirkpatrick, Jr CD Gelatt, MP Vecchi. Science. 220(4598) (1983) 671-80.
4.       E Farhi, J Goldstone, S Gutmann, J Lapan, A Lundgren, D Preda. Science. 292(5516) (2001) 472.
5.       R Monasson, R Zecchina, S Kirkpatrick, B Selman, L Troyansky. Nature. 400(6740) (1999) 133.
6.       M Mézard, G Parisi, R Zecchina.. Science. 297(5582) (2002) 812.
7.       A Braunstein, R Zecchina. Physical review letters. 96(3) (2006) 030201.
8.       HC Nguyen, R Zecchina, J Berg. Advances in Physics. 66(3) (2017) 197.
9.       G Carleo, I Cirac, K Cranmer, L Daudet, M Schuld, N Tishby, L Vogt-Maranto, L Zdeborová. 91(4) (2019) 045002.
10.    M Gabrié, S Ganguli, C Lucibello, R Zecchina. Neural networks: From the perceptron to deep nets. InSpin Glass Theory and Far Beyond: Replica Symmetry Breaking After 40 Years 2023 (pp. 477-497).
11.    F Krzakala, L Zdeborová. Statistical physics methods in optimization and machine learning. Lecture Notes. (2024).
12.    L Zdeborová, F Krząkała. Physical Review E—Statistical, Nonlinear, and Soft Matter Physics. 76(3) (2007) 031131.
13.    F Krzakała, A Montanari, F Ricci-Tersenghi, G Semerjian, L Zdeborová. Proceedings of the National Academy of Sciences. 104(25) (2007) 10318-23.
14.    M Mézard, G Parisi, MA Virasoro. Spin glass theory and beyond: An Introduction to the Replica Method and Its Applications. World Scientific Publishing Company; (1987).
15.    DH Wolpert, WG Macready. IEEE transactions on evolutionary computation. 1(1) (2002) 67-82.
16.    C Baldassi, A Ingrosso, C Lucibello, L Saglietti, R Zecchina. Journal of Statistical Mechanics: Theory and Experiment. 2016(2) (2016) 023301.
17.    F Pittorino, C Lucibello, C Feinauer, G Perugini, C Baldassi, E Demyanenko, R Zecchina. Journal of Statistical Mechanics: Theory and Experiment. 2021(12) (2021) 124015.
18.    C Gerbelot, E Troiani, F Mignacco, F Krzakala, L Zdeborova. SIAM Journal on Mathematics of Data Science. 6(2) (2024) 400-27.
19.    G Biroli, T Bonnaire, V De Bortoli, M Mézard. Nature Communications. 15(1) (2024) 9957.
20.    Y Dandi, L Pesce, L Zdeborová, F Krzakala. arXiv preprint arXiv:2502.13961. (2025).
21.    C Baldassi, A Braunstein, A Ramezanpour, R Zecchina. InMathematical Foundations of Complex Networked Information Systems: Politecnico di Torino, Verrès, Italy 2009 (2015) (pp. 27-49). Cham: Springer International Publishing.
22.    A Maleki. Approximate message passing algorithms for compressed sensing (Doctoral dissertation, Stanford University).
23.    A Montanari, S Sen. Foundations and Trends® in Machine Learning. 17(1) (2024) 1.
24.    MJ Schuetz, JK Brubaker, HG Katzgraber. Nature Machine Intelligence. 4(4) (2022) 367.
25.    O Duranthon, L Zdeborová. arXiv preprint arXiv:2503.01361. (2025).
26.    D Ghio, Y Dandi, F Krzakala, L Zdeborová. Proceedings of the National Academy of Sciences. 121(27) (2024) e2311810121.
27.    S Aranguri, G Biroli, M Mezard, E Vanden-Eijnden. arXiv preprint arXiv:2501.00988. (2025).
28.    A Abbas, A Ambainis, B Augustino, A Bärtschi, H Buhrman, C Coffrin, G Cortiana, V Dunjko, DJ Egger, BG Elmegreen, N Franco. Nature Reviews Physics. (2024) 28:1-8.
29.    LK Grover. Physical Review Letters. 95(15) (2005) 150501.
30.    A Ambainis. ACM Sigact News. 35(2) (2004) 22.
31.    PR Giri, VE Korepin. Quantum Information Processing. 16(12) (2017) 315.
32.    E Farhi, J Goldstone, S Gutmann. arXiv preprint arXiv:1411.4028. (2014).
33.    L Zhou, ST Wang, S Choi, H Pichler, MD Lukin. Physical Review X. 10(2) (2020) 021067.
34.    K Blekos, D Brand, A Ceschini, CH Chou, RH Li, K Pandya, A Summer. Physics Reports. 1068 (2024) 1.
35.    P Hauke, HG Katzgraber, W Lechner, H Nishimori, WD Oliver. Reports on Progress in Physics. 83(5) (2020) 054401.
36.    B Tasseff, T Albash, Z Morrell, M Vuffray, AY Lokhov, S Misra, C Coffrin. Journal of Heuristics. 30(5) (2024) 325-58.
37.    A Del Campo. Physical review letters. 111(10) (2013) 100502.
38.    JR Finžgar, Notarnicola S, Cain M, Lukin MD, Sels D. arXiv preprint arXiv:2503.01958. (2025).
39.    A Ramezanpour. Physical Review A. 96(5) (2017) 052307.
40.    A Ramezanpour. Physical Review A. 106(1) (2022) 012418.
41.    S Lloyd, J J Slotine. Physical Review A. 62(1) (2000) 012307.
42.    J Preskill. Fault-tolerant quantum computation. Introduction to quantum computation and information. 213 (1998).
43.    Z Cai, R Babbush, SC Benjamin, S Endo, WJ Huggins, Y Li, JR McClean, TE O’Brien. Reviews of Modern Physics. 95(4) (2023) 045005.
44.    A Ramezanpour. J. Stat. Mech. 123401 (2025).
45.    D Shapira, S Mozes, O Biham. Physical Review A. 67(4) (2003) 042301.
46.    J Leng, F Yang, XB Wang. Physical Review Research. 7(1) (2025) L012017.

Home

Guide for Authors

Submit Manuscript

Reviewers

Contact Us

تحت نظارت وف بومی