一类带非单调线搜索的信赖域算法

doi:10.12286/jssx.2011.1.48

计算数学 ›› 2011, Vol. 33 ›› Issue (1): 48-56.DOI: 10.12286/jssx.2011.1.48

一类带非单调线搜索的信赖域算法

庞善民, 陈兰平

首都师范大学数学科学学院, 北京 100048

收稿日期:2009-06-01 出版日期:2011-02-15 发布日期:2011-03-08
基金资助:
国家自然科学基金(No. 60972140) 资助.

PDF ( 1298 ) 引用被引次数 ( 8 | 1 )

庞善民, 陈兰平. 一类带非单调线搜索的信赖域算法[J]. 计算数学, 2011, 33(1): 48-56.

Pang Shanmin, Chen Lanping. A NEW FAMILY OF TRUST REGION ALGORITHMS WITH A NONMONOTONE LINE SEARCH TECHNIQUE[J]. Mathematica Numerica Sinica, 2011, 33(1): 48-56.

A NEW FAMILY OF TRUST REGION ALGORITHMS WITH A NONMONOTONE LINE SEARCH TECHNIQUE

Pang Shanmin, Chen Lanping

School of Mathematical Sciences, Capital Normal University, Beijing 100048, China

Received:2009-06-01 Online:2011-02-15 Published:2011-03-08

通过将非单调 Wolfe 线搜索技术与传统的信赖域算法相结合, 我们提出了一类新的求解无约束最优化问题的信赖域算法.新算法在每一迭代步只需求解一次信赖域子问题, 而且在每一迭代步 Hesse 阵的近似都满足拟牛顿条件并保持正定传递.在一定条件下, 证明了算法的全局收敛性和强收敛性. 数值试验表明新算法继承了非单调技术的优点, 对于求解某些优化问题具有重要意义.

关键词： 无约束最优化, 信赖域方法, 非单调线搜索, 全局收敛

We propose a new family of trust region algorithms for unconstrained optimization problems which is combining traditional trust region method with a nonmonotone Wolfe line search technique. The new algorithm solves the trust region subproblem only once at each iteration, furthermore, the matrix approximation to the Hessian simultaneously satisfies the quasi-Newton condition at each iteration and maintains its positive definiteness. Under certain conditions, the global convergence and strong global convergence of the algorithm are proved. Numerical results show that the algorithm inherits the advantages of the nonmonotone schemes and is meaningful to some optimization problems.

Key words: Unconstrained optimization, Trust-region method, Nonmonotone line search, Global convergence

MR(2010)主题分类:

65K10
90C30

分享此文:

[1] 刘培培, 陈兰平. 一类拟牛顿非单调信赖域算法及其收敛性[J]. 数学进展, 2008, 37(1): 92-100.
[2] E Michael Gertz. Combination trust-region line search methods for unconstrained optimization[R]. University of California San Zdiego, 1999.
[3] Nocedal J, Yuan Y X. Combining trust region and line search techniques[R]. Technical Report, NAM06, Dept of Computer Science, Northwestern University, Illinois, USA, 1991.
[4] Nocedal J, Yuan Y X. Combining Trust Region and Line Search Techniques[J]. Advances in Nonlinear Programming, 1998, 153-175.
[5] 袁亚湘, 孙文瑜. 最优化理论与方法[M]. 北京: 科学出版社,1997, 154-166.
[6] E Michael Gertz, A quasi-Newton trust-region method[J]. Mathematical Programming, 2004, 100(3): 447-470.
[7] Grippo L, Lucidi S. A global convergence version of the Plak-Ribiére conjugate gradient method[J]. MathematicalProgramming, 1997, 78: 375-391.
[8] Grippo L, Lampariello F, Lucidi S. A nonmonotone line search technique for Newton's method[J]. SIAM J.Numer.Anal., 1986, 23(4): 707-716.
[9] Zhang H C, Hager W W. A nonmonotone line search technique and its application to unconstrained optimization[J]. SIAM J. Optim, 2004, 14(4): 1043-1056.
[10] 席少霖. 非线性最优化方法[M]. 北京: 高等教育出版社, 1992, 102-112.
[11] Deng N Y, Xiao Y, Zhou F J. A nonmonotonic trust region algorithm[J]. Journal of optimization Theory and Applications, 1993, 76(2): 259-285.
[12] Jorge J Moré, Burton S Garbow, Kenneth E Hillstrom. Testing Unconstrained Optimization Software[J]. ACM Transactions on Mathematical Software, 1981, 7(1): 17-41.
[13] 柯小伍, 韩继业. 一类新的信赖域算法的全局收敛性[J]. 应用数学学报, 1995, 18(4): 608-615.

[1]	米玲, 薛文娟, 沈春根. 球面上$\ell_1$正则优化的随机临近梯度方法[J]. 计算数学, 2022, 44(1): 34-62.
[2]	马积瑞, 范金燕. 信赖域方法在Hölderian局部误差界下的收敛性质[J]. 计算数学, 2021, 43(4): 484-492.
[3]	孙青青, 王川龙. 低秩稀疏矩阵恢复的快速非单调交替极小化方法[J]. 计算数学, 2021, 43(4): 516-528.
[4]	刘金魁, 孙悦, 赵永祥. 凸约束伪单调方程组的无导数投影算法[J]. 计算数学, 2021, 43(3): 388-400.
[5]	尹江华, 简金宝, 江羡珍. 凸约束非光滑方程组一个新的谱梯度投影算法[J]. 计算数学, 2020, 42(4): 457-471.
[6]	张纯, 贾泽慧, 蔡邢菊. 广义鞍点问题的改进的类SOR算法[J]. 计算数学, 2020, 42(1): 39-50.
[7]	姜帆, 刘雅梅, 蔡邢菊. 一类自适应广义交替方向乘子法[J]. 计算数学, 2018, 40(4): 367-386.
[8]	王福胜, 张瑞. 不等式约束极大极小问题的一个新型模松弛强次可行SQCQP算法[J]. 计算数学, 2018, 40(1): 49-62.
[9]	刘金魁. 解凸约束非线性单调方程组的无导数谱PRP投影算法[J]. 计算数学, 2016, 38(2): 113-124.
[10]	刘亚君, 刘新为. 无约束最优化的信赖域BB法[J]. 计算数学, 2016, 38(1): 96-112.
[11]	简金宝, 尹江华, 江羡珍. 一个充分下降的有效共轭梯度法[J]. 计算数学, 2015, 37(4): 415-424.
[12]	刘群锋, 曾金平, 张忠志, 程万友. 基于混合非单调下降条件的直接搜索方法[J]. 计算数学, 2015, 37(2): 213-224.
[13]	袁敏, 万中. 求解非线性P₀互补问题的非单调磨光算法[J]. 计算数学, 2014, 36(1): 35-50.
[14]	简金宝, 唐菲, 黎健玲, 唐春明. 无约束极大极小问题的广义梯度投影算法[J]. 计算数学, 2013, 35(4): 385-392.
[15]	毕亚倩, 刘新为. 求解界约束优化的一种新的非单调谱投影梯度法[J]. 计算数学, 2013, 35(4): 419-430.

阅读次数

全文

摘要

一类带非单调线搜索的信赖域算法

A NEW FAMILY OF TRUST REGION ALGORITHMS WITH A NONMONOTONE LINE SEARCH TECHNIQUE

扫码分享