Note: This page has been translated by MathWorks. Click here to see

To view all translated materials including this page, select Country from the country navigator on the bottom of this page.

To view all translated materials including this page, select Country from the country navigator on the bottom of this page.

[1] Biggs, M.C., “Constrained Minimization
Using Recursive Quadratic Programming,” *Towards
Global Optimization* (L.C.W. Dixon and G.P. Szergo, eds.),
North-Holland, pp 341–349, 1975.

[2] Brayton, R.K., S.W. Director, G.D. Hachtel,
and L. Vidigal, “A New Algorithm for Statistical Circuit Design
Based on Quasi-Newton Methods and Function Splitting,” *IEEE
Transactions on Circuits and Systems*, Vol. CAS-26, pp
784–794, Sept. 1979.

[3] Broyden, C.G., “The Convergence of
a Class of Double-rank Minimization Algorithms,”; *J.
Inst. Maths. Applics*., Vol. 6, pp 76–90, 1970.

[4] Conn, N.R., N.I.M. Gould, and Ph.L. Toint, *Trust-Region
Methods*, MPS/SIAM Series on Optimization, SIAM and MPS,
2000.

[5] Dantzig, G., *Linear Programming
and Extensions*, Princeton University Press, Princeton,
1963.

[6] Dantzig, G.B., A. Orden, and P. Wolfe, “Generalized
Simplex Method for Minimizing a Linear Form Under Linear Inequality
Restraints,” *Pacific Journal Math.,* Vol.
5, pp. 183–195, 1955.

[7] Davidon, W.C., “Variable Metric Method
for Minimization,” *A.E.C. Research and Development
Report*, ANL-5990, 1959.

[8] Dennis, J.E., Jr., “Nonlinear least-squares,” *State
of the Art in Numerical Analysis* ed. D. Jacobs, Academic
Press, pp 269–312, 1977.

[9] Dennis, J.E., Jr. and R.B. Schnabel, *Numerical
Methods for Unconstrained Optimization and Nonlinear Equations*,
Prentice-Hall Series in Computational Mathematics, Prentice-Hall,
1983.

[10] Fleming, P.J., “Application of Multiobjective
Optimization to Compensator Design for SISO Control Systems,” *Electronics
Letters*, Vol. 22, No. 5, pp 258–259, 1986.

[11] Fleming, P.J., “Computer-Aided Control
System Design of Regulators using a Multiobjective Optimization Approach,” *Proc.
IFAC Control Applications of Nonlinear Prog. and Optim*.,
Capri, Italy, pp 47–52, 1985.

[12] Fletcher, R., “A New Approach to Variable
Metric Algorithms,” *Computer Journal*,
Vol. 13, pp 317–322, 1970.

[13] Fletcher, R., “Practical Methods of Optimization,” John Wiley and Sons, 1987.

[14] Fletcher, R. and M.J.D. Powell, “A
Rapidly Convergent Descent Method for Minimization,” *Computer
Journal*, Vol. 6, pp 163–168, 1963.

[15] Forsythe, G.F., M.A. Malcolm, and C.B. Moler, *Computer
Methods for Mathematical Computations*, Prentice Hall,
1976.

[16] Gembicki, F.W., “Vector Optimization for Control with Performance and Parameter Sensitivity Indices,” Ph.D. Thesis, Case Western Reserve Univ., Cleveland, Ohio, 1974.

[17] Gill, P.E., W. Murray, M.A. Saunders, and
M.H. Wright, “Procedures for Optimization Problems with a
Mixture of Bounds and General Linear Constraints,” *ACM
Trans. Math. Software*, Vol. 10, pp 282–298, 1984.

[18] Gill, P.E., W. Murray, and M.H. Wright,* Numerical
Linear Algebra and Optimization*, Vol. 1, Addison Wesley,
1991.

[19] Gill, P.E., W. Murray, and M.H.Wright, *Practical
Optimization*, London, Academic Press, 1981.

[20] Goldfarb, D., “A Family of Variable
Metric Updates Derived by Variational Means,” *Mathematics
of Computing*, Vol. 24, pp 23–26, 1970.

[21] Grace, A.C.W., “Computer-Aided Control System Design Using Optimization Techniques,” Ph.D. Thesis, University of Wales, Bangor, Gwynedd, UK, 1989.

[22] Han, S.P., “A Globally Convergent
Method for Nonlinear Programming,” *J. Optimization
Theory and Applications*, Vol. 22, p. 297, 1977.

[23] Hock, W. and K. Schittkowski, “A Comparative
Performance Evaluation of 27 Nonlinear Programming Codes,” *Computing*,
Vol. 30, p. 335, 1983.

[24] Hollingdale, S.H., *Methods of
Operational Analysis in Newer Uses of Mathematics* (James
Lighthill, ed.), Penguin Books, 1978.

[25] Levenberg, K., “A Method for the Solution
of Certain Problems in Least Squares,” *Quart. Appl.
Math*. Vol. 2, pp 164–168, 1944.

[26] Madsen, K. and H. Schjaer-Jacobsen, “Algorithms
for Worst Case Tolerance Optimization,” *IEEE Transactions
of Circuits and Systems*, Vol. CAS-26, Sept. 1979.

[27] Marquardt, D., “An Algorithm for Least-Squares
Estimation of Nonlinear Parameters,” *SIAM J. Appl.
Math*. Vol. 11, pp 431–441, 1963.

[28] Moré, J.J., “The Levenberg-Marquardt
Algorithm: Implementation and Theory,” *Numerical
Analysis*, ed. G. A. Watson, Lecture Notes in Mathematics
630, Springer Verlag, pp 105–116, 1977.

[29] *NAG Fortran Library Manual,* Mark
12, Vol. 4, E04UAF, p. 16.

[30] Nelder, J.A. and R. Mead, “A Simplex
Method for Function Minimization,”* Computer J.,* Vol.7,
pp 308–313, 1965.

[31] Nocedal, J. and S. J. Wright. *Numerical
Optimization*, Second Edition. Springer Series in Operations
Research, Springer Verlag, 2006.

[32] Powell, M.J.D., “The Convergence of
Variable Metric Methods for Nonlinearly Constrained Optimization
Calculations,” *Nonlinear Programming 3*,
(O.L. Mangasarian, R.R. Meyer and S.M. Robinson, eds.), Academic Press,
1978.

[33] Powell, M.J.D., “A Fast Algorithm
for Nonlinearly Constrained Optimization Calculations,” *Numerical
Analysis*, G.A.Watson ed., Lecture Notes in Mathematics,
Springer Verlag, Vol. 630, 1978.

[34] Powell, M.J.D., “A Fortran Subroutine
for Solving Systems of Nonlinear Algebraic Equations,” *Numerical
Methods for Nonlinear Algebraic Equations*, (P. Rabinowitz,
ed.), Ch.7, 1970.

[35] Powell, M.J.D., “Variable Metric Methods
for Constrained Optimization,” *Mathematical Programming:
The State of the Art*, (A. Bachem, M. Grotschel and B.
Korte, eds.) Springer Verlag, pp 288–311, 1983.

[36] Schittkowski, K., “NLQPL: A FORTRAN-Subroutine
Solving Constrained Nonlinear Programming Problems,” *Annals
of Operations Research*, Vol. 5, pp 485-500, 1985.

[37] Shanno, D.F., “Conditioning of Quasi-Newton
Methods for Function Minimization,” *Mathematics
of Computing*, Vol. 24, pp 647–656, 1970.

[38] Waltz, F.M., “An Engineering Approach:
Hierarchical Optimization Criteria,” *IEEE Trans*.,
Vol. AC-12, pp 179–180, April, 1967.

[39] Branch, M.A., T.F. Coleman, and Y. Li, “A
Subspace, Interior, and Conjugate Gradient Method for Large-Scale
Bound-Constrained Minimization Problems,” *SIAM
Journal on Scientific Computing*, Vol. 21, Number 1, pp
1–23, 1999.

[40] Byrd, R.H., J. C. Gilbert, and J. Nocedal,
“A Trust Region Method Based on Interior Point Techniques for
Nonlinear Programming,” *Mathematical Programming*,
Vol 89, No. 1, pp. 149–185, 2000.

[41] Byrd, R.H., Mary E. Hribar, and Jorge Nocedal,
“An Interior Point Algorithm for Large-Scale Nonlinear Programming,” *SIAM
Journal on Optimization*, Vol 9, No. 4, pp. 877–900,
1999.

[42] Byrd, R.H., R.B. Schnabel, and G.A. Shultz,
“Approximate Solution of the Trust Region Problem by Minimization
over Two-Dimensional Subspaces,” *Mathematical Programming*,
Vol. 40, pp 247–263, 1988.

[43] Coleman, T.F. and Y. Li, “On the Convergence
of Reflective Newton Methods for Large-Scale Nonlinear Minimization
Subject to Bounds,” *Mathematical Programming*,
Vol. 67, Number 2, pp 189–224, 1994.

[44] Coleman, T.F. and Y. Li, “An Interior,
Trust Region Approach for Nonlinear Minimization Subject to Bounds,” *SIAM
Journal on Optimization*, Vol. 6, pp 418–445, 1996.

[45] Coleman, T.F. and Y. Li, “A Reflective
Newton Method for Minimizing a Quadratic Function Subject to Bounds
on some of the Variables,” *SIAM Journal on Optimization*,
Vol. 6, Number 4, pp 1040–1058, 1996.

[46] Coleman, T.F. and A. Verma, “A Preconditioned
Conjugate Gradient Approach to Linear Equality Constrained Minimization,” *Computational
Optimization and Applications*, Vol. 20, No. 1, pp. 61–72,
2001.

[47] Mehrotra, S., “On the Implementation
of a Primal-Dual Interior Point Method,” *SIAM Journal
on Optimization*, Vol. 2, pp 575–601, 1992.

[48] Moré, J.J. and D.C. Sorensen, “Computing
a Trust Region Step,” *SIAM Journal on Scientific
and Statistical Computing*, Vol. 3, pp 553–572,
1983.

[49] Sorensen, D.C., “Minimization of a Large Scale Quadratic Function Subject to an Ellipsoidal Constraint,” Department of Computational and Applied Mathematics, Rice University, Technical Report TR94-27, 1994.

[50] Steihaug, T., “The Conjugate Gradient
Method and Trust Regions in Large Scale Optimization,” *SIAM
Journal on Numerical Analysis*, Vol. 20, pp 626–637,
1983.

[51] Waltz, R. A. , J. L. Morales, J. Nocedal,
and D. Orban, “An interior algorithm for nonlinear optimization
that combines line search and trust region steps,” *Mathematical
Programming*, Vol 107, No. 3, pp. 391–408, 2006.

[52] Zhang, Y., “Solving Large-Scale Linear Programs by Interior-Point Methods Under the MATLAB Environment,” Department of Mathematics and Statistics, University of Maryland, Baltimore County, Baltimore, MD, Technical Report TR96-01, July, 1995.

[53] Hairer, E., S. P. Norsett, and G. Wanner, *Solving
Ordinary Differential Equations I - Nonstiff Problems*,
Springer-Verlag, pp. 183–184.

[54] Chvatal, Vasek, *Linear Programming*,
W. H. Freeman and Company, 1983.

[55] Bixby, Robert E., “Implementing the Simplex Method: The Initial Basis,” ORSA Journal on Computing, Vol. 4, No. 3, 1992.

[56] Andersen, Erling D. and Knud D. Andersen, “Presolving in Linear Programming,” Mathematical Programming, Vol. 71, pp. 221–245, 1995.

[57] Lagarias, J. C., J. A. Reeds, M. H. Wright,
and P. E. Wright, “Convergence Properties of the Nelder-Mead
Simplex Method in Low Dimensions,” *SIAM Journal
of Optimization*, Vol. 9, Number 1, pp. 112–147,
1998.

[58] Dolan, Elizabeth D. , Jorge J. Moré and Todd S. Munson, “Benchmarking Optimization Software with COPS 3.0,” Argonne National Laboratory Technical Report ANL/MCS-TM-273, February 2004.

[59] Applegate, D. L., R. E. Bixby, V. Chvátal
and W. J. Cook, *The Traveling Salesman Problem: A Computational
Study*, Princeton University Press, 2007.

[60] Spellucci, P., “A new technique for
inconsistent QP problems in the SQP method,” *Journal
of Mathematical Methods of Operations Research*, Volume
47, Number 3, pp. 355–400, October 1998.

[61] Tone, K., “Revisions of constraint
approximations in the successive QP method for nonlinear programming
problems,” *Journal of Mathematical Programming*,
Volume 26, Number 2, pp. 144–152, June 1983.

[62] Gondzio, J. “Multiple centrality
corrections in a primal dual method for linear programming.” *Computational
Optimization and Applications*, Volume 6, Number 2, pp.
137–156, 1996.

[63] Gould, N. and P. L. Toint. “Preprocessing
for quadratic programming.” *Math. Programming*,
Series B, Vol. 100, pp. 95–132, 2004.

[64] Schittkowski, K., “More Test Examples
for Nonlinear Programming Codes,” *Lecture Notes
in Economics and Mathematical Systems*, Number 282, Springer,
p. 45, 1987.