请输入您要查询的字词:

 

单词 LeastSquares
释义

least squares


The general problem to be solved by the least squares method is this: given some direct measurements y of random variables, and knowing a set of equations f which have to be satisfied by these measurements (possibly involving unknown parameters x), find the set of x which comes closest to satisfying

f(x,y)=0

where “closest” is defined by a Δy such that

f(x,y+Δy)=0 and Δy2 is minimized 

The sum of squares of elements of a vector can be written in different ways

Δy2=ΔyTΔy=||Δy||2=iΔyi2

The assumptionPlanetmathPlanetmath has been made here that the elements of y are statistically uncorrelated and have equal varianceMathworldPlanetmath. For this case, the above solution results in the most efficent estimatorsMathworldPlanetmath for x, Δy. If the y are correlated, correlationsMathworldPlanetmath and variances are defined by a covariance matrixMathworldPlanetmath C, and the above minimum condition becomes

ΔyTC-1Δy is minimized 

Least squares solutions can be more or less simple, depending on the constraint equations f. If there is exactly one equation for each measurement, and the functions f are linear in the elements of y and x, the solution is discussed under linear regression. For other linear models, see Linear Least Squares. Least squares methods applied to few parameters can lend themselves to very efficient algorithms (e.g. in real-time processing), as they reduce to simple matrix operations.

If the constraint equations are non-linear, one typically solves by linearization and in iterations, using approximate values of x, Δy in every step, and linearizing by forming the matrix of derivatives , df/dx (the Jacobian matrix) and possibly also df/dy at the last point of approximation.

Note that as the iterative improvements δx,δy tend towards zero (if the process converges), Δy converges towards a final value which enters the minimum equation above.

Algorithms avoiding the explicit calculation of df/dx and df/dy have also been investigated, e.g. [1]; for a discussion, see [2]. Where convergence (or control over convergence) is problematic, use of a general package for minimization may be indicated.

References

  • 1 M.L. Ralston and R.I. Jennrich, Dud, a Derivative-free Algorithm for Non-linear Least Squares, Technometrics 20-1 (1978) 7.
  • 2 W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C, Second edition, Cambridge University Press, 1995.

Note: This entry is based on content from the http://rkb.home.cern.ch/rkb/titleA.htmlThe Data Analysis Briefbook

随便看

 

数学辞典收录了18232条数学词条,基本涵盖了常用数学知识及数学英语单词词组的翻译及用法,是数学学习的有利工具。

 

Copyright © 2000-2023 Newdu.com.com All Rights Reserved
更新时间:2025/5/5 0:10:50