Abstract
This chapter is a brief introduction to simple and multiple linear regression and how to use this method in a real context (see [41] for a more complete presentation). We present the relevant R commands and use a real data set as a connecting thread as we present the key concepts for this method. We treat the case of qualitative explanatory variables, as well as interaction of explanatory variables. We discuss model validation with a study of residuals and mention the issue of collinearity. We also present a few methods for variable selection.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Adler J. R in a Nutshell. O’Reilly, 2010.
Akaike H. Information Theory and an Extension of the Maximum Likelihood Principle. In Petrov B. N. and Csaki F., editors, Proc. of the 2nd Int. Symp. on Information Theory, pages 267–81, 1973.
Becker R. A., Chambers J. M. and Wilks A. R. The New S Language: A Programming Environment for Data Analysis and Graphics. Chapman & Hall, 1988.
Belsley D. A., Kuh E. and Welsch R. E. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. Wiley Series in Probability and Mathematical Statistics. John Wiley & Sons, New York-Chichester-Brisbane, 1980.
Bilodeau M. and Lafaye de Micheaux P. A-dependence Statistics for Mutual and Serial Independence of Categorical Variables. Journal of Statistical Planning and Inference, 139:2407–19, 2009.
Braun J. W. and Murdoch D. J. A First Course in Statistical Programming with R. Cambridge University Press, 1st edition, January 2008.
Burns P. The R inferno. Unpublished manual, Amazon, 2011.
Chambers J. M. Software for Data Analysis: Programming with R. Statistics and Computing. Springer, June 2008.
Chivers I. and Sleightholme J. Introduction to Programming with Fortran: With Coverage of Fortran 90, 95, 2003, 2008 and 77. Springer, 2nd edition, 2012.
Cohen Y. and Cohen J. Statistics and Data with R: An Applied Approach Through Examples. Wiley, 2008.
Cook R. D. and Weisberg S. Residuals and Influence in Regression. Monographs on Statistics and Applied Probability. Chapman & Hall, London, 1982.
Crawley M. J. The R Book. Wiley, Chichester, June 2007.
Dalgaard P. Introductory Statistics with R (Statistics and Computing). Springer, 2nd edition, August 2008.
Davison A. C. and Hinkley D. V. Bootstrap Methods and their Applications, volume 1 of Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge, 1997. With 1 IBM-PC floppy disk (3.5 inch; HD).
Everitt B. S. and Hothorn T. A Handbook of Statistical Analyses Using R. Chapman & Hall/CRC, 1st edition, February 2006.
Fisher R. A. Statistical Methods for Research Workers, 4th edition §21.1. Oliver & Boyd, Edinburgh, 1932.
Fox J. Extending the R Commander by “plug in” Packages. R News, 7(3):46–52, 2007.
Furnival G. M. and Jr. Wilson R. W. Regression by Leaps and Bounds. Technometrics, 16:499–511, 1974.
Hand D. J. Branch and Bounds in Statistical Data Analysis. The Statistician, 30:1–13, 1981.
Heiberger R. M. and Neuwirth E. R Through Excel. Use R! Springer, 2009.
Ihaka R. and Gentleman R. R: A Language for Data Analysis and Graphics. Journal of Computational and Graphical Statistics, 5(3):299–314, 1996.
Kernighan B. W. and Ritchie D. M. The C Programming Language, Second Edition. Prentice Hall, 1988.
Lafaye de Micheaux P. and Liquet B. ConvergenceConcepts: An R Package to Investigate Various Modes of Convergence. R Journal, 1(2):18–26, 2009.
Lafaye de Micheaux P. and Liquet B. Understanding Convergence Concepts: A Visual-minded and Graphical Simulation-based Approach. The American Statistician, 63(2):173–8, 2009.
Levene H. Robust Tests for Equality of Variances. In Contributions to probability and statistics, pages 278–92. Stanford Univ. Press, Stanford, Calif., 1960.
Maindonald J. and Braun J. Data Analysis and Graphics Using R: An Example-based Approach (Cambridge Series in Statistical and Probabilistic Mathematics). Cambridge University Press, December 2006.
Mallows C. L. Some Comments on c p . Technometrics, 15:661–75, 1973.
Matloff N. The Art of R Programming. No Starch Press, 2011.
Meyer C. Matrix Analysis and Applied Linear Algebra. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA, 2000. With 1 CD-ROM (Windows, Macintosh and UNIX) and a solutions manual (iv+171 pp.).
Jr. Miller and Rupert G. Simultaneous Statistical Inference. Springer Series in Statistics. Springer-Verlag, New York, 2nd edition, 1981.
Montgomery D. C. Design and Analysis of Experiments. Wiley, 7th edition, 2008.
Muenchen R. A. R for SAS and SPSS Users. Springer Series in Statistics and Computing. Springer, 2009.
Muenchen R. A. and Hilbe J. M. R for Stata Users. Statistics and Computing. Springer, 2010.
Park S. K. and Miller K. W. Random Number Generators: Good Ones are Hard to Find. Commun. ACM, 31(10):1192–1201, 1988.
Robert C. and Casella G. Introducing Monte Carlo Methods with R (Use R!). Springer, 2009.
Sarkar D. Lattice: Multivariate Data Visualization with R. Use R! Springer, March 2008.
Schwarz G. Estimating the Dimension of a Model. Annals of statistics, 6:461–64, 1978.
Stroustrup B. The C++ Programming Language, Third edition. Addison-Wesley, 1997.
Teetor P. R Cookbook. O’Reilly, 2011.
Vinod H. D. Hands-on Intermediate Econometrics Using R : Templates for Extending Dozens of Practical Examples. World Scientific, Hackensack, NJ, 2008.
Weisberg S. Applied Linear Regression, 3rd edition. Wiley-Interscience, 2005.
Zuur A. F., Ieno E. N. and Meesters E. H.W.G. A Beginner’s Guide to R. Springer, 2009.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this chapter
Cite this chapter
de Micheaux, P.L., Drouilhet, R., Liquet, B. (2013). Simple and Multiple Linear Regression. In: The R Software. Statistics and Computing, vol 40. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-9020-3_14
Download citation
DOI: https://doi.org/10.1007/978-1-4614-9020-3_14
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-9019-7
Online ISBN: 978-1-4614-9020-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)