This website uses cookies to ensure you have the best experience. Learn more

Linear Regression Essay

1304 words - 6 pages

Chapter 4
Multiple Linear Regression

Section 4.1
The Model and Assumptions

Participants will:  understand the elements of the model  understand the major assumptions of doing a regression analysis  learn how to verify the assumptions  understand a median split


The Model
y   o  1x1  ...   p x p   or in Matrix Notation
Dependent Variable nx1 Unknown Parameters (p+1) x 1

Y  X e
Independent Variables – n x(p+1)

Error – nx1


How many unknown parameters are there? Can you name them? How many populations will be sampled? What are conceptual populations?


Major Requirements for Doing a Regression Analysis
The errors ...view middle of the document...

Determine the number of populations sampled. Run the regression analysis and save the residuals. Plot the residuals versus independent variables. Check for normality of residuals. Check for constant variance.


Use the Store24 data set.

Remind yourself of the model and the parameters. How many populations were sampled? Are the residuals normal? Do you have constant variance?




Section 4.2
Possible Problem Points, Multicollinearity, and Additional Residual Analyses

Participants will learn:  About using Cook’s D, leverage values, and residuals to identify possible problem points.  What is multicollinearity? How to detect it? Why you should use the COLLINOINT option.  About partial F tests and why the p values can be misleading.  About other residuals and the importance of residual graphs.


Cook’s D, Leverage Values, and Residuals
Cook’s D helps identify possible problem points in the y direction and in the x direction. Cook’s D statistic is a measure of the simultaneous change in the parameter estimates when an observation is deleted from the analysis. Flag if > 1. Leverage values(Hat Diag H )help identify possible problem points in the x direction. Flag if > .5. Residuals help identify possible problem points in the y direction. Flag if abs (STUDENT) > 3.


Possible Problem Points in the Y Direction

Click Here


Possible Problem Points in the X Direction

Click Here


Occurs when the x’s predictors (independent variables) are highly correlated. Problems if VIF > 10. Some people use the condition index. In order to avoid false positives, use the COLLINOINT option.


Variance Inflation Factor (VIF) Example


Collinearity Diagnostics – Not Adjusted


Collinearity Diagnostics – Adjusted


Body Fat Example
              28

Percent body fat from Siri’s (1956) equation – dependent Age (years) Weight (lbs) Height (inches) Neck circumference (cm) Chest circumference (cm) Abdomen 2 circumference (cm) Hip circumference (cm) Thigh circumference (cm Knee circumference (cm) Ankle circumference (cm) Biceps (extended) circumference (cm) Forearm circumference (cm) Wrist circumference (cm)

What Is Being Tested by |t|



What Is Being Tested by Pr >|t|


Partial F-Tests

H o : 3  0 | all other  's are in the model


Interpretation – The Stable Table

Do I need this leg to have a stable table?




Interpretation – The Stable Table

Do I need this leg to have a stable table?




Interpretation – The Stable Table

Do I need this leg to have a stable table?




Predicted versus Y Residual versus...

Other Papers Like Linear Regression

Salary Regression Example Essay

413 words - 2 pages | |1992 |9,200 | |1993 |10,100 | |1994 |11,000 | |1995 |48,000 | |1996 |50,000 | |1997 |52,000 | |1998 |57,000 | |1999 |63,000 | |2000 |67,000 | |2001 |72,000 | |2002 |103,000 | |2003 |108,000 | Perform a linear regression on his salary

Customer Loyalty Essay

1314 words - 6 pages when any one of the independent variables is varied, while the other independent variables are held fixed. SIMPLE LINEAR REGRESSION In simple linear regression, we predict scores on one variable from the scores on a second variable. The variable we are predicting is called the criterion variable and is referred to as Y. The variable we are basing our predictions on is called the predictor variable and is referred to as X. When there is only

Business Math

1773 words - 8 pages MSOR 221 Statistical Inference Chapter 18 Multiple Regression Model and Required Conditions For k independent variables (predicting variables) x1, x2, … , xk, the multiple linear regression model is represented by the following equation: [pic] where (1, (2, … , (k are population regression coefficients of x1, x2, … , xk respectively, (0 is the constant term, and ( (the Greek letter epsilon) represents the random term (also


667 words - 3 pages Introduction The flowing charts are to show if there is any relationships between the variables. The relationships can either be negative or positive. This is told by whether the graph increases or decreases. Benefits and Intrinsic Job Satisfaction Regression output from Excel SUMMARY OUTPUT Regression Statistics Multiple R 0.069642247 R Square 0.004850043 Adjusted R Square -0.00471871

Diamonds - Should You Buy?

630 words - 3 pages data to run the regression Selected data to run the regression Cut off point of data at Price = $1000 Cut off point of data at Price = $1000 Variable Grouping and Dummy Variable Assignment The categorical variables: color, clarity, cut, certification, polish, and symmetry were categorized into necessary categories to help simplify the upcoming regression from a very large number of dummy variables. Then, dummy variables were assigned

Corporate Finance Management and Modeling

1225 words - 5 pages % level of significance, the regression coefficient is different from zero. 4.1 An Empirical look at 3-month Treasury bill rate from secondary market and civilian employment- population ratio The simple linear (or the straight line) regression model is Y=0.667X-39.174. We can tell that if civilian employment-population ratio increases by one percentage, then three-month Treasury bill rate from secondary market will increase by 0.667 percentages

Assignment 1

4865 words - 20 pages an up-and-down repetitive movement within a trend occurring periodically. Answer: Diff: 2 Page Ref: 682 Main Heading: Time Series Key words: seasonal pattern, forecasting components 27) __________ relates demand to two or more independent variables. Answer: Diff: 2 Page Ref: 712 Main Heading: Time Series Key words: multiple linear regression analysis 28) One problem with multiple regression is

Res 342 Regression Paper

1165 words - 5 pages percentage, team batting average, and city population. However, home attendance was the most cogent variable to examine from a financial perspective. After performing a simple regression, we conclude that there is a linear relationship. We see in our analysis, the coefficient of determination, r2, which determines how confident or strong we are in our regression, is .6240, viz. 62.40%. A value of 62.40% is a satisfactory result for our application

Statistics Final Project

1893 words - 8 pages regression model better than the linear model that we generated in parts 1-10? Explain. ---I think that the multiple regression model is better than the linear regression model because the value of the R2 is greater for the multiple regression model than the linear model, and the greater the value of R2, the better the regression model is.

Regression Analysis - 1

1953 words - 8 pages , the independent variable is Ed or education also known as "x". The wage is the dependent variable also known as "y". The MegaStat program has also given the equation of the line and the [pic]. After conducting the linear regression test, Team C will discuss the resulting information. Scatter Plot of Female Education and Wages In the scatter plot the wages range from 9879-83443 and years of education ranges from eight-17. According to the


1877 words - 8 pages |     Durbin-Watson stat | 1.971576 | Prob(F-statistic) | 0.000000 | | | | | | | | | | | | | | Regression analysis is used to analyse how the typical value of the dependent variable changes when any one of the independent variables is varied, while the other independent variables are held fixed. It also helps to explain the impact of changes in an independent variable on the dependent variable. The linear relationship between

Related Essays

Linear Regression Essay

1111 words - 5 pages Linear regression analyzes the relationship between an independent and dependent variable to find the line that best fits between them. It has been used to predict a continuous dependent variable from a number of independent variables. This report will discuss the different tools used for such analysis and will also describe histograms and bivariate plots. It will also discuss the value of a slope which is shown as the ratio of change in the y

Regression Analysis

1459 words - 6 pages ’ between the variables, whereas regression is a measure of degree of relationship between independent and dependent variables ← The cause and effect relation is clearly indicated through regression analysis than by correlation Simple Linear Regression Model: In regression analysis, there is a dependent variable, which is the one we are trying to explain, and one or more independent variables that are related to it. We can

Stat Assignment 4

1832 words - 8 pages the inflation rate is explained by the OCR rate. This indicates a weak relationship between OCR and inflation because the use of a regression model has only reduced the variability in predicting the inflation by 27.27%. Over 72% of the sample variability of inflation is due to factors other than what is accounted for by the linear regression model that uses the OCR rate. d) Use this model to predict the inflation that is likely to be

Significance And Advantages Of Regression Analysis

798 words - 4 pages regression analysis has been developed. Familiar methods such as linear regression and ordinary least squares regression are parametric, in that the regression function is defined in terms of a finite number of unknown parameters that are estimated from the data. Nonparametric regression refers to techniques that allow the regression function to lie in a specified set of functions, which may be infinite-dimensional. The performance of regression