Lesson
13 of 23

📊 Simple Linear Regression

Learn the meaning of regression, fitting a simple linear regression equation, and testing the significance of the regression coefficient.

Correlation tells us whether two variables move together. Regression goes one step further: it gives an equation that helps us predict one variable from another. In agriculture, this is useful whenever one measurement helps estimate another, such as grain number from panicle length or yield response from fertilizer dose.


What Is Regression?

Regression describes the functional relationship between variables.

  • The independent variable X is the predictor or explanatory variable.
  • The dependent variable Y is the response variable.

When the relationship between X and Y is represented by a straight line, it is called simple linear regression.

The basic equation is:

Y = a + bX

where:

  • a is the intercept
  • b is the regression coefficient or slope

Meaning of the Regression Coefficient

The regression coefficient b shows how much the dependent variable is expected to change for a one-unit change in the independent variable.

Example:

If Y is grain number and X is panicle length, a positive slope means grain number tends to increase as panicle length increases.

Practical interpretation

  • b > 0: positive relationship
  • b < 0: negative relationship
  • b = 0: no linear relationship

The slope is the most important quantity in simple linear regression because it gives direction and rate of change.


Fitting a Regression Line

The usual method of fitting the line Y = a + bX is the method of least squares. The idea is simple:

  • choose the line that keeps the squared prediction errors as small as possible

This gives estimates of:

  • the intercept a
  • the slope b

The fitted line represents the average value of Y associated with a given value of X.


Assumptions of Simple Linear Regression

For standard inference, the regression model is usually used under these assumptions:

  1. the values of X are fixed or treated as given
  2. for each value of X, the values of Y are normally distributed around a mean
  3. the variance of Y is similar across values of X
  4. the observations are independent

These assumptions are important because significance testing for regression depends on them.


Testing the Significance of the Regression Coefficient

Once a regression line is fitted, the next question is whether the slope is statistically meaningful.

The hypotheses are usually:

  • H0: b = 0 meaning no linear regression effect
  • H1: b != 0 meaning a significant regression relationship exists

The significance of b can be tested by:

  • a t-test, or
  • an F-test through analysis of variance

If the test is significant, we conclude that the independent variable helps explain variation in the dependent variable.


Agricultural Use of Regression

Regression is widely used in agricultural science for:

  • prediction
  • calibration
  • estimating response trends
  • understanding cause-and-effect patterns

Examples:

  • predicting yield from plant population
  • studying growth response to nitrogen dose
  • relating pest mortality to insecticide level

So regression is not just a mathematical exercise; it is a practical decision-support tool.

Summary Cheat Sheet

Topic Key Point
Regression Functional relationship between variables
Independent variable Predictor, usually X
Dependent variable Response, usually Y
Simple linear regression Y = a + bX
Regression coefficient b Change in Y for one-unit change in X
Significance test Often tests whether b = 0
Main exam trap Correlation measures association; regression gives a predictive equation

Lesson Doubts

Ask questions, get expert answers