Draft:Multivariate logistic regression

Review waiting, please be patient.

This may take 3 months or more, since drafts are reviewed in no specific order. There are 2,741 pending submissions waiting for review.

If the submission is accepted, then this page will be moved into the article space.
If the submission is declined, then the reason will be posted here.
In the meantime, you can continue to improve this submission by editing normally.

Where to get help

If you need help editing or submitting your draft, please ask us a question at the AfC Help Desk or get live help from experienced editors. These venues are only for help with editing and the submission process, not to get reviews.
If you need feedback on your draft, or if the review is taking a lot of time, you can try asking for help on the talk page of a relevant WikiProject. Some WikiProjects are more active than others so a speedy reply is not guaranteed.

How to improve a draft

Wikipedia:Contributing to Wikipedia – a basic overview on how to edit Wikipedia.
Help:Wikitext – how to use the markup
Help:Referencing for beginners – how to include references
Wikipedia:Article development – how to develop your article
Wikipedia:Writing better articles – how to improve your article
Wikipedia:Verifiability – make sure your article includes reliable third-party sources

You can also browse Wikipedia:Featured articles and Wikipedia:Good articles to find examples of Wikipedia's best writing on topics similar to your proposed article.

Improving your odds of a speedy review

To improve your odds of a faster review, tag your draft with relevant WikiProject tags using the button below. This will let reviewers know a new draft has been submitted in their area of interest. For instance, if you wrote about a female astronomer, you would want to add the Biography, Astronomy, and Women scientists tags.

Add tags to your draft

Editor resources

Easy tools: Citation bot (help) | Advanced: Fix bare URLs

Reviewer tools

Instructions · What links here · Multivariate logistic regression (talk: + · bio) · (log) · Copyvios report · reFill · Citation Bot · (Search: Google, Wikipedia) · Submitted 28 days ago by Faster than Thunder (talk: D · +) · Last edited 40 hours ago by Faster than Thunder

Multivariate logistic regression is a type of data analysis that predicts any number of^[1] outcomes based on multiple^[2]^[3] independent variables.^[4]^[5]^[6] It is based on the assumption that the natural logarithm of the odds has a linear relationship with independent variables.^[7]

Procedure

First, the baseline odds of a specific outcome compared to not having that outcome are calculated, giving a constant (intercept).^[8] Next, the independent variables are incorporated into the model, giving a regression coefficient (beta) and a "P" value for each independent variable.^[9] The "P" value determines how significantly the independent variable impacts the odds of having the outcome or not.^[10]

Formula

Multivariate logistic regression uses a formula similar to univariate logistic regression,^[11] but with multiple independent variables.

\pi \left(x\right)={\frac {e^{\beta _{0}+\beta _{1}X_{1}+\beta _{2}X_{2}+\dots +\beta _{v}X_{v}}}{1+e^{\beta _{0}+\beta _{1}X_{1}+\beta _{2}X_{2}+\dots +\beta _{v}X_{v}}}}

where v is the number of independent variables. The following formula shows that multivariate logistic regression is simply a standard linear regression model:^[12]

\mathrm {logit} \left(\pi \left(x\right)\right)=\beta _{0}+\beta _{1}X_{1}+\beta _{2}X_{2}+\dots +\beta _{v}X_{v}

Types

The two main types of multivariate logistic regression are linear regression and logistic regression.

Linear regression

Linear regression produces results that show a linear relationship with a single independent variable (IV) and can be plotted on a graph as a straight line.^[13]

Logistic regression

In contrast, logistic regression produces results that show a nonlinear relationship. As a result, plotting the data on a graph produces a curved line called a sigmoid. Unlike linear regression, logistic regression produces results based on two or more independent variables.^[14]^[15]^[5]

The odds ratio associated with a single independent variable can change when other independent variables are accounted for as well.^[16] However, the changes are usually insignificant, but they can indicate errors.^[17]

Assumptions

Multivariate logistic regression assumes that the different observations are independent.^[18] It also assumes that the natural logarithm of the odds ratio and the dependent variables show a linear relationship. However, it does not assume a normal distribution of the dependent variables.

Null hypothesis

A null hypothesis is an assumption that the independent variables do not have any impact on the dependent variable.^[19]

Dependent variables

There are three main types of logistic regression dependent variables (DVs): Binary, multi-class, and ordinal.^[20]

Binary

A binary dependent variable is a variable with only two outcomes, and the possible values must be opposites of each other.^[21]

Multi-class

A multi-class dependent variable is a variable with at least three qualitative (non-numerical) outcomes, usually with a constant numerical stand-in.^[22]

Ordinal

An ordinal dependent variable is a variable with at least three possible outcomes, which are numerically different.^[23]

Models

Multivariate logistic regression produces the following models:^[24]

Logit models

Logit models distinguish independent and dependent variables.

Log-linear models

Unlike logit models, log-linear models do not distinguish between categories of variables.

Probit models

Probit models function similarly to logit models due to the similarities of normal and logistic distributions. However, since the independent variables are interpreted as standard deviations instead of odds ratios, these models are also more similar to linear models than logit models.

Uses

Scientists

When scientists use logistic regression, they usually include as many independent variables as necessary.^[5]

Doctors and physicians

Multivariate logistic regression is used by physicians to:^[25]

associate certain characteristics with certain outcomes^[26]
determine the effects of certain techniques
give people with certain conditions appropriate treatments
develop appropriate models^[27]

Market

Multivariate logistic regression is also used to analyze customer preferences for products.^[28]

Artificial intelligence

Multivariate logistic regressions are also used in machine learning.^[29]

In comparison to multivariable logistic regression

While both multivariate logistic regression and multivariable logistic regression correlate multiple independent variables to outcomes, multivariate logistic regression correlates independent variables to multiple outcomes, while multivariable logistic regression correlates independent variables to a single outcome.^[30]^[31]

References

^ "... while multivariate logistic regression deals with multiple outcomes simultaneously." - [1] (This vs. That)
^ "In contrast, multivariate logistic regression involves analyzing the relationship between multiple outcome variables and one or more predictors. This can lead to more complex interpretations, as researchers must consider the impact of predictors on each outcome variable." - [2] (This vs. That)
^ "Number of variables: One dependent (y), At least two independent (x)" - [3] (Ylva B. Almquist)
^ "Multivariate logistic regression is a type of analysis that can help predict results when you're working with multiple variables." - [4] (Indeed)
^ ^a ^b ^c Sperandei, Sandro (2014). "Understanding logistic regression analysis". Biochemia Medica. 24 (1): 12–18. doi:10.11613/BM.2014.003. ISSN 1330-0962. PMC 3936971. PMID 24627710.
^ "Use multiple logistic regression when you have one nominal variable and two or more measurement variables, and you want to know how the measurement variables affect the nominal variable." - [5] (Handbook of Biological Statistics)
^ "The multiple logistic regression equation is based on the premise that the natural log of odds (logit) is linearly related to independent variables." - [6] (Springer)
^ "The statistical program first calculates the baseline odds of having the outcome versus not having the outcome without using any predictor." - [7] (National Library of Medicine)
^ "Then, the chosen independent (input/predictor) variables are entered into the model, and a regression coefficient (known also as “beta”) and “P” value for each of these are calculated." - [8] (National Library of Medicine)
^ "The “P” value indicates whether the particular variable contributes significantly to the occurrence of the outcome or not." - [9] (National Library of Medicine)
^ "As in univariate logistic regression, let π(x) represent the probability of an event that depends on p covariates or independent variables. Then, using an inv.logit formulation for modeling the probability, we have: ..." - [10] (McGill Medical)
^ "... which shows that logistic regression is really just a standard linear regression model, ..." - [11] (McGill Medical)
^ "Linear regression has a continuous set of results that can easily be mapped on a graph as a straight line." - [12] (Indeed)
^ "Logistic regressions are non-linear and are portrayed on a graph with a curved shape called a sigmoid. Instead of a continuous set of results, a logistical regression has two or more categories for data." - [13] (Indeed)
^ "Logistic regression analysis is a statistical technique to evaluate the relationship between various predictor variables (either categorical or continuous) and an outcome which is binary (dichotomous)." - [14] (National Library of Medicine)
^ "A specific odds ratio from a simple logistic regression model can increase when other x-variables are included." - [15] (Ylva B. Almquist)
^ "Usually, it is just “noise”, i.e. not any large increases, and therefore not much to be concerned about. But it can also reflect that there is something going on that we need to explore further." - [16] (Ylva B. Almquist)
^ "Multiple logistic regression assumes that the observations are independent." - [17] (Statistics LibreTexts)
^ "he main null hypothesis of a multiple logistic regression is that there is no relationship between the X variables and the Y variable;" - [18] (LibreTexts)
^ "Logistic regression includes three basic types: ..." - [19] (Indeed)
^ "A binary output is a variable where there are only two possible outcomes. These outcomes must be opposite of each other and mutually exclusive." - [20] (Indeed)
^ "A multi-class has three or more categories without any numerical value, though they usually have a numerical stand-in for datasets." - [21] (Indeed)
^ "An ordinal output also has three or more categories, though they're in a ranked output." - [22] (Indeed)
^ [23] (Springer)
^ "Multivariable regression models are used to establish the relationship between a dependent variable (i.e. an outcome of interest) and more than 1 independent variable. Multivariable regression can be used to (i) identify patient characteristics associated with an outcome (often called ‘risk factors’), (ii) determine the effect of a procedural technique on a particular outcome, (iii) adjust for differences between groups to allow a comparison of different treatment strategies, (iv) quantify the magnitude of an effect size, (v) develop a propensity score and (vi) develop risk-prediction models." - [24] (Oxford Academic)
^ "Epidemiologists use multiple logistic regression a lot, because they are concerned with dependent variables such as alive vs. dead or diseased vs. healthy, and they are studying people and can't do well-controlled experiments, so they have a lot of independent variables." - [25] (Handbook of Biological Statistics)
^ [26] (ScienceDirect)
^ "It is also used in market research to analyze consumer preferences among product categories." - [27] (This vs. That)
^ "This is a common classification algorithm used in data science and machine learning." - [28] (Indeed)
^ "Two statistical terms, multivariate and multivariable, are repeatedly and interchangeably used in the literature, when in fact they stand for two distinct methodological approaches. While the multivariable model is used for the analysis with one outcome (dependent) and multiple independent (a.k.a., predictor or explanatory) variables, multivariate is used for the analysis with more than 1 outcome[s] (eg, repeated measures) and multiple independent variables." - [29] (Oxford Academic)
^ "Number of variables: One dependent (y), At least two independent (x)" - [30] (Ylva B. Almquist)

[1] "... while multivariate logistic regression deals with multiple outcomes simultaneously." - [1] (This vs. That)

[2] "In contrast, multivariate logistic regression involves analyzing the relationship between multiple outcome variables and one or more predictors. This can lead to more complex interpretations, as researchers must consider the impact of predictors on each outcome variable." - [2] (This vs. That)

[3] "Number of variables: One dependent (y), At least two independent (x)" - [3] (Ylva B. Almquist)

[4] "Multivariate logistic regression is a type of analysis that can help predict results when you're working with multiple variables." - [4] (Indeed)

[:0-5] Sperandei, Sandro (2014). "Understanding logistic regression analysis". Biochemia Medica. 24 (1): 12–18. doi:10.11613/BM.2014.003. ISSN 1330-0962. PMC 3936971. PMID 24627710.

[6] "Use multiple logistic regression when you have one nominal variable and two or more measurement variables, and you want to know how the measurement variables affect the nominal variable." - [5] (Handbook of Biological Statistics)

[7] "The multiple logistic regression equation is based on the premise that the natural log of odds (logit) is linearly related to independent variables." - [6] (Springer)

[8] "The statistical program first calculates the baseline odds of having the outcome versus not having the outcome without using any predictor." - [7] (National Library of Medicine)

[9] "Then, the chosen independent (input/predictor) variables are entered into the model, and a regression coefficient (known also as “beta”) and “P” value for each of these are calculated." - [8] (National Library of Medicine)

[10] "The “P” value indicates whether the particular variable contributes significantly to the occurrence of the outcome or not." - [9] (National Library of Medicine)

[11] "As in univariate logistic regression, let π(x) represent the probability of an event that depends on p covariates or independent variables. Then, using an inv.logit formulation for modeling the probability, we have: ..." - [10] (McGill Medical)

[12] "... which shows that logistic regression is really just a standard linear regression model, ..." - [11] (McGill Medical)

[13] "Linear regression has a continuous set of results that can easily be mapped on a graph as a straight line." - [12] (Indeed)

[14] "Logistic regressions are non-linear and are portrayed on a graph with a curved shape called a sigmoid. Instead of a continuous set of results, a logistical regression has two or more categories for data." - [13] (Indeed)

[15] "Logistic regression analysis is a statistical technique to evaluate the relationship between various predictor variables (either categorical or continuous) and an outcome which is binary (dichotomous)." - [14] (National Library of Medicine)

[16] "A specific odds ratio from a simple logistic regression model can increase when other x-variables are included." - [15] (Ylva B. Almquist)

[17] "Usually, it is just “noise”, i.e. not any large increases, and therefore not much to be concerned about. But it can also reflect that there is something going on that we need to explore further." - [16] (Ylva B. Almquist)

[18] "Multiple logistic regression assumes that the observations are independent." - [17] (Statistics LibreTexts)

[19] "he main null hypothesis of a multiple logistic regression is that there is no relationship between the X variables and the Y variable;" - [18] (LibreTexts)

[20] "Logistic regression includes three basic types: ..." - [19] (Indeed)

[21] "A binary output is a variable where there are only two possible outcomes. These outcomes must be opposite of each other and mutually exclusive." - [20] (Indeed)

[22] "A multi-class has three or more categories without any numerical value, though they usually have a numerical stand-in for datasets." - [21] (Indeed)

[23] "An ordinal output also has three or more categories, though they're in a ranked output." - [22] (Indeed)

[24] [23] (Springer)

[25] "Multivariable regression models are used to establish the relationship between a dependent variable (i.e. an outcome of interest) and more than 1 independent variable. Multivariable regression can be used to (i) identify patient characteristics associated with an outcome (often called ‘risk factors’), (ii) determine the effect of a procedural technique on a particular outcome, (iii) adjust for differences between groups to allow a comparison of different treatment strategies, (iv) quantify the magnitude of an effect size, (v) develop a propensity score and (vi) develop risk-prediction models." - [24] (Oxford Academic)

[26] "Epidemiologists use multiple logistic regression a lot, because they are concerned with dependent variables such as alive vs. dead or diseased vs. healthy, and they are studying people and can't do well-controlled experiments, so they have a lot of independent variables." - [25] (Handbook of Biological Statistics)

[27] [26] (ScienceDirect)

[28] "It is also used in market research to analyze consumer preferences among product categories." - [27] (This vs. That)

[29] "This is a common classification algorithm used in data science and machine learning." - [28] (Indeed)

[30] "Two statistical terms, multivariate and multivariable, are repeatedly and interchangeably used in the literature, when in fact they stand for two distinct methodological approaches. While the multivariable model is used for the analysis with one outcome (dependent) and multiple independent (a.k.a., predictor or explanatory) variables, multivariate is used for the analysis with more than 1 outcome[s] (eg, repeated measures) and multiple independent variables." - [29] (Oxford Academic)

[31] "Number of variables: One dependent (y), At least two independent (x)" - [30] (Ylva B. Almquist)

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21]

[22]

[23]

[24]

[25]

[26]

[27]

[28]

[29]

[30]

[31]