Preprint Article Version 1 Preserved in Portico This version is not peer-reviewed

Conditional Mixture Model and Its Application for Regression Model

Version 1 : Received: 24 October 2020 / Approved: 27 October 2020 / Online: 27 October 2020 (11:41:42 CET)
Version 2 : Received: 28 October 2020 / Approved: 28 October 2020 / Online: 28 October 2020 (11:18:04 CET)

How to cite: Nguyen, L. Conditional Mixture Model and Its Application for Regression Model. Preprints 2020, 2020100550 (doi: 10.20944/preprints202010.0550.v1). Nguyen, L. Conditional Mixture Model and Its Application for Regression Model. Preprints 2020, 2020100550 (doi: 10.20944/preprints202010.0550.v1).

Abstract

Expectation maximization (EM) algorithm is a powerful mathematical tool for estimating statistical parameter when data sample contains hidden part and observed part. EM is applied to learn finite mixture model in which the whole distribution of observed variable is finite sum of partial distributions. Coverage ratio of every partial distribution is specified by the probability of hidden variable. An application of mixture model is soft clustering in which cluster is modeled by hidden variable whereas each data point can be assigned to more than one cluster and degree of such assignment is represented by the probability of hidden variable. However, such probability in traditional mixture model is simplified as a parameter, which can cause loss of valuable information. Therefore, in this research I propose a so-called conditional mixture model (CMM) in which the probability of hidden variable is modeled as a full probabilistic density function (PDF) that owns individual parameter. CMM aims to improve power of mixture model. I also propose an application of CMM which is called adaptive regressive model (ARM). Traditional regression model is effective when data sample is scattered equally. If data points are grouped into clusters, regression model tries to learn a unified regression function which goes through all data points. Obviously, such unified function is not effective to evaluate response variable based on grouped data points. The concept “adaptive” of ARM means that ARM solves the ineffectiveness problem by selecting the best cluster of data points firstly and then evaluating response variable within such best cluster. In order words, ARM reduces estimation space of regression model so as to gain high accuracy in calculation.

Subject Areas

expectation maximization (EM) algorithm; finite mixture model; conditional mixture model; regression model; adaptive regressive model (ARM)

Comments (0)

We encourage comments and feedback from a broad range of readers. See criteria for comments and our diversity statement.

Leave a public comment
Send a private comment to the author(s)
Views 0
Downloads 0
Comments 0
Metrics 0


×
Alerts
Notify me about updates to this article or when a peer-reviewed version is published.
We use cookies on our website to ensure you get the best experience.
Read more about our cookies here.