Expectation Maximization (often abbreviated EM) is an iterative algorithm that can be used for maximum likelihood estimation in the presence of missing data or hidden variables.
Questions tagged [expectation-maximization]
125 questions
0
votes
1 answer
EM algorithm with Beta Distribution in R
I would like to write R code to build the dirichlet mixture model.
The loglikelihood I used for the beta distribution is as below:
(,)=(−1)ln¯+(−1)ln(1−)¯+lnΓ(+)−lnΓ()−lnΓ()
and I need help for initialising parameters (alpha, beta and setting…

hollyjolly
- 115
- 11
0
votes
0 answers
Python package for parameter estimation in PGMs with continuous variables
I am looking for a Python package to work on a probabilistic graphical model (PGM) with categorical and continous variables. Some nodes in the PGM are latent variables. The conditional probabilities are defined by continuous functions such as Beta…

Kowshika
- 1
0
votes
0 answers
Modal regression
enter image description here
I am working on a problem of modal regression using EM algorithm. The image shown here is achieved using mean shift algorithm by Chen et . However, using EM, I am not able to obtain a multiple estimated lines. Can …

user491683
- 11
- 1
0
votes
1 answer
How can one add/remove components from a sklearn gmm object for further warm start?
The sklearn.mixture object GaussianMixture provides the framework to fit a GMM to provided data, but how can one add/remove components from a sklearn gmm object for further warm start?

pietro_molina
- 97
- 1
- 9
0
votes
1 answer
Defining the EM parameters
I have a list of observations where each data point is a pair of a time expression (e.g. night, morning) and an hour in a 12-hr clock (i.e. 1, 2, ..., 12): Y = {}_i={1,...,N}. I would like to estimate the distribution of hours in a 24-hr…

Vered
- 21
- 3
0
votes
1 answer
Expectation Maximization in Python
I'm tasked with implementing the expectation-maximization algorithm for a class I'm in. In the notes, my professor evaluated the iterative formulas used in the code, I've checked them and they're written correctly.
The question asks us to create…

NoVa
- 317
- 3
- 15
0
votes
1 answer
Python- how to get top terms per cluster after using EM clustering with doc2vec input file?
I have collection of 300 docs.
I used doc2vec as input file for EM clustering. vector size = 30
I used WEKA to do the clustering. The result is in arff…

Noor
- 11
0
votes
1 answer
Compute probability of parameters given data in a bayesian network with pyMC3
I’m new to pyMC3 and I would like to know if it is possible to use it to solve the following problem: I have a bayesian network (image of my BN: Bayesian network of my problem) and I don’t know the parameters of the distributions of A,B,C,D and S, I…
0
votes
0 answers
Does anyone have a routine example implementation of Numerical Recipes 3rd Ed estep/mstep find in gaumixmod.h header?
I'm starting with the use of "Numerical Recipes 3ed", and I would like to implement the "estep" and "mstep" of the chapter 16, I can't find examples to help me and allow me to get started without difficulty and manage to exploit the gaumixmod.h…

RA AM
- 1
0
votes
0 answers
Is this code for Gaussian Mixture Model correct?
I am learning GMM to do color segmentation. I found a good resource online with the following GMM code:
import matplotlib.pyplot as plt
from matplotlib import style
style.use('fivethirtyeight')
import numpy as np
from scipy.stats import…

Marlborough321
- 11
- 1
0
votes
0 answers
EM algorithm python on MNIST image data
I need to implement the EM algorithm for fitting a GMM on image data (pixels). The data was provided as a .mat file. The data is similar to the MNIST dataset. So it's a matrix of images with the shape 784 x 1990. There are 1990 images, and each…

zelda26
- 489
- 2
- 10
- 33
0
votes
1 answer
Converting Mat to one dimensional float array for EM?
I'm trying to convert a Python code to Java. However, I'm unable to find a way to create the sample to train the Expectation Maximization as it should be a one-channel matrix with 2 values (S and V from HSV Color Space) as below:
row 0: S, V
row 1:…

Tarcisiofl
- 123
- 1
- 4
- 16
0
votes
1 answer
Perl Expectation Maximization of log-odds scores of DNA sequences
My overall goal for this code is to find the motif (smaller sequence) in each DNA sequence that will report a maximum log-odds score based on a log-odds scoring matrix. The .txt file I am searching through looks like this:
>Sequence…

William
- 39
- 7
0
votes
1 answer
Including time dependency in gaussian mixture model/expectation–maximization model?
I'm working on a time series dataset and therefore while fitting the GaussianMixture() function from the scikit-learn package, I need to make each feature(timestamp) dependent. However, I don't find a parameter to customize the covariance matrix…

Cocoa Wang
- 23
- 8
0
votes
0 answers
Expectation Maximization implementation
I am not sure as to what I am doing wrong with this code. I am trying to implement the expectation maximization algorithm(pseudo code screenshot below) and I think I am not minimizing the Beta correctly. Any thoughts on how I can fix this?
This is…

ersh
- 339
- 2
- 8