Matlab parfor loop indexing

Question

Does anybody know what's going on in this simple code using parfor in matlab? Thanks,

I sliced a matrix into four arrays and want to update elements in each array independently

Here is a simple version:

a = zeros(4,4);  
parfor i = 1:4  
    j = 2;      
    a(j,i) = 3;  
end

error:Valid indices for 'a' are restricted in parfor loops;

however,

this works:

a = zeros(4,4);  
parfor i = 1:4  
    a(2,i) = 3;  
end

another simpler nonworking version with the same error:

a = zeros(4,4);  
parfor i = 1:4  
    a(i,i) = 3;  
end

in my application, index j is generated independently for each array through some algorithm

Seems like you cannot set other index variables inside the loop. See: http://www.mathworks.com/matlabcentral/newsreader/view_thread/162203 — cyang, Mar 22 '13 at 19:22
Although I don't have it in my version of MATLAB, I think it's worthy to give a look at `parpool` - http://www.mathworks.it/it/help/distcomp/parpool.html — Pantelis Sopasakis, Sep 24 '14 at 10:47

Pantelis Sopasakis · Answer 1 · 2016-11-08T21:34:59.680

Just my two cents: As @mmumbos already explained, what you're trying to achieve is not possible this way, but certain workarounds can still apply.

Let's assume you need to implement something like the following (which is the permutation of a linear transformation of matrix A):

n=10;
A=rand(n,n);
B=zeros(n,n);
parfor i=1:n,
  j=(i<=5)*(2*(i-1)+1)+(i>5)*(2*(i-5));
  B(j,i) = my_function(A(i,:));
end

Try instead the following:

parfor i=1:n,
  B_temp(i,:) = my_function(A(i,:));
end

Then, you don't really need to construct matrix B; you can access it using B_temp using an ''index table'' which is simply constructed as follows:

J=zeros(n,1);
parfor i=1:n,
  J(i) = (i<=5)*(2*(i-1)+1)+(i>5)*(2*(i-5));
end

Then B(i) is accessed via B_temp(J(i)).

Revisiting your last (counter)example, let's see how you can work it around:

n=4;
diag_A = zeros(n,1);
parfor i=1:n,
    diag_A(i)=3; % or any function of i
end

Then, whenever you need to access the ''i''-th diagonal element of A, you access instead diag_A(i). For such cases it is convenient to create a function along the following lines:

function a = access_matrix(A, diag_A, i, j)
  if (i!=j), 
    a = A(i,j);
  else
    a = diag_A(i);
  end
end

Until MATLAB improves the implementation of parfor, such workarounds will (unfortunately) be necessary in lots of cases.

Your second section of code used to construct `B_temp` causes an error in Matlab (R2016a). — Erik M, Nov 08 '16 at 19:00
@ErikM Thank a lot - you actually found a typo. The left hand side should have been `B_temp(i,:)` instead of `B_temp(i,i)` — Pantelis Sopasakis, Nov 08 '16 at 21:35

score 2 · Answer 2 · answered Mar 23 '13 at 14:50

2

What you are trying to achieve seems not to be possible.

According to the matlab documentation:

When you use other variables along with the loop variable to index an array, you cannot set these variables inside the loop. In effect, such variables are constant over the execution of the entire parfor statement. You cannot combine the loop variable with itself to form an index expression.

MATLAB Documentation Source

So all variables you use to index your array, other than the loop variable have to be constant for the entire loop.

answered Mar 23 '13 at 14:50

mmumboss

690
1
5
13

I see. I saw it's possible to nest a for loop within a parfor to index a 2D array. The "for" loop variable, for example: for j = 1:4 {a(i,j) =..} can change within the parfor loop: for i = 1:4 {}. It seems to me as long as j is the same for all parfor iterations, it's safe. In fact, I found this in the document you refer :"Fixed Index Listing — Within the first-level parenthesis or braces, the list of indices is the same for all occurrences of a given variable (sliced variable)". – Zongyi Gong Mar 24 '13 at 00:08

score 1 · Answer 3 · answered Jan 21 '16 at 20:25

Since it hasn't been mentioned yet, here's a link which is really helpful for diagnosing these types of issues: Classification of Variables in Parfor. These issues arise when MATLAB cannot classify the variables into the rigid definitions it outlines on that page.

What's happening here is that it does not know how to slice up the "slice variable" A before the loop. Think about programming the parallel implementation yourself. What you would want to do is cut-up A into even pieces that you know other processors won't touch, and then give them to different CPUs to act indpendently. MATLAB looks at your loop and doesn't know how to do this because it doesn't know what j is until it's running the program. It's a limitation of MATLAB. Another case where the same thing happens if you use complex coefficients like A(i*j,:). Once again it doesn't know how to split it up.

Matlab parfor loop indexing

3 Answers3