Questions tagged [parallelism-amdahl]

Amdahl's law, also known as Amdahl's argument, is used to find the maximum expected improvement to an overall system when only part of the system is improved. It is often used in parallel computing to predict the theoretical maximum speedup using multiple processors. The law is named after computer architect Gene Amdahl, and was presented at the AFIPS Spring Joint Computer Conference in 1967.

Amdahl's law, also known as Amdahl's argument, is used to find the maximum expected improvement to an overall system when only part of the system is improved. It is often used in to predict the theoretical maximum speedup using multiple processors. The law is named after computer architect Gene Amdahl, and was presented at the AFIPS Spring Joint Computer Conference in 1967.

The speedup of a program using multiple processors in parallel computing is limited by the time needed for the sequential fraction of the program. For example, if a program needs 20 hours using a single processor core, and a particular portion of the program which takes one hour to execute cannot be parallelized, while the remaining 19 hours (95%) of execution time can be parallelized, then regardless of how many processors are devoted to a parallelized execution of this program, the minimum execution time cannot be less than that critical one hour. Hence the speedup is limited up to 20x.

106 questions
1
vote
1 answer

I have some algorithm, which is taking more than 5 hours to give the output. Is there any way to reduce the processing time?

I have one deterministic dynamic programming algorithm which consist of a recursive function and my code is taking forever (more than 5 hours) to give me an output as I increase the data points (x and s in below code). I heard there is something…
Saurabh
  • 199
  • 1
  • 3
  • 11
1
vote
1 answer

Amdahl's Law for specific heavy tasks

I have a set of tasks(sending SMS by GSM modem) which can be executed fully paralleled, but one sms task could not. Each task takes about lets say 10 second to execute. So now i am trying to evaluate how it would behave with 4 GSM modem. Amdahl’s…
1
vote
1 answer

Is it beneficial to parallelize variable declaration?

I wonder if it is beneficial when writing a parallel program to insert variables declarations into the parallel section? Because the Amdahl's law says that if more portion of the program is parallel it's better but I don't see the point to…
user7475082
1
vote
1 answer

OpenMP - Random running time - why having so high run-time variance?

I am following Tim Mattson's lectures on OpenMP to learn ways of implementation of some parallel programming concepts. I was trying to observe the running time behavior of a parallel program that computes the value of PI using 3x10^8 steps. Here is…
Shakil Ahamed
  • 587
  • 3
  • 18
1
vote
1 answer

How to run a parallel function inside a serial one in Python?

Maybe this is really simple, but I am having a bit of a problem understanding this. The challenge I have is to execute a child parallel function from inside a mother function. That mother function should run only once while waiting for the results…
1
vote
1 answer

Is it better to resume a process with different inputs in python or re-launch it?

I want to implement an online recursive parallel algorithm in python. So every time I got a new observation I want to calculate a new coefficient matrix. Each row on this matrix must be calculated on parallel. Is it too expensive to create for each…
1
vote
2 answers

Measure parallel speedup in randomized-algorithms

I have a randomized program with sequential and parallel variants. The nature of that program is that its run-time varies drastically depending on its "luck". It regularly takes values between 1sec and 2 min in a seemingly…
1
vote
1 answer

Does python's Pool() for parallelization prevent writing to global variables?

In python 2.7 I am trying to distribute the computation of a two-dimensional array on all of the cores. For that I have two arrays associated with a variable at the global scope, one to read from and one to write to. import itertools as it import…
1
vote
1 answer

RegCM, MPICH, Computer Clustering

Background: I need to run a huge computation for climate simulation with over 800 [GB] of data ( for the past 50 years and future 80 years ). For this, I'm using RegCM4 based in linux. I am using Ubuntu. The most powerful system we have has some…
anup
  • 465
  • 3
  • 18
1
vote
3 answers

How to replace multiple patterns in the same file, based on the line's first word?

I have a list of phrases in a single file ( "phrases" ), each being on its own line. I also have another file, which contains a list of words, each on a line ("words"). I wish to append an asterisk at the end of every phrase in "phrases", which…
Ifa
  • 33
  • 3
1
vote
1 answer

maximum speed up achieved

If only 80% of the execution time of the application could run in parallel, what is the maximum speedup you could achieve? I did something like this, 1-.8 = .2 overall speedup = 1/0.2 = 5 I am not sure weather I attempted right or wrong? Please…
Muhammad Usman
  • 115
  • 1
  • 2
  • 11
1
vote
2 answers

Why Amdahl Law on serial and parallel fractions does not provide a theoretical speedup of 4 on quad-core CPU?

I have a code ( the Floyd-Warshall algorithm for the shortest path in an NxN matrix ),with three for-loops, one within the other and with the same number of cycles. In the last for I have an assignment via a ternary-operation = ? :…
1
vote
0 answers

Speedup in execution time using Amdahl's law

I have been given this problem in one of my assignments. I understand the principles of the process of speedup, execution time etc.. However, I feel that this question is incomplete. Is it true or can it be solved? If so can you please explain. A…
0
votes
0 answers

Calculating theoretical speedup using Amdahl's Law

Hi I just wanted to get some thoughts on my working out on this question. Using Amdahl's law calculate the maximum theoretical speedup for a program comprised of 82% parallel code and 18% serial code running on 8 processing cores My thoughts is…
Priit
  • 1
  • 1
0
votes
0 answers

CPU utilization calculation in Amdahl's law

I am reading "Java Concurrency In Practice" and am stuck at one calculation presented in Amdahl's law section. Full text is also available here: https://flylib.com/books/en/2.558.1/amdahls_law.html " With ten processors, a program with 10%…
Akhil
  • 533
  • 2
  • 11
  • 26