Questions tagged [parallel-builds]

Parallel building harnesses the advantages of multi-core processors to speed up compilation and building, by compiling several files in parallel.

58 questions
4
votes
0 answers

how to make sure that a maven plugin is thread safe

I have few maven plugins that were developed in my team, and those plugins are not marked @threadSafe. I have run around 50 jobs and I do not see in inconsistency, but I would like to know if there is way to verify this programmatically. And what…
Optimus
  • 697
  • 2
  • 8
  • 22
3
votes
0 answers

Maven fails to download artifacts from local nexus

I have a problem with downloading artifacts from our local nexus, sorry if this is a bit long. Our sources tree is divided into several projects, let's call them A and B. B is dependent on a release version of A that is deployed to our local Nexus…
Guy Marom
  • 166
  • 1
  • 9
3
votes
0 answers

How to change folder path in DerivedData?

I have the following scenario: whenever i do a build, i know that my products and build artifacts get generated in a folder like: /Users/david/Library/Developer/Xcode/DerivedData/MyProject-foobar123. Unfortunately, i'd like to multiple xctool build…
David T.
  • 22,301
  • 23
  • 71
  • 123
3
votes
1 answer

CMake parallel build for Fortran-90+ with modules

I have a problem building multiple Fortran-90+ executable targets using CMake, when I use Fortran modules that are shared by all executables, and build in parallel using make -j. The issue seems to be that the compiled object files are placed in…
AstroFloyd
  • 405
  • 5
  • 14
2
votes
1 answer

Maven 3 Parallel build Projects Skipped

Does anybody know of any reason why some of my projects are marked as SKIPPED at the end of a successful maven build? please note that the 'skip chain' always starts with my web project which includes the following features: jspc-maven-plugin war…
Guy Segev
  • 41
  • 5
2
votes
2 answers

Makefile: why always use `$(MAKE)` instead of `make`?

I usually use a high level build system like cmake for building my C/C++ code. But for various reasons I am using straight GNU make. I am doing recursive build where each directory has a makefile. I recently had to change all my makefiles from using…
Trevor Boyd Smith
  • 18,164
  • 32
  • 127
  • 177
2
votes
1 answer

Restrict concurrency in sub-make

For a project spread over several sub-directories we use GNU make for the builds. Developers can use the -j flag to parallelize the build tasks, and choose a number that suits the hardware of their machines. However, the Makefiles of a…
Ludwig Schulze
  • 2,155
  • 1
  • 17
  • 36
2
votes
1 answer

issue with using MSBUILD with maxcpucount option

I am using MsBuild on a 4 core machine. I am giving the following command line to build 4 projects belonging to a big VC++ solution ( having more than 4 projects ALL with no mutual dependencies ). I am using Visual Studio 2008. To speed up the…
user311906
  • 1,575
  • 2
  • 14
  • 17
2
votes
1 answer

Preventing ant dependencies to be called multiple times in parallel

Background: I have a build process that compiles java code and builds two jars using the compiled classes (each jar a different subset, with some classes appearing in both). Now, I was required that the users to be able to build each jar separately,…
yossiz74
  • 889
  • 1
  • 9
  • 16
2
votes
1 answer

Does setting -j8 in MAKEFLAGS cause problems for recursive make?

I asked a question about setting the '-j8' flag globally, and the answer suggested setting MAKEFLAGS="-j8" in /etc/environment, but they said it could be a problem for recursive make. However, GNU documentation says that -j8 will be treated in a…
sashoalm
  • 75,001
  • 122
  • 434
  • 781
2
votes
2 answers

Debugging CMake/Make dependencies for a parallel build

I manage for work a complex C++ project, whose build definitions are written in CMake and the build itself is obtained by invoking make. The source tree is composed by many modules and it is highly parallelizable. A linear build always succeeds,…
Marco Leogrande
  • 8,050
  • 4
  • 30
  • 48
1
vote
1 answer

Better parallelization of jenkins build nodes

I have a Jenkins jobs that runs as so (very simplified but the structure is there): #!/usr/bin/env groovy node('my_label'){ timestamps{ build() postBuild() } } def build(){ parallel{ flavorABuild: { if(condtionA){ …
1
vote
0 answers

cmake target created with ADD_CUSTOM_TARGET() generated multiple times in parallel mode

I have project name libtld where I first create a tool¹: project(tld_parser) add_executable(${PROJECT_NAME} ../tools/tldc.cpp tld_compiler.cpp tld_file.cpp tld_strings.c ) Then I use that tool to generate the tld_data.c file, which…
Alexis Wilke
  • 19,179
  • 10
  • 84
  • 156
1
vote
0 answers

Running parallel builds in codebuild

I am trying to run commands in parallel in codebuild using the batch-list function, however, I cannot get it to work as intended. The commands are getting executed sequentially and not in parallel. Below is the buildspec file. version: 0.2 phases: …
Bhargav Mg
  • 337
  • 4
  • 12
1
vote
1 answer

Parallelizing gradle tasks like GNU Makefile

I followed the tutorial in https://guides.gradle.org/using-the-worker-api/ and got the example working. Summary: It's about parallelization of tasks in a gradle run, supported since version 4.0, and the gradle team obviously thinks they have a nice…
Daniel Alder
  • 5,031
  • 2
  • 45
  • 55