Getting this simple problem while importing Xgboost on Jupyter notebook

Question

Everything was running fine in Jupyter notebook until I imported Xgboost. As soon as I import it I get the problem below. I have Python 3.8 and have installed it via terminal pip3 method, what should I do next?

---------------------------------------------------------------------------
XGBoostError                              Traceback (most recent call last)
<ipython-input-17-a81e4513ce38> in <module>
      1 # Let's Learn about the stock market using XGBOOST
      2 
----> 3 import xgboost as xgb

/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/xgboost/__init__.py in <module>
      9 import warnings
     10 
---> 11 from .core import DMatrix, DeviceQuantileDMatrix, Booster
     12 from .training import train, cv
     13 from . import rabit  # noqa

/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/xgboost/core.py in <module>
    173 
    174 # load the XGBoost library globally
--> 175 _LIB = _load_lib()
    176 
    177 

/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/xgboost/core.py in _load_lib()
    156     if not lib_success:
    157         libname = os.path.basename(lib_paths[0])
--> 158         raise XGBoostError(
    159             'XGBoost Library ({}) could not be loaded.\n'.format(libname) +
    160             'Likely causes:\n' +

XGBoostError: XGBoost Library (libxgboost.dylib) could not be loaded.
Likely causes:
  * OpenMP runtime is not installed (vcomp140.dll or libgomp-1.dll for Windows, 
       libomp.dylib for Mac OSX, libgomp.so for Linux and other UNIX-like OSes). 
       Mac OSX users: Run `brew install libomp` to install OpenMP runtime.
  * You are running 32-bit Python on a 64-bit OS
Error message(s): ['dlopen(/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/xgboost/lib/libxgboost.dylib, 6): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib\n  Referenced from: /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/xgboost/lib/libxgboost.dylib\n  Reason: image not found']

Solved I installed libomp.dylib for Mac OSX – jon May 23 '20 at 12:27 — jon, May 23 '20 at 12:27
Any idea how to do this on linux? – Wolfy Jan 12 '21 at 20:13 — Wolfy, Jan 12 '21 at 20:13

score 38 · Answer 1 · edited Jun 03 '21 at 08:38

38

I solved it by installing libomp.dylib for Mac OSX. The answer was there all along.

You can do it by running the following command :

brew install libomp

edited Jun 03 '21 at 08:38

Espoir Murhabazi

5,973
5
42
73

answered May 23 '20 at 12:28

jon

751
1
6
9

This fixed it for me too. – Renata Ghisloti Sep 03 '20 at 23:21
15

agreed, and to be specific i did `brew install libomp` – user Sep 24 '20 at 00:08
1

This didn't work for me on a M1 mac – jtb Feb 27 '23 at 17:53

score 18 · Answer 2 · answered Oct 08 '20 at 06:47

18

for Mac OSX, just run 'brew install libomp'

answered Oct 08 '20 at 06:47

Terence Yang

558
6
9

The error message said that `is an incompatible architecture (have 'arm64', need 'x86_64'))`. I think that it is still an unsolved issue for m1 mac users. btw, I had put the libomp.dylib to : `/usr/local/opt/libomp/lib/libomp.dylib` – Denny Chen Aug 09 '22 at 17:36

score 12 · Answer 3 · answered Apr 10 '21 at 20:00

12

If you use anaconda, you can use:

conda install py-xgboost

answered Apr 10 '21 at 20:00

berkayln

935
1
8
14

4

This worked for me on M1 Mac! No success even after `brew install libomp` – Utpal Kumar Jan 29 '22 at 02:33
Thanks for sharing! That solved it for me as well! – Timo Mar 01 '22 at 09:24

score 9 · Answer 4 · answered Dec 16 '21 at 00:32

The cause is that xgboost is looking for the dynamic library at the following locations, which is not where it might be installed to.

Reason: tried: '/libomp.dylib' (no such file), '/usr/local/opt/libomp/lib/libomp.dylib' (no such file), '/libomp.dylib' (no such file), '/Users/michaeltu/third-party/lib/libomp.dylib' (no such file)"]

First, brew install libomp if you haven't done so.

After that, check where brew installed the library.

$ brew info libomp
libomp: stable 12.0.0 (bottled)
LLVM's OpenMP runtime library
https://openmp.llvm.org/
/opt/brew/Cellar/libomp/12.0.0 (9 files, 1.5MB) *

We see it installed it here:

$ ls /opt/brew/Cellar/libomp/12.0.0/lib/
libomp.a    libomp.dylib

Make a simlink (based on the version of libomp you installed):

$ mkdir -p /usr/local/opt/libomp/
$ ln -s /opt/brew/Cellar/libomp/12.0.0/lib /usr/local/opt/libomp/lib

Try importing it again. This was able to resolve my issue.

score 4 · Answer 5 · edited Dec 20 '20 at 19:46

4

You must install brew on your MAC first: https://brew.sh/ (Brew might take a moment to install) Then run the following in your terminal: brew install libomp

edited Dec 20 '20 at 19:46

Federica Benacquista

835
11
25

answered Dec 20 '20 at 18:24

Sedo

41
1

score 3 · Answer 6 · answered Dec 09 '21 at 06:17

If brew install libomp doesn't work, libomp might be installed to a different place.

xgboost needs libomp.dylib under usr/local/opt/libomp/lib/libomp.dylib, but brew may install it under /opt/brew/Cellar/libomp/11.0.1/lib/libomp.dylib. You can copy yours to the xgboost required path.

score 1 · Answer 7 · answered Jul 26 '21 at 20:08

1

You can solve it as below if you have Python 3.7 or higher:

!brew install libomp

answered Jul 26 '21 at 20:08

berkayln

935
1
8
14

score 1 · Answer 8 · answered Aug 03 '21 at 18:36

1

Below command worked for me if you are using anaconda

conda install -c conda-forge xgboost

answered Aug 03 '21 at 18:36

Nitin Pal

21
1
6

Getting this simple problem while importing Xgboost on Jupyter notebook

8 Answers8