Building Numpy with MKL

Numpy and SciPy are very powerful Python extensions for numerical and scientific computing. One can easily install their generic versions via standard Ubuntu commands:

ilya@lin1:/tmp$ sudo pip install numpy

The problem with generic versions is that they are not optimized for a particular platform and don’t use platform-specific libraries that you might have installed. If you do have optimized mathematical libraries, in particular Intel’s MKL, using them with Numpy/SciPy can make a huge difference in performance.

To illustrate it we can compare generic Numpy with the version that uses MKL using a very simple benchmark. The following program performs a multiplication of two dense matrices followed by an eigenvalue decomposition.

ilya@lin1:/tmp$ cat numpy_blas_time.py 
import time
import numpy as np

A = np.random.rand(2000,2000)
B = np.random.rand(2000,2000)

print('Matrix multiplication')
time1 = time.time()
clock1 = time.clock()
C = np.dot(A,B) 
clock2 = time.clock()
time2 = time.time()
print('  Elapsed time: %.02f sec.' % (time2-time1) )
print('  CPU time: %.02f sec.' % (clock2-clock1) )

print('Eigenvalue computation')
time1 = time.time()
clock1 = time.clock()
np.linalg.eig(A)
clock2 = time.clock()
time2 = time.time()
print('  Elapsed time: %.02f sec.' % (time2-time1) )
print('  CPU time: %.02f sec.' % (clock2-clock1) )

After installing Numpy I am getting the following run times for these two operations on a two-core Skylake system (Intel i5-6260U CPU @ 1.80GHz):

ilya@lin1:/tmp$ python numpy_blas_time.py
Matrix multiplication
  Elapsed time: 17.62 sec.
  CPU time: 17.62 sec.
Eigenvalue computation
  Elapsed time: 82.66 sec.
  CPU time: 82.67 sec.

Here the elapsed time is just the wall clock time and CPU time is the time the CPU cores are busy. CPU time can be lower than the elapsed time if cores go idle or it can exceed the elapsed time on a parallel system if the program uses multiple cores concurrently. Here the two measurements match meaning that Numpy keeps a core busy throughout the computation but executes it serially.

Now we can uninstall Numpy

ilya@lin1:/tmp$ sudo pip uninstall numpy

then download the source version from http://sourceforge.net/projects/numpy/files/NumPy/ and build it locally with MKL. We untar the Numpy distribution file and create the site.cfg file using site.cfg.example as a template and pointing to the location of MKL libraries (following Intel Developer Zone suggestions):

ilya@lin1:~/Tools/numpy/numpy-1.10.4$ diff site.cfg site.cfg.example 
157,161d156
< [mkl]
< include_dirs = /opt/intel/compilers_and_libraries/linux/mkl/include
< library_dirs = /opt/intel/compilers_and_libraries/linux/mkl/lib/intel64
< mkl_libs = mkl_rt
< lapack_libs =

Now it’s time to compile and install the optimized Numpy.

ilya@lin1:~/Tools/numpy/numpy-1.10.4$ export LD_LIBRARY_PATH=/opt/intel/compilers_and_libraries/linux/mkl/lib/intel64:${LD_LIBRARY_PATH}
ilya@lin1:~/Tools/numpy/numpy-1.10.4$ python setup.py config --compiler=intel build_clib --compiler=intel build_ext --compiler=intel build
ilya@lin1:~/Tools/numpy/numpy-1.10.4$ sudo python setup.py config --compiler=intel build_clib --compiler=intel build_ext --compiler=intel install

After the installation is complete we can rerun the same test program to see the effect of MKL.

ilya@lin1:/tmp$ python numpy_blas_time.py
Matrix multiplication
  Elapsed time: 1.86 sec.
  CPU time: 3.66 sec.
Eigenvalue computation
  Elapsed time: 11.46 sec.
  CPU time: 21.06 sec.

We can see almost a tenfold improvement in performance for both operations. We can also notice that the CPU time is almost twice the elapsed time which indicates that the computations are running in parallel now using both cores of the system.

Similarly we can download and build SciPy (http://sourceforge.net/projects/scipy/files/).

SciPy inherits library configuration from NumPy so we don’t need any additional steps to point it to MKL

ilya@lin1:~/Tools/scipy$ unzip scipy-0.16.1.zip 
ilya@lin1:~/Tools/scipy$ cd scipy-0.16.1/
ilya@lin1:~/Tools/scipy/scipy-0.16.1$ python setup.py config --compiler=intelem --fcompiler=intelem build_clib --compiler=intelem --fcompiler=intelem build_ext --compiler=intelem --fcompiler=intelem build 
ilya@lin1:~/Tools/scipy/scipy-0.16.1$ sudo python setup.py config --compiler=intelem --fcompiler=intelem build_clib --compiler=intelem --fcompiler=intelem build_ext --compiler=intelem --fcompiler=intelem install

Once we are at it, we can install scikit-learn as well

$ sudo pip uninstall -U scikit-learn

and a few other packages 

$ sudo apt-get install libfreetype6-dev
$ sudo pip install matplotlib
$ sudo pip install nltk

Note that if you have multiple Python installations (e.g. 2.7 and 3.5), you need to build and install optimized Numpy, SciPy and other packages for all of them.

0 thoughts on “Building Numpy with MKL”

  7. Appreciate it! A good amount of knowledge!
    http://canadianpharmacymim.com/
    pharmacy prices north west pharmacy canada online pharmacies no prescription mexican pharmacies shipping to usa
    canadian prescriptions
    price prescription drugs
    buy prescription drugs from canada
    king pharmacy
    price prescription drugs
    discount drugs online pharmacy

    Reply

  13. Incredible many of fantastic data.
    http://canadianonlinepharmacynnm.com/
    prescription drug canadian pharmacy online canadian family pharmacy canadianpharmacy
    prescription cost comparison
    no prescription online pharmacy
    compare prescription prices
    canadian pharmacy no prescription
    prescription drugs canada
    no prescription online pharmacy

    Reply

  14. Superb write ups. Many thanks.
    http://canadianpharmacysilo.com/
    canadian pharmacies without prescriptions north west pharmacy canada canada pharmacy no prescription canadian online pharmacy
    no 1 canadian pharcharmy online
    best online pharmacies canada
    canadian drugstore reviews
    online pharmacy reviews
    get prescription online
    canadian pharmacies without prescriptions

    Reply

  17. Nicely voiced truly! .
    http://canadianpharmacysilo.com/
    prescription without a doctor’s prescription online pharmacies canada pharmacy online store online pharmacies of canada
    online canadian discount pharmacy
    canada drugs
    mexican online pharmacies
    canadian online pharmacy
    best online pharmacies canada
    <a href="http://www.marieauthouartcreation.fr/?s=You+actually+explained+that+exceptionally+well.+http%3A%2F%2Fcanadianpharmacysilo.com%2F+canadapharmacyonline.com+canada+pharmacy+price+prescription+drugs+global+pharmacy+canada+%0D%0Acanadian+online+pharmacies+%0D%0Amail+order+pharmacies+%0D%0Aonline+pharmacy+without+prescription+%0D%0Aonline+drugstore+%0D%0Apharmacy+price+comparison+%0D%0Areputable+canadian+mail+order+pharmacies”>canada drugs pharmacy

    Reply

  18. You made your stand pretty clearly..
    http://www.canadianpharmacymsn.com/
    medical information online aarp approved canadian online pharmacies canadian viagra canadian viagra
    online pharmacy canada
    discount prescription drug
    online pharmacy without prescription
    prescription prices comparison
    compare prescription prices
    online prescription drugs

    Reply

  28. Cheers, Ample tips!
    http://canadianpharmaciesnnm.com/
    canadian pharmacy uk delivery canadian pharmacies without an rx best canadian pharmacies canadian pharmacy
    reputable canadian mail order pharmacies
    approved canadian pharmacies online
    cheap prescription drugs online
    canada drugs pharmacy
    24 hour pharmacy
    buy prescription drugs online

    Reply

  30. Truly lots of wonderful knowledge!
    https://nicktambone.com/
    canadian pharmacies shipping to usa canadian online pharmacies best canadian pharmacies canadian viagra
    prescription drug price comparison
    drugstore online
    canada pharmacies prescription drugs
    canadian pharmacy online
    online pharmacies no prescription
    online discount pharmacy

    Reply

  31. Amazing plenty of amazing advice!
    http://talahicc.com/
    canadian drug stores online canadianpharmacy canadian rx canada pharmaceuticals online
    medication costs
    prescription drug assistance
    canada pharmacy online
    canadian drug stores online
    northwest pharmacy canada
    <a href="http://mecetes.org/?s=+Superb+advice.+Kudos%21+http%3A%2F%2Ftalahicc.com%2F+my+canadian+pharmacy+top+rated+canadian+pharmacies+online+canadian+pharmacy+no+prescription+north+west+pharmacy+canada+%0D%0Aonline+pharmacy+usa+%0D%0Acanadian+rx+%0D%0Aprescription+drug+%0D%0Amexican+online+pharmacies+%0D%0Abest+online+pharmacy+%0D%0Acanadian+prescriptions”>best canadian online pharmacy

    Reply

  33. With thanks, Wonderful information.
    http://www.canadianpharmacymsn.com/
    canadian drugstore northwest pharmacy pain meds online without doctor prescription canadian pharmacies
    buy prescription drugs without doctor
    <a href="http://www.ikeaclub.biz.ua/lib/ajax/contact_us_form.php?form_ajax=contacts&name=Quentinnax&email=zittel020eejf%40songwriter.net&phone=89451759949&message=+Wonderful+data.+Many+thanks%21+http%3A%2F%2Fcanadianpharmacysilo.com%2F+canadian+drug+stores+online+trust+pharmacy+canada+mexican+pharmacies+shipping+to+usa+canadian+pharmacies+without+an+rx+%0D%0Acanadian+pharmacy+meds+%0D%0Adrugstore+online+%0D%0Abest+online+pharmacies+no+prescription+%0D%0Apharmacy+prescription+%0D%0Acanada+online+pharmacy+%0D%0Aweb+medical+information&security_code=%21UNKNOWN_TYPE%21&send=”>canadian online pharmacy reviews
    rx pharmacy
    discount prescription drug
    prescription drug price comparison
    discount pharmacy online

    Reply

  42. Amazing tips. Many thanks!
    http://www.canadianpharmacymsn.com/
    buy prescription drugs online canadian pharmacies that ship to us canadian pharmacy viagra north west pharmacy canada
    canadian pharmacy online canada
    canadian pharmacy uk delivery
    overseas pharmacy forum
    buy prescription drugs without doctor
    <a href="http://meier-mediadesign.ch/?s=+Thank+you%2C+Useful+stuff.+http%3A%2F%2Fcanadianpharmacyntx.com%2F+best+price+prescription+drugs+aarp+approved+canadian+online+pharmacies+northwestpharmacy+canadian+cialis+%0D%0Abest+online+canadian+pharcharmy+%0D%0Acanadian+drugstore+reviews+%0D%0Apharmacy+tech+%0D%0Apharmacy+drug+store+%0D%0Aoverseas+pharmacy+forum+%0D%0Alegitimate+online+pharmacies”>canada drugs
    walmart pharmacy price check

    Reply

  43. You stated this very well!
    http://canadianpharmacysilo.com/
    canada pharmacy online reviews online pharmacies of canada reputable canadian mail order pharmacies online pharmacies canada
    pharmacy drug store
    canadian drug store
    walmart pharmacy price check
    cheap prescription drugs online
    canadian rx pharmacy online
    get prescription online

    Reply

  48. Excellent posts. Many thanks!
    http://canadianpharmacymim.com/
    prescription price comparison aarp approved canadian online pharmacies canadian mail order pharmacies canada pharmaceutical online ordering
    canadian pharma companies
    canadian viagra
    rx price comparison
    online discount pharmacy
    canadadrugs
    online pharmacy without prescription

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *