Numpy and SciPy are very powerful Python extensions for numerical and scientific computing. One can easily install their generic versions via standard Ubuntu commands:
ilya@lin1:/tmp$ sudo pip install numpy
The problem with generic versions is that they are not optimized for a particular platform and don’t use platform-specific libraries that you might have installed. If you do have optimized mathematical libraries, in particular Intel’s MKL, using them with Numpy/SciPy can make a huge difference in performance.
To illustrate it we can compare generic Numpy with the version that uses MKL using a very simple benchmark. The following program performs a multiplication of two dense matrices followed by an eigenvalue decomposition.
ilya@lin1:/tmp$ cat numpy_blas_time.py
import time
import numpy as np
A = np.random.rand(2000,2000)
B = np.random.rand(2000,2000)
print('Matrix multiplication')
time1 = time.time()
clock1 = time.clock()
C = np.dot(A,B)
clock2 = time.clock()
time2 = time.time()
print(' Elapsed time: %.02f sec.' % (time2-time1) )
print(' CPU time: %.02f sec.' % (clock2-clock1) )
print('Eigenvalue computation')
time1 = time.time()
clock1 = time.clock()
np.linalg.eig(A)
clock2 = time.clock()
time2 = time.time()
print(' Elapsed time: %.02f sec.' % (time2-time1) )
print(' CPU time: %.02f sec.' % (clock2-clock1) )
After installing Numpy I am getting the following run times for these two operations on a two-core Skylake system (Intel i5-6260U CPU @ 1.80GHz):
ilya@lin1:/tmp$ python numpy_blas_time.py
Matrix multiplication
Elapsed time: 17.62 sec.
CPU time: 17.62 sec.
Eigenvalue computation
Elapsed time: 82.66 sec.
CPU time: 82.67 sec.
Here the elapsed time is just the wall clock time and CPU time is the time the CPU cores are busy. CPU time can be lower than the elapsed time if cores go idle or it can exceed the elapsed time on a parallel system if the program uses multiple cores concurrently. Here the two measurements match meaning that Numpy keeps a core busy throughout the computation but executes it serially.
Now we can uninstall Numpy
ilya@lin1:/tmp$ sudo pip uninstall numpy
then download the source version from http://sourceforge.net/projects/numpy/files/NumPy/ and build it locally with MKL. We untar the Numpy distribution file and create the site.cfg
file using site.cfg.example
as a template and pointing to the location of MKL libraries (following Intel Developer Zone suggestions):
ilya@lin1:~/Tools/numpy/numpy-1.10.4$ diff site.cfg site.cfg.example
157,161d156
< [mkl]
< include_dirs = /opt/intel/compilers_and_libraries/linux/mkl/include
< library_dirs = /opt/intel/compilers_and_libraries/linux/mkl/lib/intel64
< mkl_libs = mkl_rt
< lapack_libs =
Now it’s time to compile and install the optimized Numpy.
ilya@lin1:~/Tools/numpy/numpy-1.10.4$ export LD_LIBRARY_PATH=/opt/intel/compilers_and_libraries/linux/mkl/lib/intel64:${LD_LIBRARY_PATH}
ilya@lin1:~/Tools/numpy/numpy-1.10.4$ python setup.py config --compiler=intel build_clib --compiler=intel build_ext --compiler=intel build
ilya@lin1:~/Tools/numpy/numpy-1.10.4$ sudo python setup.py config --compiler=intel build_clib --compiler=intel build_ext --compiler=intel install
After the installation is complete we can rerun the same test program to see the effect of MKL.
ilya@lin1:/tmp$ python numpy_blas_time.py
Matrix multiplication
Elapsed time: 1.86 sec.
CPU time: 3.66 sec.
Eigenvalue computation
Elapsed time: 11.46 sec.
CPU time: 21.06 sec.
We can see almost a tenfold improvement in performance for both operations. We can also notice that the CPU time is almost twice the elapsed time which indicates that the computations are running in parallel now using both cores of the system.
Similarly we can download and build SciPy (http://sourceforge.net/projects/scipy/files/).
SciPy inherits library configuration from NumPy so we don’t need any additional steps to point it to MKL
ilya@lin1:~/Tools/scipy$ unzip scipy-0.16.1.zip
ilya@lin1:~/Tools/scipy$ cd scipy-0.16.1/
ilya@lin1:~/Tools/scipy/scipy-0.16.1$ python setup.py config --compiler=intelem --fcompiler=intelem build_clib --compiler=intelem --fcompiler=intelem build_ext --compiler=intelem --fcompiler=intelem build
ilya@lin1:~/Tools/scipy/scipy-0.16.1$ sudo python setup.py config --compiler=intelem --fcompiler=intelem build_clib --compiler=intelem --fcompiler=intelem build_ext --compiler=intelem --fcompiler=intelem install
Once we are at it, we can install scikit-learn as well
$ sudo pip uninstall -U scikit-learn
and a few other packages
$ sudo apt-get install libfreetype6-dev
$ sudo pip install matplotlib
$ sudo pip install nltk
Note that if you have multiple Python installations (e.g. 2.7 and 3.5), you need to build and install optimized Numpy, SciPy and other packages for all of them.
Fine advice. Thanks a lot.
http://canadianonlinepharmacynnm.com/
prescription drugs canada
canadian pharmacies online
canada pharmacy no prescription
canadian online pharmacy
You actually suggested this adequately!
http://www.canadianpharmacymsn.com/
prescription drugs online without doctor northwestpharmacy buy drugs online canada online pharmacies
buy prescription drugs canada
prescription cost comparison
pharmacies in canada
highest rated canadian pharmacies
canadian cialis
discount drugs online pharmacy
Wonderful material, Many thanks.
http://talahicc.com/
canadian family pharmacy canadian cialis compare prescription prices canadian drugs
online pharmacy no prescription
buying drugs canada
buy online prescription drugs
online pharmacy no prescription needed
canadian online pharmacy
drugs for sale
This is nicely said! !
http://talahicc.com/
canadian pharmacies online northwestpharmacy costco pharmacy pricing canadian pharmacies
canadian drug stores online
canada meds
get prescription online
northwest pharmacy
canadian pharmacy
buy prescription drugs online
You actually revealed this very well!
http://canadianpharmacyntx.com/
online pharmacy no prescription canadian viagra overseas pharmacy forum canada online pharmacies
pharmacy drug store
online discount pharmacy
canada pharmacy online orders
mexican pharmacies
northwest pharmacy
best price prescription drugs
Seriously plenty of superb knowledge.
http://canadianonlinepharmacynnm.com/
costco pharmacy pricing canadian pharcharmy buy prescription drugs online online pharmacies canada
the canadian pharmacy
overseas pharmacy forum
buy prescription drugs without doctor
candrugstore com
canadian pharmacy king
walgreens pharmacy
Appreciate it! A good amount of knowledge!
http://canadianpharmacymim.com/
pharmacy prices north west pharmacy canada online pharmacies no prescription mexican pharmacies shipping to usa
canadian prescriptions
price prescription drugs
buy prescription drugs from canada
king pharmacy
price prescription drugs
discount drugs online pharmacy
Thanks! Plenty of info!
http://www.canadianpharmacymsn.com/
canadian prescriptions canadian viagra mexican pharmacies shipping to usa canadian pharmacy
northwest pharmacy
canada drug
no prescription pharmacy
ed meds online
drugs online
canadian pharmacy uk delivery
Amazing material. Thanks!
http://talahicc.com/
canadian cialis canada drugs canadapharmacyonline.com online pharmacies of canada
canadian pharmacy no prescription needed
mexican pharmacies online
canadian pharmacy 365
canadian online pharmacies
canadian pharmacies online
walmart pharmacy price check
Nicely put. Appreciate it.
http://canadianpharmacyntx.com/
mexican pharmacies online canada pharmacy online top rated canadian pharmacies online canadianpharmacy
canadian meds
prescription online
medical information online
canadian pharmacies that ship to us
pharmacy price compare
ed meds online
Kudos, An abundance of information!
http://canadianonlinepharmacynnm.com/
canadian online pharmacies canada drug canadapharmacy canada pharmacy
canadian pharmacies that are legit
canadian family pharmacy
pharmacy price compare
pharmacy near me
canadian pharmacies online prescriptions
canadian drugstore online
Nicely put, Thanks a lot!
http://talahicc.com/
online discount pharmacy canada pharmacy online pharmacy near me northwest pharmacy
ed meds online
northwestpharmacy
king pharmacy
canadian viagra
prescription without a doctor’s prescription
compare rx prices
Incredible many of fantastic data.
http://canadianonlinepharmacynnm.com/
prescription drug canadian pharmacy online canadian family pharmacy canadianpharmacy
prescription cost comparison
no prescription online pharmacy
compare prescription prices
canadian pharmacy no prescription
prescription drugs canada
no prescription online pharmacy
Superb write ups. Many thanks.
http://canadianpharmacysilo.com/
canadian pharmacies without prescriptions north west pharmacy canada canada pharmacy no prescription canadian online pharmacy
no 1 canadian pharcharmy online
best online pharmacies canada
canadian drugstore reviews
online pharmacy reviews
get prescription online
canadian pharmacies without prescriptions
With thanks, A lot of information.
http://canadianpharmacysilo.com/
candrugstore com online pharmacies of canada online pharmacies no prescription canadian pharmacies-24h
canadadrugs
drug costs
online canadian pharmacies
canadian drugstore online
mexican pharmacies shipping to usa
canadian pharmacies online prescriptions
Many thanks. Fantastic stuff.
http://canadianpharmacysilo.com/
canada online pharmacies canadian pharmacies pharmacy online mexico canadian pharmacies online
24 hour pharmacy
online discount pharmacy
canadian pharmacies shipping to usa
get prescription online
canadian pharmacy without prescription
canada pharmacies without script
Nicely voiced truly! .
http://canadianpharmacysilo.com/
prescription without a doctor’s prescription online pharmacies canada pharmacy online store online pharmacies of canada
online canadian discount pharmacy
canada drugs
mexican online pharmacies
canadian online pharmacy
best online pharmacies canada
<a href="http://www.marieauthouartcreation.fr/?s=You+actually+explained+that+exceptionally+well.+http%3A%2F%2Fcanadianpharmacysilo.com%2F+canadapharmacyonline.com+canada+pharmacy+price+prescription+drugs+global+pharmacy+canada+%0D%0Acanadian+online+pharmacies+%0D%0Amail+order+pharmacies+%0D%0Aonline+pharmacy+without+prescription+%0D%0Aonline+drugstore+%0D%0Apharmacy+price+comparison+%0D%0Areputable+canadian+mail+order+pharmacies”>canada drugs pharmacy
You made your stand pretty clearly..
http://www.canadianpharmacymsn.com/
medical information online aarp approved canadian online pharmacies canadian viagra canadian viagra
online pharmacy canada
discount prescription drug
online pharmacy without prescription
prescription prices comparison
compare prescription prices
online prescription drugs
Truly tons of wonderful info!
http://canadianpharmacysilo.com/
canadian pharmacy uk delivery canada drugs internet pharmacy canadian pharmacies online
prescription cost
cheap canadian drugs
most reliable canadian pharmacies
online canadian pharcharmy
pharmacy online
pharmacy online
Nicely put. Kudos.
http://canadianonlinepharmacynnm.com/
drugstore online canadian pharmaceuticals online canada drugs online canadian drugs
canadian prescription drugs
prescription drugs canada
international pharmacies that ship to the usa
canadian rx
meds online
canadian online pharmacies
You actually explained it terrifically.
http://canadianonlinepharmacynnm.com/
canadian cialis canadian online pharmacies costco pharmacy pricing canada pharmacy online
discount prescription drug
canada drug pharmacy
canadian pharmacy
canada drug
canadian pharmacies online prescriptions
online pharmacies no prescription
Regards, Good information.
http://canadianpharmacyntx.com/
prescription drug price comparison north west pharmacy canada online pharmacy no prescription northwestpharmacy
trusted overseas pharmacies
drugstore online
online pharmacies canada
canadian pharmacies top best
discount pharmacy online
cialis online
Regards. An abundance of posts!
http://www.canadianpharmacymsn.com/
canadapharmacy com trust pharmacy canada canadapharmacy aarp approved canadian online pharmacies
canadian discount pharmacy
internet pharmacy
pharmacy online store
buy online prescription drugs
best canadian pharmacies
canadian prescription drugs
Nicely put, Appreciate it!
http://canadianpharmacymim.com/
canadian pharma companies canada pharmacy online canadian pharcharmy online canada online pharmacies
rx pharmacy
online canadian pharmacy
canadian pharmacies top best
prescription online
canada pharmacies online
best online pharmacies canada
Terrific info. Thanks a lot!
http://canadianpharmaciesnnm.com/
pharmacy without dr prescriptions canada drug pharmacy prices canadian cialis
best canadian online pharmacy
best canadian prescription prices
onlinecanadianpharmacy.com
canadian pharmacies without prescriptions
best online pharmacy
best canadian pharmacies
Helpful write ups. Regards!
https://nicktambone.com/
canadian pharmacy uk delivery london drugs canada cheap canadian drugs canadian pharmaceuticals online
online pharmacies canada
canadian drug
global pharmacy canada
no prescription online pharmacy
approved canadian pharmacies online
highest rated canadian pharmacies
Seriously all kinds of superb material!
http://canadianonlinepharmacynnm.com/
online pharmacy canada canadian pharmaceuticals online 24 hour pharmacy northwestpharmacy
prescription drug assistance
top rated online canadian pharmacies
pharmacy price comparison
prescription online
canadian viagra
global pharmacy canada
Cheers, Ample tips!
http://canadianpharmaciesnnm.com/
canadian pharmacy uk delivery canadian pharmacies without an rx best canadian pharmacies canadian pharmacy
reputable canadian mail order pharmacies
approved canadian pharmacies online
cheap prescription drugs online
canada drugs pharmacy
24 hour pharmacy
buy prescription drugs online
Seriously tons of terrific knowledge!
http://talahicc.com/
canada drugs online pharmacy trust pharmacy canada cialis canadian pharmacy canada pharmaceutical online ordering
us pharmacy no prior prescription
discount pharmacy online
canadian pharmacy viagra
web medical information
candrugstore com
online pharmacy no prescription
Truly lots of wonderful knowledge!
https://nicktambone.com/
canadian pharmacies shipping to usa canadian online pharmacies best canadian pharmacies canadian viagra
prescription drug price comparison
drugstore online
canada pharmacies prescription drugs
canadian pharmacy online
online pharmacies no prescription
online discount pharmacy
Amazing plenty of amazing advice!
http://talahicc.com/
canadian drug stores online canadianpharmacy canadian rx canada pharmaceuticals online
medication costs
prescription drug assistance
canada pharmacy online
canadian drug stores online
northwest pharmacy canada
<a href="http://mecetes.org/?s=+Superb+advice.+Kudos%21+http%3A%2F%2Ftalahicc.com%2F+my+canadian+pharmacy+top+rated+canadian+pharmacies+online+canadian+pharmacy+no+prescription+north+west+pharmacy+canada+%0D%0Aonline+pharmacy+usa+%0D%0Acanadian+rx+%0D%0Aprescription+drug+%0D%0Amexican+online+pharmacies+%0D%0Abest+online+pharmacy+%0D%0Acanadian+prescriptions”>best canadian online pharmacy
You actually explained it wonderfully.
https://nicktambone.com/
canadapharmacy com canadian pharmacies-24h no prescription online pharmacy northwest pharmacy
pharmacies near me
canada drugs pharmacy
mexican pharmacy online medications
international pharmacy
canadian pharmacy without prescription
canadian pharmacy reviews
With thanks, Wonderful information.
http://www.canadianpharmacymsn.com/
canadian drugstore northwest pharmacy pain meds online without doctor prescription canadian pharmacies
buy prescription drugs without doctor
<a href="http://www.ikeaclub.biz.ua/lib/ajax/contact_us_form.php?form_ajax=contacts&name=Quentinnax&email=zittel020eejf%40songwriter.net&phone=89451759949&message=+Wonderful+data.+Many+thanks%21+http%3A%2F%2Fcanadianpharmacysilo.com%2F+canadian+drug+stores+online+trust+pharmacy+canada+mexican+pharmacies+shipping+to+usa+canadian+pharmacies+without+an+rx+%0D%0Acanadian+pharmacy+meds+%0D%0Adrugstore+online+%0D%0Abest+online+pharmacies+no+prescription+%0D%0Apharmacy+prescription+%0D%0Acanada+online+pharmacy+%0D%0Aweb+medical+information&security_code=%21UNKNOWN_TYPE%21&send=”>canadian online pharmacy reviews
rx pharmacy
discount prescription drug
prescription drug price comparison
discount pharmacy online
You actually revealed it really well.
http://canadianpharmaciesnnm.com/
online rx pharmacy canadian viagra canada pharmacies online canadian pharmacies
canadian pharcharmy online
online canadian discount pharmacy
prescription drug price comparison
drugs for sale
online drugstore
pharmacy prescription
You’ve made the point!
http://www.canadianpharmacymsn.com/
canadian prescriptions london drugs canada canada pharmacies online online pharmacies canada
canada drug pharmacy
medication costs
prescription drugs online without doctor
internet pharmacy
buy drugs online
prescription cost comparison
Thank you! Numerous knowledge.
http://canadianonlinepharmacynnm.com/
online pharmacy canada online pharmacies buy drugs online northwestpharmacy
internet pharmacy
costco pharmacy pricing
drug stores near me
online pharmacy
online pharmacy without prescription
no prescription online pharmacy
Perfectly voiced certainly! !
http://canadianpharmacyntx.com/
prescription drugs without prior prescription london drugs canada best canadian pharmacies trust pharmacy canada
canadian drug
canada pharmacy online
canadian drug stores online
online canadian pharmacy
compare rx prices
online pharmacy
You actually said this perfectly!
http://canadianpharmacyntx.com/
canadian drugs canadian pharmacies canadian drug stores online canada online pharmacies
canadian rx
internet pharmacy
canadian prescriptions
web medical information
global pharmacy canada
canadian drugstore
Fine forum posts. Appreciate it!
http://canadianpharmacysilo.com/
pharmacy price compare london drugs canada online drugs canada pharmacy
online drugstore
online pharmacies
northwestpharmacy
discount prescription drugs online
northwest pharmacy canada
online pharmacy canada
With thanks. Lots of facts!
http://talahicc.com/
no 1 canadian pharcharmy online canada pharmaceuticals online canadian pharmacy without prescription canada pharmaceutical online ordering
northwestpharmacy
canada pharmacy no prescription
buy prescription drugs from canada
canadian drugstore
canada pharmacies
buy cialis
Thanks a lot! Lots of info!
http://canadianonlinepharmacynnm.com/
canadian pharmacies that are legit canada pharmacy online canada pharmacies canada pharmacy online
prescription cost
online pharmacy usa
online pharmacy without prescription
canada online pharmacy
online pharmacies canada
mail order pharmacies
Amazing tips. Many thanks!
http://www.canadianpharmacymsn.com/
buy prescription drugs online canadian pharmacies that ship to us canadian pharmacy viagra north west pharmacy canada
canadian pharmacy online canada
canadian pharmacy uk delivery
overseas pharmacy forum
buy prescription drugs without doctor
<a href="http://meier-mediadesign.ch/?s=+Thank+you%2C+Useful+stuff.+http%3A%2F%2Fcanadianpharmacyntx.com%2F+best+price+prescription+drugs+aarp+approved+canadian+online+pharmacies+northwestpharmacy+canadian+cialis+%0D%0Abest+online+canadian+pharcharmy+%0D%0Acanadian+drugstore+reviews+%0D%0Apharmacy+tech+%0D%0Apharmacy+drug+store+%0D%0Aoverseas+pharmacy+forum+%0D%0Alegitimate+online+pharmacies”>canada drugs
walmart pharmacy price check
You stated this very well!
http://canadianpharmacysilo.com/
canada pharmacy online reviews online pharmacies of canada reputable canadian mail order pharmacies online pharmacies canada
pharmacy drug store
canadian drug store
walmart pharmacy price check
cheap prescription drugs online
canadian rx pharmacy online
get prescription online
You expressed it perfectly.
http://canadianonlinepharmacynnm.com/
canadian drug canada pharmaceutical online ordering onlinecanadianpharmacy.com canadian pharmacy online
most reliable canadian pharmacies
costco pharmacy pricing
canadian prescription drugs
online pharmacy without a prescription
pharmacy price compare
medication costs
Thank you. Very good information!
https://nicktambone.com/
canadian pharmacies that ship to us canadian pharmacies-24h online pharmacies global pharmacy canada
drugs from canada
most reliable canadian pharmacies
rx online
drug costs
best online pharmacy
mail order pharmacy
Nicely put. Regards!
http://canadianpharmaciescubarx.com/
best online pharmacies canada canadian pharcharmy online pharmacy canada canada pharmacy
canadianpharmacy
canadian cialis
canada pharmacy online no script
canadian rx
online pharmacy no prescription needed
canadian cialis
Kudos. Quite a lot of facts.
http://canadianpharmaciesnnm.com/
reputable canadian mail order pharmacies canadian cialis canadian drugs canadian online pharmacy
discount drugs online pharmacy
cheap prescription drugs
prescription drugs prices
mexican pharmacy online medications
internet pharmacy
canadian pharmacy viagra brand
Excellent posts. Many thanks!
http://canadianpharmacymim.com/
prescription price comparison aarp approved canadian online pharmacies canadian mail order pharmacies canada pharmaceutical online ordering
canadian pharma companies
canadian viagra
rx price comparison
online discount pharmacy
canadadrugs
online pharmacy without prescription
Many thanks. Very good information.
http://canadianpharmaciescubarx.com/
canadian pharmacy no prescription needed canada pharmacy pharmacy prices canadian pharmacies without an rx
mexican pharmacy online
canadian drug
cheap prescription drugs online
discount pharmacy online
cheap prescription drugs
canadian drugstore online
You explained this really well!
https://nicktambone.com/
online drugs canada pharmacy online canadian pharmacies shipping to usa canada pharmacy
reputable canadian mail order pharmacies
canadian pharmacies shipping to usa
mexican pharmacies online
drug costs
canadian pharmacy 365
canadian prescription drugs