Tensorflow using virtual environments

Tensorflow 2.6(Current version 2.11 at 2023-03-23)

$ sudo apt-get install python3-venv

$ python3 -m venv envtf26

$ source envtf26/bin/activate

(envtf26) cloud@AsusDesktop:~/Gaia$
 

(envtf26) cloud@AsusDesktop:~/Gaia$ pip list  
Package       Version
------------- -------
pip           20.0.2  
pkg-resources 0.0.0   
setuptools    44.0.0

(envtf26) cloud@AsusDesktop:~/Gaia$ pip install tensorflow==2.6

(envtf26) cloud@AsusDesktop:~/Gaia$ pip install --upgrade protobuf==3.20

(envtf26) cloud@AsusDesktop:~/Gaia$ pip install keras==2.6

(envtf26) cloud@AsusDesktop:~/Gaia$ python3           
Python 3.8.10 (default, Mar 13 2023, 10:26:41)  
[GCC 9.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf      
>>> print(tf.keras.__version__)  
2.6.0

(envtf26) cloud@AsusDesktop:~/Gaia$ pip install matplotlib==3.6 #if you install without 3.6 will install 3.7 and it will break tensorflow installation

References:

[1] matplotlib compa https://matplotlib.org/stable/devel/min_dep_policy.html

Python and OpenCV issues

Error:

   import cv2, numpy as np,time
 File "/home/fincahuanaco/.local/lib/python3.7/site-packages/cv2/__init__.py", line 3, in <module>
   from .cv2 import *
ImportError: numpy.core.multiarray failed to import

 

Solution:

$ python3 -m pip install opencv-python==4.0.0.21

$ python3 -m pip list  
 

opencv-python          4.0.0.21

numpy                  1.15.0

 

Other combinations

opencv_python==4.4.0.46 and numpy==1.19.3 works.

 

AWS Python issues

$ curl -O https://bootstrap.pypa.io/get-pip.py
$ python3 get-pip.py --user
 

References:

[1] https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/eb-cli3-install-linux.html

 

Python tools for Web Developers

 

[1] FastAPI https://fastapi.tiangolo.com/

[2] Dash Python https://dash.plotly.com/background-callbacks

 

Gimp Python-Fu

 

[0] https://www.gimp.org/docs/python/index.html#PREGION-OBJECT-MEMBERS

[1] https://www.gimp.org/docs/python/index.html#DRAWABLE-OBJECT-METHODS

[2] http://myvirtualbrain.blogspot.com/2012/06/gimp-python-fu-very-basics.html 

[3] Samples https://github.com/jfmdev/PythonFuSamples

[4] https://github.com/gummyCowboy/GIMP-python-fu

[5] https://gist.github.com/garystafford/5259576a7e9299d5b80284489aa25fc3

Python tools

#Force to install a version Python-3.7.4

 wget https://www.python.org/ftp/python/3.7.4/Python-3.7.4.tgz

tar xvf Python-3.7.4.tgz
cd Python-3.7.4
./configure --enable-optimizations --with-ensurepip=install
make -j 8
sudo make altinstall



#Install pip module into any version of Python

curl -o get-pip.py https://bootstrap.pypa.io/pip/get-pip.py
python3.8 get-pip.py  #or
python3.9 get-pip.py

Stock Price Prediction - data source

 

[1] Nasdaq API https://data.nasdaq.com/sign-up 

[2] API https://data.nasdaq.com/tools/python (API is in setting option)

Python Settings to use in environments

Solving multiple python instalation:

sudo update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.5 1

sudo update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.6 2

sudo update-alternatives --config python3

Solving:

Error: Command '['/home/DRIVE/Temp/aa/bin/python3.9', '-Im', 'ensurepip', '--upg
rade', '--default-pip']' returned non-zero exit status 1.
 

apt-get install python3.6-dev python3.6-venv

python3.6 -m venv myVenv 

Upgrade pip

pip3 install --upgrade pip

 

Python set right version to execute 3.6 3.7 3.8

 

 

https://tech.serhatteker.com/post/2019-12/upgrade-python38-on-ubuntu/

https://stackoverflow.com/questions/63823964/importerror-cannot-import-name-sysconfig-from-distutils-usr-lib-python3-8

curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py

python3 get-pip.py --force-reinstall

ModuleNotFoundError: No module named 'apt_pkg' error

sudo apt-get remove python3-apt
sudo apt-get install python3-apt

 

 

ImportError: No module named OpenGL.GL

apt-get install python3-opengl

or  

pip3 install pyopengl --user

As well as:

sudo apt-get install python python-numpy python-opengl python-qt4 python-qt4-gl

 

 

 

 

2D and 3D Moments resources

Theory

[1] Binary Image http://homepages.inf.ed.ac.uk/rbf/CVonline/LOCAL_COPIES/OWENS/LECT2/node3.html

[2] https://towardsdatascience.com/a-visual-introduction-to-binary-image-processing-part-1-d2fba9f102a4

[3] Hu Moments code and theory https://www.learnopencv.com/shape-matching-using-hu-moments-c-python

[4] PCA Analysis and code https://towardsdatascience.com/visualizing-principal-component-analysis-with-matrix-transforms-d17dabc8230e

[3] 3D moments http://147.231.16.195/3DRotationInvariants

Codes

[1] OpenCV moments https://github.com/krutikabapat/Shape-Matching-using-Hu-Moments

[2] Hu Moments https://github.com/adailtonjn68/hu_moments_in_python

Books

[1] 2D and 3D Image Analysis by Moments https://b-ok.lat/book/4985123/51d687?regionChanged=&redirect=34651345

Applications

[1] Tracking http://raphael.candelier.fr/?blog=Image%20Moments

 

 

 

 

 

3D Deep Learning

 

https://github.com/mit-han-lab/pvcnn

https://paperswithcode.com/paper/octnet-learning-deep-3d-representations-at

Python Animation Matrix Convolution

 

[1] Convolution animation https://stackoverflow.com/questions/52067833/how-to-plot-an-animated-matrix-in-matplotlib

Python - Read binary data int float

 

[1] struct https://docs.python.org/3.0/library/struct.html 

Euclidean Distance Transform

Resources:
[1] https://github.com/seung-lab/euclidean-distance-transform-3d

Colab include Html

Resources:

[1] with IPython https://stackoverflow.com/questions/47723731/how-embed-html-file-exported-from-plotly-to-jupiter-notebook
[2] Embedding html in Colab https://ipywidgets.readthedocs.io/en/latest/embedding.html

Anisotropic Diffusion

[1] Perona Malik Diffusion for Edge Detection
https://github.com/fubel/PeronaMalikDiffusion/blob/master/main.py

[2] https://github.com/pastapleton/Perona-Malik
[3] https://pastebin.com/sBsPX4Y7

COVID-19

Trackers
[1] https://gisanddata.maps.arcgis.com/apps/opsdashboard/index.html#/bda7594740fd40299423467b48e9ecf6
[2] https://who.sprinklr.com/
[3] Perú https://www.bing.com/covid/local/peru
[4] https://extranet.who.int/publicemergency
[5] Brasil https://olhardigital.com.br/coronavirus/noticia/coronavirus-brasil-registra-904-casos-confirmados-e-11-mortes/98089

Codes
[1] https://laconicml.com/predict-infected-people-coronavirus-python
[2] https://github.com/fincahuanaco/covid19peru

[3] https://www.tecmint.com/convert-files-to-utf-8-encoding-in-linux/

Datasets
[1] Timeseries https://github.com/CSSEGISandData/COVID-19
[2] images https://www.kaggle.com/bachrr/covid-chest-xray/data
[2.1] https://theaisummer.com/medical-image-deep-learning

[3] Brazil daily report https://github.com/wcota/covid19br

Other Datasets

[1] Datasus http://www2.datasus.gov.br/DATASUS/index.php

python pybind11

 for run https://github.com/ilastik/marching_cubes, we need to install pybind11
 alternative to test https://github.com/pmneila/PyMCubes

# prerequisites 
apt-get install cmake
pip3 install pytest

# Clone and build
git clone https://github.com/pybind/pybind11.git 
cd pybind11 
mkdir build 
cd build 
cmake .. 
sudo make install 

SPH on Python

Based on https://pysph.readthedocs.io/en/1.0a1/installation.html
                https://pysph.readthedocs.io/en/latest/installation.html
Examples https://pypi.org/project/PySPH/

python3.2 -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())"

python3 -m venv /path/to/new/virtual/environment

Object arrays cannot be loaded when allow_pickle=False

pip install numpy==1.16.1

pip3 install PyQt5

 [1] SPH on Python https://github.com/pypr/pysph

Word cloud

Python codes
[1] https://www.geeksforgeeks.org/generating-word-cloud-python/