Today I've come to a totally virgin installation upon a server, this was for a work group I've got to head up whom are looking at pushing MySQL with Python. And things initially went wrong...
I stipulated they had to use Python3 and thought everything else would be fine for them to install with Pip3, so...
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install python3
sudo apt-get install python3-pip
sudo apt-get install mysql-server
Everything looked fine, their user could install packages through Pip3 and they had Flask and a few other things and were flying. I used the mysql client on the command like to test I could add a few items and also ran...
sudo mysql_secure_installation
To do the basic hardening of the database, so everything was fine... Right?....RIGHT?!?!
No, not exactly.... "I can't get mysql.connector".... Came the cry.
And they were right, it reported a myriad of build issues and could not install. I took a look... NIGHTMARE!
It appears the installation of mysql.connector via Pip3 depends upon Protocol Buffers from google for the latest version of mysql.connector... Which the Pip install didn't sort out, at least not easily... Luckily I run a whole gaggle of virtualized machines, so I could quickly spool up a new instance and try a few things out...
This is the script I came up with....
cd ~
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install -y python3-pip git autoconf automake libtool curl make g++ unzip
sudo pip3 install flask
hostname -f > hostname.txt
sudo apt-get install -y mysql-server
sudo mysql_secure_installation
sudo ldconfig
cd ~
git clone http://github.com/google/protobuf.git
cd protobuf/
./autogen.sh
./configure
make
make check
sudo make install
sudo ldconfig
cd python
sudo python ./setup.py install
cd ~
sudo ldconfig
sudo pip3 install mysql-connector --install-option='--with-protobuf-include-dir=/usr/local/include/google/protobuf' --install-option='--with-protobuf-lib-dir=/usr/local/lib' --install-option='--with-protoc=protoc'
Lets go through this step by step...
cd ~
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install -y python3-pip git autoconf automake libtool curl make g++ unzip
This is just the basics, so our installation will now depend upon git, autoconf, automake, libtool, curl, make, g++ and unzip, most all your standard distributions will contain packages for these, we use -y just to skip any permission requests.
sudo pip3 install flask
hostname -f > hostname.txt
The next step is simply a couple of items for our project, we're going to use Flask to provide a restful interface, and the "hostname.txt" is simply to remove our need to call "hostname" again later.
sudo apt-get install -y mysql-server
sudo mysql_secure_installation
Our next step is to install and secure the MySQL service.
sudo ldconfig
cd ~
Generic code now, to simply reload the library list and change to the home directory.
git clone http://github.com/google/protobuf.git
cd protobuf/
./autogen.sh
./configure
make
make check
sudo make install
This is the build of protocol buffers from google, so we pull it from their github repo, we move into that folder, prepare and configure the build, then make the whole build. By far this is the LOOOONGEST instruction, on a single core 1GB equipped virtual instance this took around 45 minutes.
Once complete we simply need to reload the libraries again...
sudo ldconfig
However, protocol buffers are still not installed within Python, so we are still in the "~/protobuf" folder, we now need to go deeper, into the python folder and perform the setup installation under python...
cd python
sudo python ./setup.py install
When complete we again need to reload the libraries...
sudo ldconfig
And the final, secret sauce, is to actually install mysql connector through pip3 with protocol buffers...
sudo pip3 install mysql-connector --install-option='--with-protobuf-include-dir=/usr/local/include/google/protobuf' --install-option='--with-protobuf-lib-dir=/usr/local/lib' --install-option='--with-protoc=protoc'
This is a single command, spanning one single line.
And voila, once complete you get to use mysql.connector in your python code...
import mysql.connector
import gc
con = mysql.connector.connect (user='whatever', password='something', host='localhost', database='yeahyeah')
con.close()
con = None
gc.collect()
You can find out more about why I nullify and garbage collect a connection in my previous post.
No comments:
Post a Comment