Unable to install mysqlclient in python virtualenv

While installing mysqlclient in python virtualenv, some might have experienced issue like 

"failed building wheel for mysqlclient". This issue occurs mostly in Windows, to overcome this we need to download appropriate version of mysqlclient-xxx-xx.whl files, search for below files

Mysqlclient, a fork of the MySQL-python interface for the MySQL database.

• mysqlclient‑1.3.10‑cp27‑cp27m‑win32.whl
• mysqlclient‑1.3.10‑cp27‑cp27m‑win_amd64.whl
• mysqlclient‑1.3.10‑cp34‑cp34m‑win32.whl
• mysqlclient‑1.3.10‑cp34‑cp34m‑win_amd64.whl
• mysqlclient‑1.3.10‑cp35‑cp35m‑win32.whl
• mysqlclient‑1.3.10‑cp35‑cp35m‑win_amd64.whl
• mysqlclient‑1.3.10‑cp36‑cp36m‑win32.whl
• mysqlclient‑1.3.10‑cp36‑cp36m‑win_amd64.whl

and run the command

$ pip install mysqlclient-1.3.10.cp27m-win32.whl

you can see mysqlclient installed successfully.

Connecting to MySQL database in Google Compute Engine - Remote Access

This page help you to access MYSQL database in Google Compute Engine from your system or network.

1. Get your public IP address.
2. Open Google Compute Engine in browser window
3. Navigate to /etc/mysql/
4. Open my.cnf file and add line:  bind-address = <internal IP>
5. Restart mysql server: $ service mysql restart
6. Sign in as mysql root user: $mysql -u root -p
7. Create new user: mysql>CREATE USER 'user1'@'<internal-ip-my-client>' IDENTIFIED BY '<some-password>'
8. Provide access to the user: mysql> GRANT ALL PRIVILEGES ON *.* TO 'user1'@'<internal-ip-my-client>' IDENTIFIED BY '<some-password>'; 
9. Restart mysql server

Django Migrate Sqllite to MySql DB

Steps to migrate Django Sqllite DB to MySql DB

1. python manage.py dumpdata -o datadump.json
2. Change settings.py to your mysql

DATABASES = {
    'default': {
        'ENGINE': 'django.db.backends.mysql',
        'NAME': 'database',
        'USER': 'username',
        'PASSWORD': 'password',
        'HOST': 'localhost',   # Or an IP Address that your DB is hosted on
        'PORT': '3306',
    }
}

3. Check you have mysqlclient, else run below command: 

       

       pip install mysqlclient

4. python manage.py migrate --run-syncdb5. python manage.py loaddata datadump.json

Setting up Python Virtual Environment

Follow below steps to create a virtual environment with python 2.7 version, 

you can replace it with any other version.

    $ pip install virtualenv
    $ virtualenv -p python2.7 mypython27

   Run below command to activate python 2.7 virtualenv

   > Go to mypython27 directory
   $ . bin/activate

Determining _PARTITION details in BigQuery Partitioned Table

Run below query to check the partition summary of Bigquery table:

SELECT DATE(_PARTITIONDATE) AS PT, DATE(CURRENT_TIMESTAMP()) , DATE(DATE_ADD(CURRENT_TIMESTAMP(), -1, 'DAY'))
FROM [ProjectId:Dataset.Table]
GROUP BY PT

SELECT project_id, dataset_id, table_id, partition_id
, MSEC_TO_TIMESTAMP(creation_time) Created_date, MSEC_TO_TIMESTAMP(last_modified_time) modified_time
from [ProjectId:Dataset.Table$__PARTITIONS_SUMMARY__]

Install AWS Components in Python Virtual Environment

Installing AWS Components in Python Virtual Environment

Step 1: >>$ sudo su

Step 2: >>$ pip install awscli

Step 3: >>$ aws configure

Complete the authorization steps with your AWS Key and Secret Key.

Install gcloud components in python virtual environment

Installing gcloud components in virtual environment

Step 1: Download google cloud SK file (below is an example for Mac)

url: https://cloud.google.com/sdk/docs/quickstart-mac-os-x

Step 2. Unzip the tar file, navigate to bin folder

>> ./install.sh

if you face any issues like Module Platform missing, execute below command:

>>$ export CLOUDSDK_PYTHON_SITEPACKAGES=1

Step 3: Run gcloud init

Step 4: Open new terminal and run 'bq ls', a authorization steps occurs, complete the authorization.