BigData Engineer | Full stack dev | I write about ML/AI in Digital marketing. | linktr.ee/mshakhomirov | @MShakhomirov

Complete Data Studio guide and BigQuery tutorial for Firebase users, Machine Learning enthusiasts and Marketers. All you wanted to know. Data Studio template included.

Image for post
Image for post
Data Studio template. Image by author

Who is this article for?

  • Marketers who have been tasked to create custom user retention dashboards.
  • Analysts who might want to create better reports.
  • AI and ML experts who will definetely want to predict user churn.
  • Firebase users who might want to question their retention numbers.

Prerequisites


Complete guide using Tensorflow, Airflow scheduler and Docker

Image for post
Image for post
Photo by Setyaki Irham on Unsplash
gcloud ai-platform jobs submit training ${JOB_NAME} \
--region $REGION \
--scale-tier=CUSTOM \
--job-dir ${BUCKET}/jobs/${JOB_NAME} \
--module-name trainer.task \
--package-path trainer \
--config trainer/config/config_train.json \
--master-machine-type complex_model_m_gpu \
--runtime-version 1.15


Why I don’t trust User Activity Dashboards

Image for post
Image for post
User base scenarios. Image by author

Counting Active users in your App might be tricky. What would you do? Count — active deviceIds or active accounts?


Complete guide for scripting and UDF testing

Image for post
Image for post
Photo by Florian Olivo on Unsplash

What is this article about?

  1. How to write unit tests for SQL and UDFs in BigQuery.
  2. How to link multiple queries and test execution.
  3. How to automate unit testing and data healthchecks.


Getting Started

Complete Python comparison and Step by Step guide for any dataset. Kaggle User churn data.

Image for post
Image for post
Exploratory Data Analysis in Google Data Studio. Image by author.

Can we perform Exploratory Data Analysis with SQL?

— Yes, we can.

What is this article about?

  • What is Exploratory Data Analysis (EDA)?
  • How to perform Exploratory Data Analysis (EDA) in Pandas (Python)?
  • How to perform Exploratory Data Analysis (EDA) in BigQuery SQL and how is it different from Pandas?
  • How to use dynamic SQL in BigQuery for Exploratory Data Analysis (EDA)?
  • How to create visualisations to explore your dataset in BigQuery / Pandas?
  • How to use Pandas/ BigQuery SQL to analyse relationships between variables for feature selection?


Simple and effective dashboard. With actual report names, users and labels. Handy template included

Image for post
Image for post
BigQuery and Data Studio cost monitoring dashboard. (Image by author)
  • What was the cost of each Data Studio report for yesterday?
  • How many times each query/report was run and who ran it?
  • What was the cost of queries for tables, datasets (e.g. production/staging/ analytics) with label X?
  • Can I be notified in case of a sudden surge in billed bytes amount?

According to official Google docs at the moment you can’t use labels for BigQuery jobs.


In 8 days. Quick learner’s guide for those who don’t have time to read the manuals. August 2020.

Image for post
Image for post
Google Cloud Certified Professional Data Engineer


How would you explain Firebase figures? Here is the answers. Neat template included as well as sample Firebase datasets for BigQuery analysis.

Image for post
Image for post
Crashlytics dashboard


Image for post
Image for post
My first BigQuery bill :)


Loading data into BigQuery using Cloud Functions in 20 minutes.

Image for post
Image for post
Photo by fabio on Unsplash

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store