Resolve repetitive queries with scheduled invocations, combine simple queries to complex DML statements by using Cloud Workflows instead of BigQuery Scripting.
SQL pipelines! In this article, we will explore how to use Workflows Connectors to run BigQuery query pipelines to execute a query, retrieve query results, loop through the resultset, and repeatedly launch subsequent queries.
Also, you could reuse these techniques to various business logics to execute a SQL pipeline process that combines several consecutive steps.
We are going to define a problem that currently is not supported out of the box by BigQuery and is frequently asked on Stackoverflow.
Backup every night your Firestore collections to secure Cloud Storage the easy way with Cloud Workflows, you don’t need to be a developer to setup the steps.
Database Backups! We know how important they are, a wrong click and someone could delete your collection or the entire database. In the case of a Disaster Recovery Plan is activated you need to have your backups to resume business operation.
Let’s make sure your Firestore/Datastore collections backup every night to secure storage.
Automate the execution of shell commands in a fully serverless and secure way without managing private keys. What a joy for a Cloud Architect to work with.
Sometimes, as part of a workflow process, it is necessary to connect to a VM in order to perform different tasks. We are going to cover connecting to a Linux VM and performing different tasks like copying files, or a script to import/update a database by using Cloud Workflows.
This article covers how to define Cloud Workflow to start a VM machine, connect to the Compute Engine shell, execute shell commands securely with…
In this article, we will orchestrate and automate Google Cloud with serverless workflows.
We will create a Cloud Workflow to load data from Google Storage into BigQuery. This is a complete guide on how to work with workflows, connecting any Google Cloud APIs, working with subworkflows, arrays, extracting segments, and calling BigQuery load jobs.
There are various ways to process Cloud Storage files to BigQuery such as using a Cloud Function, by Eventarc triggers to Cloud Run services, a relatively new syntax is by using BigQuery create external table statement or the good old way via BQ CLI tool.
Writing, debugging and deploying from Visual Studio Code for Google Cloud Platform is working out great as you have multiple options to interact with Google Cloud products:
All these work based on the project that your environment is setup.
However, the VS Code screen was missing key info: displaying the current project. There was no easy way to switch projects from the IDE. Until now!
Introducing the “GCP Project Switcher” extension for VS Code.
So, this weekend in early…
At the time of the writing Data Studio doesn’t offer out of the box Annotations on time series charts. You can however add your annotations as seen below in easy ways.
We will cover 3 ways how to add Data Studio Annotations:
To get going, Edit your data source (with the Pencil icon ), when you see your current fields, find and choose Add a field, name it after your event eg: Google Algorithm Update and…
Waze introduced in their mobile apps around 2018 routing options that enable to you set Vignettes to enable use of toll roads.
This was a mobile first feature, so the web version of their Livemap didn’t had this feature, and by default it routes without toll roads — omitting motorways, bridges and so on, which yields crappy routes.
To get Livemap to use the vignettes and return the toll roads, use the following link: