PinnedPublished inTowards DevAnalyzing Dataform projects with Dataform RateDataform Rate tool is a Python-based solution designed to analyze Dataform projects, evaluate them against a set of predefined best…Sep 26, 2024Sep 26, 2024
Monitoring Dataform assertions with BigQuery and GitHub actionsSuppose you’ve used Dataform for orchestrating your analytics workflows in Google Cloud. In that case, you might have discovered its…4d ago4d ago
How to outsmart BigQuery storage costs and save $$$ like a proYou’re a BigQuery ninja, slicing through massive datasets with lightning-fast queries. Life’s great… until you look at the bill. Ouch…Nov 30, 2024Nov 30, 2024
Spicing up GCS to BigQuery transfers from Dataform with BigFunctionsContext and ideaJul 26, 2024Jul 26, 2024
Reflections on over 13 years in consultingAfter more than 13 years in the consulting industry, particularly in IT consulting, I am soon bidding farewell to a significant chapter of…Jun 25, 2024Jun 25, 2024
Understanding RAG (Retrieval-Augmented Generation) with a practical (simple) exampleIntroductionMay 15, 20241May 15, 20241
Dynamic chunk sizing with Pandas and BigqueryThe ability to process large datasets efficiently on machines with limited resources is a valuable skill. As datasets grow in size, so does…Apr 30, 2024Apr 30, 2024
