Top Posts

Causal design patterns for data analysts

An informal primer to causal analysis designs and data structures
Jan 30, 2021 causal, data, tutorial

Building a team of internal R packages

On the jobs-to-be-done and design principles for internal tools
Jan 21, 2021 rstats, pkgdev, jtbd

Column Names as Contracts

Using controlled dictionaries for low-touch documentation, validation, and usability of tabular data
Sep 6, 2020 data, workflow, rstats

RMarkdown Driven Development (RmdDD)

A workflow for refactoring one-time analyses to sustainable data products
May 4, 2019 pkgdev, rmarkdown, rstats, workflow

Recent Posts

The Art of Abstraction in ETL: Dodging Data Extraction Errors

Cross-post from guest post on Airbyte’s developer blog
Mar 22, 2023 data, workflow

Goin' to Carolina in my mind (or on my hard drive)

Out-of-memory processing of North Carolina’s voter file with DuckDB and Apache Arrow
Sep 25, 2022 data, sql

Oh, I'm sure it's probably nothing

How we do (or don’t) think about null values and why the polyglot push makes it all the more important
Sep 5, 2022 rstats, python, sql, data

Update: grouped data quality check PR merged to dbt-utils

After a prior post on the merits of grouped data quality checks, I demo my newly merged implementation for dbt
Aug 26, 2022 data, changelog, dbt

Using databases with Shiny

Key issues when adding persistent storage to a Shiny application, featuring {golem} app development and Digital Ocean serving
Jan 2, 2022 rstats, shiny, data
See all posts

Talks

Evaluation without Experimentation

An introduction to inverse propensity of treatment weighting for program evaluation with applications to Two Million Texans’ relational organizing campaign during the 2022 midterms
Mar 22, 2023 11:00 AM Data for Progress Data Engineering Open Mic
Slides Follow

Taking Flight with Shiny: a Modules-First Approach

An argument for the individual and organization-wiide benefits of teaching new developers Shiny with a modules-first paradigm
Mar 15, 2023 11:00 AM Appsilon ShinyConf 2023
Slides Follow

Data (error) Generating Process

Interrogating the data generating process to devise better data quality tests.
Nov 10, 2022 11:00 AM Airbyte move(data) | CANSII | DataFold Meetup
Slides Video

Operationalizing Column-Name Contracts with dbtplyr

An exploration of how data producers and consumers can use column names as interfaces, configuations, and code to improve data quality and discoverability. The second half of the talk demonstrates how to implement these ideas with my dbtplyr dbt package.
Dec 13, 2021 11:00 AM Virtual
Project Slides Video Follow

Column Names as Contracts

Exploring the benefits of using controlled vocabularies to encode metadata in column names, and demonstrations of implementing this approach with the convo R package or dbt extensions of SQL.
Feb 25, 2021 11:00 AM University of Toronto | Chicago
Project Slides Video Follow
See all talks

Projects

*
All Packages

dbtplyr

dbt package bringing dplyr semantics to SQL

convo

R package for managing controlled vocabularies

satRday Chicago Conference Organizer

Speaker & Sponsor lead for 2019 and 2020

Rtistic

Hackathon-in-a-box templates for custom Rmd and ggplot2 themes

projmgr

R package providing project management interface to GitHub

Publications

97 Things Every Data Engineer Should Know: Collective Wisdom from the Experts

Contributed six chapters on tops ranging from data design, development, validation, and democratization
Related Post Publisher Site Amazon

R Markdown Cookbook

This cookbook contains tips and tricks to help you get the most out of R Markdown. Topics include the automated generation of content (diagrams, text), customizing format (Pandoc, HTML, and LaTeX templates), workflow improvements (modularizing child documents, cross-referencing code chunks, chunk caching), modifying rendering behavior with hooks, and using alternative language engines.
Read Online Publisher Site Amazon

Topics

causal changelog data dbt jtbd notes package pkgdev python resources rmarkdown rstats shiny speaking sql tutorial workflow