Top Posts

Causal design patterns for data analysts

An informal primer to causal analysis designs and data structures
Jan 30, 2021 causal, data, tutorial

Building a team of internal R packages

On the jobs-to-be-done and design principles for internal tools
Jan 21, 2021 rstats, pkgdev, jtbd

Column Names as Contracts

Using controlled dictionaries for low-touch documentation, validation, and usability of tabular data
Sep 6, 2020 data, workflow, rstats

RMarkdown Driven Development (RmdDD)

A workflow for refactoring one-time analyses to sustainable data products
May 4, 2019 pkgdev, rmarkdown, rstats, workflow

Recent Posts

Goin' to Carolina in my mind (or on my hard drive)

Out-of-memory processing of North Carolina’s voter file with DuckDB and Apache Arrow
Sep 25, 2022 data, sql

Oh, I'm sure it's probably nothing

How we do (or don’t) think about null values and why the polyglot push makes it all the more important
Sep 5, 2022 rstats, python, sql, data

Update: grouped data quality check PR merged to dbt-utils

After a prior post on the merits of grouped data quality checks, I demo my newly merged implementation for dbt
Aug 26, 2022 data, changelog, dbt

Using databases with Shiny

Key issues when adding persistent storage to a Shiny application, featuring {golem} app development and Digital Ocean serving
Jan 2, 2022 rstats, shiny, data

How to Make R Markdown Snow

Much like ice sculpting, applying powertools to absolutely frivolous pursuits
Dec 11, 2021 rstats, rmarkdown
See all posts

Talks

Data (error) Generating Process

Interrogating the data generating process to devise better data quality tests.
Nov 10, 2022 11:00 AM Airbyte move(data) | CANSII | DataFold Meetup
Slides Video

Operationalizing Column-Name Contracts with dbtplyr

An exploration of how data producers and consumers can use column names as interfaces, configuations, and code to improve data quality and discoverability. The second half of the talk demonstrates how to implement these ideas with my dbtplyr dbt package.
Dec 13, 2021 11:00 AM Virtual
Project Slides Video Follow

Column Names as Contracts

Exploring the benefits of using controlled vocabularies to encode metadata in column names, and demonstrations of implementing this approach with the convo R package or dbt extensions of SQL.
Feb 25, 2021 11:00 AM University of Toronto | Chicago
Project Slides Video Follow

oRganization: Design patterns for internal packages

An overview of the unique design challenges and opportunities when building R packages for use inside of a single organization versus open-source. By using the jobs-to-be-done framework, this talk explores how internal packages can be better teammates by following specific design patterns for API design, testing, documentaiton, and more.
Jan 21, 2021 11:00 AM rstudio::global(2021)
Slides Video Follow

projmgr: Managing the human dependencies of your project

A lightning talk on key features of the projmgr package
Jul 6, 2020 11:00 AM UseR!2020
Project Video Follow
See all talks

Projects

*
All Packages

dbtplyr

dbt package bringing dplyr semantics to SQL

convo

R package for managing controlled vocabularies

satRday Chicago Conference Organizer

Speaker & Sponsor lead for 2019 and 2020

Rtistic

Hackathon-in-a-box templates for custom Rmd and ggplot2 themes

projmgr

R package providing project management interface to GitHub

Publications

97 Things Every Data Engineer Should Know: Collective Wisdom from the Experts

Contributed six chapters on tops ranging from data design, development, validation, and democratization
Related Post Publisher Site Amazon

R Markdown Cookbook

This cookbook contains tips and tricks to help you get the most out of R Markdown. Topics include the automated generation of content (diagrams, text), customizing format (Pandoc, HTML, and LaTeX templates), workflow improvements (modularizing child documents, cross-referencing code chunks, chunk caching), modifying rendering behavior with hooks, and using alternative language engines.
Read Online Publisher Site Amazon

Topics

causal changelog data dbt jtbd notes package pkgdev python resources rmarkdown rstats shiny speaking sql tutorial workflow