Last updated: 2021-10-06
Checks: 7 0
Knit directory: myTidyTuesday/
This reproducible R Markdown analysis was created with workflowr (version 1.6.2). The Checks tab describes the reproducibility checks that were applied when the results were created. The Past versions tab lists the development history.
Great! Since the R Markdown file has been committed to the Git repository, you know the exact version of the code that produced these results.
Great job! The global environment was empty. Objects defined in the global environment can affect the analysis in your R Markdown file in unknown ways. For reproduciblity it’s best to always run the code in an empty environment.
The command set.seed(20210907)
was run prior to running the code in the R Markdown file. Setting a seed ensures that any results that rely on randomness, e.g. subsampling or permutations, are reproducible.
Great job! Recording the operating system, R version, and package versions is critical for reproducibility.
Nice! There were no cached chunks for this analysis, so you can be confident that you successfully produced the results during this run.
Great job! Using relative paths to the files within your workflowr project makes it easier to run your code on other machines.
Great! You are using Git for version control. Tracking code development and connecting the code version to the results is critical for reproducibility.
The results in this page were generated with repository version 0a83f10. See the Past versions tab to see a history of the changes made to the R Markdown and HTML files.
Note that you need to be careful to ensure that all relevant files for the analysis have been committed to Git prior to generating the results (you can use wflow_publish
or wflow_git_commit
). workflowr only checks the R Markdown file, but you know if there are other scripts or data files that it depends on. Below is the status of the Git repository when the results were generated:
Ignored files:
Ignored: .Rhistory
Ignored: .Rproj.user/
Ignored: catboost_info/
Ignored: data/2021-09-08/
Ignored: data/CNHI_Excel_Chart.xlsx
Ignored: data/CommunityTreemap.jpeg
Ignored: data/Community_Roles.jpeg
Ignored: data/YammerDigitalDataScienceMembership.xlsx
Ignored: data/acs_poverty.rds
Ignored: data/fmhpi.rds
Ignored: data/grainstocks.rds
Ignored: data/hike_data.rds
Ignored: data/nber_rs.rmd
Ignored: data/netflixTitles.rmd
Ignored: data/us_states.rds
Ignored: data/us_states_hexgrid.geojson
Ignored: data/weatherstats_toronto_daily.csv
Untracked files:
Untracked: analysis/2021_04_20.Rmd
Untracked: code/YammerReach.R
Untracked: code/work list batch targets.R
Unstaged changes:
Modified: code/_common.R
Note that any generated files, e.g. HTML, png, CSS, etc., are not included in this status report because it is ok for generated content to have uncommitted changes.
These are the previous versions of the repository in which changes were made to the R Markdown (analysis/2021_09_28_NBERpapers.Rmd
) and HTML (docs/2021_09_28_NBERpapers.html
) files. If you’ve configured a remote Git repository (see ?wflow_git_remote
), click on the hyperlinks in the table below to view the files as they were in that past version.
File | Version | Author | Date | Message |
---|---|---|---|---|
Rmd | 0a83f10 | opus1993 | 2021-10-06 | use best_contrast in treemap |
html | 0c46dc1 | opus1993 | 2021-10-06 | Build site. |
Rmd | 9fb758b | opus1993 | 2021-10-06 | better constrasting text |
html | 0fdc287 | opus1993 | 2021-10-04 | Build site. |
Rmd | 4c00fd7 | opus1993 | 2021-10-04 | normalize the preprocessed data to properly lasso penalize the |
html | 594b352 | opus1993 | 2021-10-04 | Build site. |
Rmd | a80b1b6 | opus1993 | 2021-10-04 | improve bar graph geom_text legibility |
html | 08aaac0 | opus1993 | 2021-10-03 | Build site. |
Rmd | 645c9a6 | opus1993 | 2021-10-03 | add tidytuesday tweet |
html | 322ecf4 | opus1993 | 2021-10-03 | Build site. |
Rmd | 5998caf | opus1993 | 2021-10-03 | annotate with nber logo and tidytuesday logo 2nd try |
html | 66b00e0 | opus1993 | 2021-10-03 | Build site. |
Rmd | 01425d1 | opus1993 | 2021-10-03 | annotate with nber logo and tidytuesday logo |
html | 4370089 | opus1993 | 2021-10-03 | Build site. |
Rmd | d6b0274 | opus1993 | 2021-10-03 | attempting alt text in the new knitr engine |
html | 83a6c48 | opus1993 | 2021-10-03 | Build site. |
Rmd | becd96c | opus1993 | 2021-10-03 | drop the plotly chart in favor of static ggplot |
html | c2084af | opus1993 | 2021-10-02 | Build site. |
Rmd | f64fb40 | opus1993 | 2021-10-02 | initial commit |
The #TidyTuesday data sets this week come from the National Bureau of Economic Research NBER by way of the nberwp
package by Ben Davies.
Ben also has a detailed blogpost looking at this data, and NBER discusses the history of the organization here here.
My plan here is to learn something about the documents in the set and explore some R package functionality. Let’s load up R packages:
source(here::here("code","_common.R"),
verbose = FALSE,
local = knitr::knit_global())
Registered S3 method overwritten by 'tune':
method from
required_pkgs.model_spec parsnip
[conflicted] Will prefer dials::degree over any other package
suppressPackageStartupMessages({
library(tidyverse) # clean and transform rectangular data
library(treemapify)
library(extrafont)
library(tidytext)
library(tidylo)
library(tidygraph)
library(ggraph)
library(igraph)
library(patchwork)
library(tidymodels) # machine learning tools
library(textrecipes)
library(finetune) # racing methods for accelerating hyperparameter tuning
library(themis) # ml prep tools for handling unbalanced datasets
})
extrafont::loadfonts(quiet = TRUE)
theme_set(theme_jim(base_size = 14))
papers <-
readr::read_csv(
"https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/data/2021/2021-09-28/papers.csv"
)
programs <-
readr::read_csv(
"https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/data/2021/2021-09-28/programs.csv"
)
paper_authors <-
readr::read_csv(
"https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/data/2021/2021-09-28/paper_authors.csv"
)
paper_programs <-
readr::read_csv(
"https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/data/2021/2021-09-28/paper_programs.csv"
)
Let’s start by joining up these datasets to find the info we need. The papers are grouped into twenty one programs so let’s train a multiclass predictive model to better understand them. I am going to choose to omit the technical working papers.
papers_joined <-
paper_programs %>%
left_join(programs) %>%
left_join(papers) %>%
filter(!is.na(program_desc)) %>%
mutate(pub_date = lubridate::ym(paste(year, "-", month))) %>%
distinct(paper, pub_date, title, program_desc, program_category) %>%
filter(
program_desc != "Technical Working Papers",
!is.na(pub_date),
!is.na(title),
!is.na(program_desc)
) %>%
mutate(program_desc = factor(program_desc))
papers_joined %>%
count(program_desc, sort = TRUE)
The data are not balanced, so we will investigate strategies for finding features that work accordingly.
First, though, let’s explore the data with some visuals. Julia Silge’s approach to text modeling often goes down a path of exploring the log odds uniqueness of words within the document categories. Let’s try her approach, found here. And Emil Hvitfeldt’s prismatic
package offers a nice method of building contrasting text on the bars.
title_log_odds <-
papers_joined %>%
unnest_tokens(word, title) %>%
filter(!is.na(program_desc)) %>%
count(program_desc, word, sort = TRUE) %>%
bind_log_odds(program_desc, word, n)
p <- title_log_odds %>%
group_by(program_desc) %>%
slice_max(log_odds_weighted, n = 5) %>%
ungroup() %>%
mutate(word = reorder_within(word, log_odds_weighted, program_desc)) %>%
ggplot(aes(log_odds_weighted, word, fill = program_desc)) +
geom_col(show.legend = FALSE) +
scale_y_reordered() +
geom_text(aes(
label = str_extract(word, "[:alnum:]*"),
color = after_scale(map_chr(fill, best_contrast)), hjust = 0
),
x = 0.2,
size = rel(4),
show.legend = FALSE,
nudge_x = 40
) +
scale_color_manual(values = viridis::viridis_pal(option = "H")(21)[c(1, 8, 15, 2, 9, 16, 3, 10, 17, 4, 11, 18, 5, 12, 19, 6, 13, 20, 7, 14, 21)]) +
scale_fill_manual(values = viridis::viridis_pal(option = "H")(21)[c(1, 8, 15, 2, 9, 16, 3, 10, 17, 4, 11, 18, 5, 12, 19, 6, 13, 20, 7, 14, 21)]) +
facet_wrap(vars(program_desc),
scales = "free",
labeller = label_wrap_gen()
) +
labs(
x = "Log odds (weighted)", y = NULL,
title = "NBER Paper Titles: Most Descriptive Words by Program",
caption = "Data Source: `nberwp` package by Ben Davies"
) +
theme_jim(base_size = 10) +
theme(
panel.grid.major.y = element_blank(),
axis.title.y = element_blank(),
axis.text.y = element_blank()
)
imglogo <- magick::image_read("https://github.com/rfordatascience/tidytuesday/blob/master/data/2021/2021-09-28/nber-logo.png?raw=true")
tidy_logo <- magick::image_read("https://raw.githubusercontent.com/rfordatascience/tidytuesday/master/static/plot_logo.png") %>%
magick::image_resize("300x300")
cowplot::ggdraw() +
cowplot::draw_plot(p) +
cowplot::draw_image(imglogo,
x = 0.01,
y = -0.48,
width = 0.2
) +
cowplot::draw_image(tidy_logo,
x = 0.2,
y = -0.48,
width = .1
)
With this many categorical variables, lets take a look at counts in a treemap:
papers_joined %>%
group_by(program_desc, program_category) %>%
summarise(
n = n(),
last_paper = last(pub_date),
.groups = "drop"
) %>%
slice_max(order_by = n, n = 60) %>%
ggplot(aes(
area = n,
fill = last_paper,
label = program_desc,
subgroup = program_category
)) +
geom_treemap() +
geom_treemap_subgroup_border() +
geom_treemap_text(aes(color = after_scale(map_chr(fill, best_contrast))),
place = "top",
reflow = TRUE
) +
geom_treemap_subgroup_text(
color = "white",
place = "bottomleft",
fontface = "italic",
min.size = 0
) +
scale_fill_viridis_c(option = "H") +
labs(
fill = NULL, title = "National Bureau of Economic Research Papers",
subtitle = "Three primary program categories cover 20 programs. The area corresponds to the\nnumber of papers of each in the dataset.",
caption = "Data Source: Ben Davies {nberwp}"
) +
theme(legend.position = "none")
We could create a co-authorship network graphic straight from the paper_authors table that makes the link between the papers and their authors.
To speed up the process of plotting every year, let’s build a function:
ggraph_theme <- theme_jim(base_size = 12) +
theme(
legend.position = "none",
axis.title = element_blank(),
axis.title.x = element_blank(),
axis.title.y = element_blank(),
axis.text = element_blank(),
axis.text.x = element_blank(),
axis.text.y = element_blank(),
panel.grid = element_blank(),
panel.grid.major = element_blank(),
panel.grid.minor = element_blank()
)
fun_net <- function(yr) {
paper_authors_year <- paper_authors %>%
left_join(papers) %>%
filter(year == yr)
edges_list <- paper_authors_year %>%
mutate(author_id = as.integer(as.factor(author)))
edges_list <- edges_list %>%
left_join(edges_list, by = "paper") %>%
count(author_id.x, author_id.y) %>%
mutate(
max = pmax(author_id.x, author_id.y),
min = pmin(author_id.x, author_id.y)
) %>%
unite(check, c(min, max), remove = FALSE) %>%
distinct(check, .keep_all = TRUE) %>%
mutate(n = case_when(
(author_id.x == author_id.y) ~ 0L,
TRUE ~ n
)) %>%
rename(
from = author_id.x,
to = author_id.y
) %>%
select(from, to, n)
network <- as_tbl_graph(edges_list, directed = FALSE)
return(network)
}
plot80 <- ggraph(
graph = fun_net(1980),
layout = "kk"
) +
geom_node_point() +
geom_edge_diagonal(color = "dimgrey", alpha = 0.8) +
ggraph_theme
plot00 <- ggraph(
graph = fun_net(2000),
layout = "kk"
) +
geom_node_point() +
geom_edge_diagonal(color = "dimgrey", alpha = 0.8) +
ggraph_theme
layout <- c(
area(
t = 1,
l = 1,
b = 4,
r = 2
),
area(
t = 1,
l = 3,
b = 4,
r = 4
)
)
plot80 + plot00 +
plot_layout(design = layout) +
plot_annotation(
title = "Evolution of co-authorship networks for NBER papers",
subtitle = "Algorithm: Kamda-Kawai",
caption = "Data Source: `nberwp` package by Ben Davies",
tag_levels = list(c("1980", "2000"))
)
What can be done to further annotate the visual with metrics? In network analysis, the most common metric for each node is degree, that is the number of connections for each node.
net80 <- fun_net(1980) %>%
activate(edges) %>%
mutate(weights = case_when(
# Solo-authored set to weight=0
n == 0 ~ 0,
# Weight = 1 for all others collaborations
TRUE ~ 1
)) %>%
# Now activate nodes
activate(nodes) %>%
# Compute degree for each node
mutate(deg = centrality_degree(weights = weights)) %>%
# Find author with most collaboration
# (highest-degree node)
mutate(max_deg = max(deg)) %>%
mutate(max_author = case_when(
deg == max_deg ~ 1,
TRUE ~ 0
))
# Same steps for year 2000
net00 <- fun_net(2000) %>%
activate(edges) %>%
mutate(weights = case_when(
n == 0 ~ 0,
TRUE ~ 1
)) %>%
activate(nodes) %>%
mutate(deg = centrality_degree(weights = weights)) %>%
mutate(max_deg = max(deg)) %>%
mutate(max_author = case_when(
deg == max_deg ~ 1,
TRUE ~ 0
))
We may now calculate the average degree for each network.
stat_deg_80 <- net80 %>%
activate(nodes) %>%
as_tibble() %>%
summarise(
year = "1980",
mean_deg = mean(deg),
max_deg = mean(max_deg)
)
stat_deg_00 <- net00 %>%
activate(nodes) %>%
as_tibble() %>%
summarise(
year = "2000",
mean_deg = mean(deg),
max_deg = mean(max_deg)
)
bind_rows(stat_deg_80, stat_deg_00)
The number of connection is increasing between 1980 and 2000. For papers published in 2000, each author collaborated on average with approximately two other authors.
We may now add these information to the plots.
p80 <- ggraph(net80,
layout = "kk"
) +
geom_node_point(aes(col = deg, size = max_author)) +
geom_edge_diagonal(color = "dimgrey", alpha = 0.8) +
scale_color_viridis_b(option = "H") +
guides(size = "none", color = "none") +
ggraph_theme
p00 <- ggraph(net00,
layout = "kk"
) +
geom_node_point(aes(col = deg, size = max_author)) +
guides(size = "none") +
labs(color = "Degree") +
scale_color_viridis_b(option = "H") +
geom_edge_diagonal(color = "dimgrey", alpha = 0.8) +
ggraph_theme
p80 + p00 +
plot_layout(
design = layout,
guides = "collect"
) +
plot_annotation(
title = "Evolution of co-authorship networks for NBER papers",
subtitle = "Largest points show node with maximum degree. Algorithm: Kamda-Kawai",
caption = "Data Source: `nberwp` package by Ben Davies",
tag_levels = list(c("1980", "2000"))
)
More metrics regarding these networks are described in Ben Davies’ blog post.
Ben Nowak’s superb complete network diagram submission:
tweetrmd::include_tweet("https://twitter.com/BjnNowak/status/1442807060396134408")
For this week #TidyTuesday : evolution of co-authorship networks for @nberpubs publications.#RStats code here: https://t.co/42jqOPbo3q pic.twitter.com/8WDkFYbPDv
— Benjamin Nowak (@BjnNowak) September 28, 2021
The types of relationships, as inferences, between program and title words are what we want to discover more about in a predictive model.
Let’s start our modeling by setting up our “data budget.” We’ll stratify by our outcome program_desc
.
nber_split <- initial_split(papers_joined,
strata = program_desc
)
nber_train <- training(nber_split)
nber_test <- testing(nber_split)
set.seed(2021)
nber_folds <- vfold_cv(nber_train, strata = program_desc)
Next, let’s set up feature engineering. We will need to transform our text data into features useful for our model by tokenizing and computing either term frequency or tf-idf. Let’s also upsample since our dataset is imbalanced, with many more of some of the categories than others. Finally, for GLMnet penalties to work properly, all features must be normalized.
nber_rec_tfidf <-
recipe(program_desc ~ title + pub_date,
data = nber_train
) %>%
step_tokenize(title) %>%
step_stem(title) %>%
step_ngram(title, num_tokens = 3) %>%
step_tokenfilter(title, max_tokens = 200) %>%
step_tfidf(title) %>%
step_date(pub_date,
features = c("month", "year"),
keep_original_cols = FALSE
) %>%
step_dummy(all_nominal_predictors()) %>%
step_upsample(program_desc) %>%
step_normalize(all_numeric_predictors()) %>%
step_zv(all_predictors())
Then, let’s create our model specification for a lasso model. We need to use a model specification that can handle multiclass data, in this case multinom_reg()
.
multi_spec <-
multinom_reg(
penalty = tune(),
mixture = 1
) %>%
set_mode("classification") %>%
set_engine("glmnet")
Since the lasso regularization penalty
is a hyperparameter of the model (we can’t find the best value from fitting the model a single time), let’s tune over a grid of possible penalty parameters.
nber_grid <- grid_regular(penalty(range = c(-5, 0)),
levels = 16
)
To speed things up, we will use all but one of the computer’s cores.
ctrl <- control_race(
parallel_over = "everything",
save_pred = TRUE
)
all_cores <- parallelly::availableCores(omit = 1)
all_cores
future::plan("multisession", workers = all_cores) # on Windows
Tidymodels will model every penalty parameter over the first couple of folds, but will begin to drop values unlikely to perform to save processing time.
nber_wf <-
workflow(nber_rec_tfidf, multi_spec)
nber_rs <-
nber_wf %>%
tune_grid(
resamples = nber_folds,
verbose = TRUE,
metric = metric_set(roc_aunu),
grid = nber_grid
)
How did it turn out?
autoplot(nber_rs)
(final_penalty <- select_by_one_std_err(nber_rs,
metric = "roc_auc",
desc(penalty)
))
final_rs <-
nber_wf %>%
finalize_workflow(final_penalty) %>%
last_fit(nber_split)
final_rs
How did our final model perform on the training data?
collect_metrics(final_rs)
We can visualize the difference in performance across classes with a confusion matrix.
collect_predictions(final_rs) %>%
conf_mat(program_desc, .pred_class) %>%
autoplot() +
theme_jim(base_size = 12) +
theme(axis.text.x = element_blank()) +
labs(title = "NBER Classification Confusion Matrix on Training")
We can also visualize the ROC curves for each class.
collect_predictions(final_rs) %>%
roc_curve(
truth = program_desc,
`.pred_Asset Pricing`:`.pred_Public Economics`
) %>%
ggplot(aes(1 - specificity, sensitivity, color = .level)) +
geom_abline(
slope = 1,
color = "gray50",
lty = 2,
alpha = 0.8
) +
geom_path(size = 1.5, alpha = 0.7) +
scale_color_manual(values = viridis::viridis_pal(option = "H")(21)[c(1, 8, 15, 2, 9, 16, 3, 10, 17, 4, 11, 18, 5, 12, 19, 6, 13, 20, 7, 14, 21)], labels = scales::label_wrap(width = 12)) +
labs(color = NULL) +
coord_fixed() +
labs(title = "ROC better for Development Economics than most others") +
guides(color = guide_legend(ncol = 2)) +
theme(legend.text = element_text(size = 8))
Finally, we can extract (and save, if we like) the fitted workflow from our results to use for predicting on new data.
For paper w0456, Sterilization and Offsetting Capital Movements: Evidence from West Germany, 1960-1970, the model makes the following prediction probabilities:
final_fitted <- extract_workflow(final_rs)
## can save this for prediction later with readr::write_rds()
predict(final_fitted, nber_test[85, ], type = "prob") %>%
pivot_longer(cols = everything()) %>%
arrange(desc(value))
The test data’s correct answer (truth) is International Finance and Macroeconomics
My tweet for the week:
tweetrmd::include_tweet("https://twitter.com/jim_gruman/status/1444715803631357958")
#TidyTuesday #RStats text analysis on #R4DS #DataViz featuring @bnldvs's @NBERpubs dataset on more than 1,200 working papers each year. https://t.co/Oa7V53k3uf pic.twitter.com/WP0lLBgicS
— Jim Gruman📚🚵♂️⚙ (@jim_gruman) October 3, 2021
sessionInfo()
R version 4.1.1 (2021-08-10)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 22000)
Matrix products: default
locale:
[1] LC_COLLATE=English_United States.1252
[2] LC_CTYPE=English_United States.1252
[3] LC_MONETARY=English_United States.1252
[4] LC_NUMERIC=C
[5] LC_TIME=English_United States.1252
attached base packages:
[1] stats graphics grDevices utils datasets methods base
other attached packages:
[1] glmnet_4.1-2 Matrix_1.3-4 vctrs_0.3.8 rlang_0.4.11
[5] SnowballC_0.7.0 themis_0.1.4 finetune_0.1.0 textrecipes_0.4.1
[9] yardstick_0.0.8 workflowsets_0.1.0 workflows_0.2.3 tune_0.1.6
[13] rsample_0.1.0 recipes_0.1.17 parsnip_0.1.7.900 modeldata_0.1.1
[17] infer_1.0.0 dials_0.0.10 scales_1.1.1 broom_0.7.9
[21] tidymodels_0.1.4 patchwork_1.1.1 igraph_1.2.6 ggraph_2.0.5
[25] tidygraph_1.2.0 tidylo_0.1.0 tidytext_0.3.2 extrafont_0.17
[29] treemapify_2.5.5 forcats_0.5.1 stringr_1.4.0 dplyr_1.0.7
[33] purrr_0.3.4 readr_2.0.2 tidyr_1.1.4 tibble_3.1.4
[37] ggplot2_3.3.5 tidyverse_1.3.1 workflowr_1.6.2
loaded via a namespace (and not attached):
[1] utf8_1.2.2 R.utils_2.11.0 tidyselect_1.1.1
[4] grid_4.1.1 pROC_1.18.0 munsell_0.5.0
[7] codetools_0.2-18 ragg_1.1.3 future_1.22.1
[10] withr_2.4.2 colorspace_2.0-2 highr_0.9
[13] knitr_1.36 rstudioapi_0.13 Rttf2pt1_1.3.8
[16] listenv_0.8.0 labeling_0.4.2 git2r_0.28.0
[19] polyclip_1.10-0 bit64_4.0.5 DiceDesign_1.9
[22] farver_2.1.0 rprojroot_2.0.2 mlr_2.19.0
[25] parallelly_1.28.1 generics_0.1.0 ipred_0.9-12
[28] xfun_0.26 R6_2.5.1 doParallel_1.0.16
[31] graphlayouts_0.7.1 lhs_1.1.3 assertthat_0.2.1
[34] promises_1.2.0.1 vroom_1.5.5 nnet_7.3-16
[37] gtable_0.3.0 globals_0.14.0 timeDate_3043.102
[40] BBmisc_1.11 systemfonts_1.0.2 splines_4.1.1
[43] extrafontdb_1.0 prismatic_1.0.0 checkmate_2.0.0
[46] yaml_2.2.1 modelr_0.1.8 backports_1.2.1
[49] httpuv_1.6.3 tokenizers_0.2.1 tools_4.1.1
[52] lava_1.6.10 ellipsis_0.3.2 jquerylib_0.1.4
[55] Rcpp_1.0.7 plyr_1.8.6 parallelMap_1.5.1
[58] rpart_4.1-15 ParamHelpers_1.14 viridis_0.6.1
[61] cowplot_1.1.1 haven_2.4.3 ggrepel_0.9.1
[64] fs_1.5.0 here_1.0.1 furrr_0.2.3
[67] unbalanced_2.0 magrittr_2.0.1 data.table_1.14.2
[70] magick_2.7.3 reprex_2.0.1 RANN_2.6.1
[73] GPfit_1.0-8 whisker_0.4 ROSE_0.0-4
[76] R.cache_0.15.0 hms_1.1.1 evaluate_0.14
[79] readxl_1.3.1 shape_1.4.6 gridExtra_2.3
[82] compiler_4.1.1 crayon_1.4.1 R.oo_1.24.0
[85] htmltools_0.5.2 later_1.3.0 tzdb_0.1.2
[88] lubridate_1.7.10 DBI_1.1.1 tweenr_1.0.2
[91] dbplyr_2.1.1 MASS_7.3-54 cli_3.0.1
[94] R.methodsS3_1.8.1 parallel_4.1.1 gower_0.2.2
[97] pkgconfig_2.0.3 tweetrmd_0.0.9 xml2_1.3.2
[100] foreach_1.5.1 bslib_0.3.0 hardhat_0.1.6
[103] prodlim_2019.11.13 rvest_1.0.1 janeaustenr_0.1.5
[106] digest_0.6.28 rmarkdown_2.11 cellranger_1.1.0
[109] fastmatch_1.1-3 curl_4.3.2 lifecycle_1.0.1
[112] jsonlite_1.7.2 viridisLite_0.4.0 fansi_0.5.0
[115] pillar_1.6.3 lattice_0.20-44 fastmap_1.1.0
[118] httr_1.4.2 survival_3.2-11 glue_1.4.2
[121] conflicted_1.0.4 FNN_1.1.3 iterators_1.0.13
[124] bit_4.0.4 ggforce_0.3.3 class_7.3-19
[127] stringi_1.7.5 sass_0.4.0 rematch2_2.1.2
[130] ggfittext_0.9.1 textshaping_0.3.5 styler_1.6.2
[133] future.apply_1.8.1