Last updated: 2021-10-11

Checks: 7 0

Knit directory: myTidyTuesday/

This reproducible R Markdown analysis was created with workflowr (version 1.6.2). The Checks tab describes the reproducibility checks that were applied when the results were created. The Past versions tab lists the development history.

R Markdown file: up-to-date

Great! Since the R Markdown file has been committed to the Git repository, you know the exact version of the code that produced these results.

Environment: empty

Great job! The global environment was empty. Objects defined in the global environment can affect the analysis in your R Markdown file in unknown ways. For reproduciblity it’s best to always run the code in an empty environment.

Seed: set.seed(20210907)

The command set.seed(20210907) was run prior to running the code in the R Markdown file. Setting a seed ensures that any results that rely on randomness, e.g. subsampling or permutations, are reproducible.

Session information: recorded

Great job! Recording the operating system, R version, and package versions is critical for reproducibility.

Cache: none

Nice! There were no cached chunks for this analysis, so you can be confident that you successfully produced the results during this run.

File paths: relative

Great job! Using relative paths to the files within your workflowr project makes it easier to run your code on other machines.

Repository version: a034f06

Great! You are using Git for version control. Tracking code development and connecting the code version to the results is critical for reproducibility.

The results in this page were generated with repository version a034f06. See the Past versions tab to see a history of the changes made to the R Markdown and HTML files.

Note that you need to be careful to ensure that all relevant files for the analysis have been committed to Git prior to generating the results (you can use wflow_publish or wflow_git_commit). workflowr only checks the R Markdown file, but you know if there are other scripts or data files that it depends on. Below is the status of the Git repository when the results were generated: 


Ignored files:
    Ignored:    .Rhistory
    Ignored:    .Rproj.user/
    Ignored:    catboost_info/
    Ignored:    data/2021-09-08/
    Ignored:    data/2021-10-10/
    Ignored:    data/2021-10-11/
    Ignored:    data/CNHI_Excel_Chart.xlsx
    Ignored:    data/CommunityTreemap.jpeg
    Ignored:    data/Community_Roles.jpeg
    Ignored:    data/YammerDigitalDataScienceMembership.xlsx
    Ignored:    data/acs_poverty.rds
    Ignored:    data/airbnbcatboost.rds
    Ignored:    data/australiaweather.rds
    Ignored:    data/fmhpi.rds
    Ignored:    data/grainstocks.rds
    Ignored:    data/hike_data.rds
    Ignored:    data/nber_rs.rmd
    Ignored:    data/netflixTitles.rmd
    Ignored:    data/netflixTitles2.rds
    Ignored:    data/us_states.rds
    Ignored:    data/us_states_hexgrid.geojson
    Ignored:    data/weatherstats_toronto_daily.csv

Untracked files:
    Untracked:  analysis/CHN_1_sp.rds
    Untracked:  analysis/sample data for r test.xlsx
    Untracked:  code/YammerReach.R
    Untracked:  code/work list batch targets.R

Note that any generated files, e.g. HTML, png, CSS, etc., are not included in this status report because it is ok for generated content to have uncommitted changes.

These are the previous versions of the repository in which changes were made to the R Markdown (analysis/2021_06_29_sliced.Rmd) and HTML (docs/2021_06_29_sliced.html) files. If you’ve configured a remote Git repository (see ?wflow_git_remote), click on the hyperlinks in the table below to view the files as they were in that past version.

File Version Author Date Message
Rmd a034f06 opus1993 2021-10-11 adopt common ggplot theming

SLICED is like the TV Show Chopped but for data science. Competitors get a never-before-seen dataset and two-hours to code a solution to a prediction challenge. Contestants get points for the best model plus bonus points for data visualization, votes from the audience, and more.

Season 1 Episode 5 featured a challenge to predict AirBnb pricing for properties in New York City. The evaluation metric in this competition is residual mean log squared error.

To make the best use of the resources that we have, we will explore the data set features to select those with the most predictive power, build a random forest to confirm the recipe, and then use the rest of the time to build one or more catboost ensemble models. Let’s load up some packages:

suppressPackageStartupMessages({
library(tidyverse)
library(hrbrthemes)
library(lubridate)
library(tidytext)

library(tidymodels)
library(textrecipes)
library(treesnip)
library(finetune)
library(stacks)
library(themis)
library(baguette)
  
library(catboost)

})

source(here::here("code","_common.R"),
       verbose = FALSE,
       local = knitr::knit_global())

ggplot2::theme_set(theme_jim(base_size = 12))

#create a data directory
data_dir <- here::here("data",Sys.Date())
if (!file.exists(data_dir)) dir.create(data_dir)

# set a competition metric
mset <- metric_set(mn_log_loss)

# set the competition name from the web address
competition_name <- "sliced-s01e05-WXx7h8"

zipfile <- paste0(data_dir,"/", competition_name, ".zip")

path_export <- here::here("data",Sys.Date(),paste0(competition_name,".csv"))

A quick reminder before downloading the dataset: Go to the web site and accept the competition terms!!!

Import and EDA

I was out on holiday this past week and missed the live competition. This file is a compilation of some of the best parts of what the contestants demonstrated (live coding from scratch) and Julia Silge’s custom metric blog post.

We have basic shell commands available to interact with Kaggle here:

# from the Kaggle api https://github.com/Kaggle/kaggle-api

# the leaderboard
shell(glue::glue("kaggle competitions leaderboard { competition_name } -s"))

# the files to download
shell(glue::glue("kaggle competitions files -c { competition_name }"))

# the command to download files
shell(glue::glue("kaggle competitions download -c { competition_name } -p { data_dir }"))

# unzip the files received
shell(glue::glue("unzip { zipfile } -d { data_dir }"))

Reading in the contents of the datafiles here:

train_df <-
  read_csv(file = glue::glue(
    {
      data_dir
    },
    "/train.csv"
  )) %>%
  mutate(across(c(id, host_id), as.character)) %>%
  mutate(across(
    c(host_name, neighbourhood_group, neighbourhood, room_type),
    as.factor
  )) %>%
  mutate(price = log10(price + 1))

test_df <-
  read_csv(file = glue::glue(
    {
      data_dir
    },
    "/test.csv"
  )) %>%
  mutate(across(c(id, host_id), as.character)) %>%
  mutate_if(is.character, as.factor)

Some questions to answer here: What features have missing data, and imputations may be required? What does the outcome variable look like, in terms of imbalance?

skimr::skim(train_df)

Outcome variable log10(price) has a mean of 2.06 and a range between 0 and 4. Numerical feature reviews_per_month and date last_review are missing about 20% of the time in training data. Categorical variable neighbourhood has 217 levels.

summarize_prices <- function(tbl) {
  tbl %>%
    summarize(
      median_price = 10^median(price) - 1,
      n = n(),
      mean_price = 10^mean(price) - 1
    ) %>%
    arrange(desc(n))
}

train_df %>%
  group_by(neighbourhood_group = withfreq(neighbourhood_group)) %>%
  ggplot(aes(10^price,
    neighbourhood_group,
    color = neighbourhood_group
  )) +
  ggdist::stat_dots(
    aes(fill = neighbourhood_group),
    side = "top",
    alpha = 0.2,
    justification = -0.1,
    binwidth = 0.03,
    dotsize = .5,
    stackratio = .1,
    normalize = "groups",
    show.legend = FALSE
  ) +
  geom_boxplot(
    width = 0.1,
    outlier.shape = NA,
    show.legend = FALSE
  ) +
  scale_x_log10(labels = scales::dollar_format(accuracy = 1)) +
  labs(y = NULL, x = "Price", title = "NYC Airbnb by Neighborhood Groups") +
  theme(panel.grid.major.y = element_blank())

train_df %>%
  mutate(
    host_id = fct_lump(host_id, 30),
    host_id = fct_reorder(host_id, price)
  ) %>%
  group_by(host_id = withfreq(host_id)) %>%
  ggplot(aes(10^price, host_id)) +
  geom_boxplot(show.legend = FALSE) +
  scale_x_log10(labels = scales::dollar_format(accuracy = 1)) +
  labs(y = NULL, x = "Price", title = "NYC Airbnb by Host IDs")

train_df %>%
  mutate(room_type = fct_reorder(room_type, price)) %>%
  group_by(room_type) %>%
  ggplot(aes(10^price,
    room_type,
    color = room_type
  )) +
  ggdist::stat_dots(
    aes(fill = room_type),
    side = "top",
    alpha = 0.2,
    justification = -0.1,
    binwidth = 0.03,
    dotsize = .5,
    stackratio = .08,
    normalize = "groups",
    show.legend = FALSE
  ) +
  geom_boxplot(
    width = 0.1,
    outlier.shape = NA,
    show.legend = FALSE
  ) +
  scale_x_log10(labels = scales::dollar_format(accuracy = 1)) +
  labs(y = NULL, x = "Price", title = "NYC Airbnb by Room Type")

train_df %>%
  unnest_tokens(word, name) %>%
  anti_join(stop_words) %>%
  group_by(word) %>%
  summarize_prices() %>%
  head(30) %>%
  mutate(word = fct_reorder(word, mean_price)) %>%
  ggplot(aes(mean_price, word, size = n)) +
  geom_point() +
  scale_x_log10(labels = scales::dollar_format(accuracy = 1)) +
  labs(size = "Number of Listings", title = "NYC AirBNB Property Description NLP", y = NULL) +
  theme(
    legend.position = c(0.8, 0.3),
    legend.background = element_rect(color = "white")
  )

train_df %>%
  group_by(neighbourhood) %>%
  summarize_prices() %>%
  arrange(-median_price)
ABCDEFGHIJ0123456789
neighbourhood
<fct>
median_price
<dbl>
n
<int>
mean_price
<dbl>
Woodrow700.000001700.00000
Tribeca305.00000128335.38020
Neponsit264.614382264.61438
Flatiron District255.0000055267.77228
NoHo250.0000053254.44736
Breezy Point220.801712220.80171
Midtown219.000001113230.03264
Financial District204.49939538200.08540
West Village200.00000525216.93939
Chelsea199.00000764192.39307
Next
123456
...
22
Previous
1-10 of 217 rows

The outcome variable itself is skewed across all observations in the training data, as prices often are.

train_df %>%
  ggplot(aes(10^price + 1, fill = neighbourhood_group)) +
  geom_histogram(
    position = "identity",
    alpha = 0.5,
    bins = 40
  ) +
  scale_x_log10(
    labels = scales::dollar_format(accuracy = 1),
    breaks = c(5, 10, 100, 1000)
  ) +
  labs(
    fill = NULL, x = "price per night",
    title = "NYC Airbnb"
  ) +
  theme(
    legend.position = c(0.8, 0.5),
    legend.background = element_rect(color = "white")
  )

Let’s explore the relationships between the features and the numeric outcome.

A plot of the time series last_review by year and the corresponding ranges of price

train_df %>%
  group_by(year = year(last_review)) %>%
  summarize(
    mean_price = mean(10^price - 1),
    n = n(),
    low = quantile(10^price - 1, probs = 0.25, na.rm = TRUE),
    high = quantile(10^price - 1, probs = 0.75, na.rm = TRUE),
    .groups = "drop"
  ) %>%
  filter(!is.na(year)) %>%
  ggplot(aes(year, mean_price)) +
  geom_line() +
  geom_point(aes(size = n)) +
  geom_ribbon(aes(ymin = low, ymax = high), alpha = .1) +
  expand_limits(y = 0) +
  scale_x_continuous(breaks = seq(2011, 2017, 2)) +
  scale_y_continuous(labels = scales::dollar_format(accuracy = 1)) +
  labs(
    x = "Year", y = "Mean Price and IQR",
    size = "Reviews", title = "NYC Airbnb"
  ) +
  theme(
    legend.position = c(0.85, 0.2),
    legend.background = element_rect(color = "white")
  )

Histograms of the distributions of each numeric feature:

train_numeric <- train_df %>%
  keep(is.numeric) %>%
  colnames()

chart <- c(train_numeric)

train_df %>%
  select_at(vars(all_of(chart))) %>%
  select(-price) %>%
  pivot_longer(
    cols = everything(),
    names_to = "key",
    values_to = "value"
  ) %>%
  filter(!is.na(value)) %>%
  ggplot() +
  geom_histogram(
    mapping = aes(x = value, fill = key),
    bins = 50, show.legend = FALSE
  ) +
  facet_wrap(~key, scales = "free", ncol = 3) +
  labs(title = "NYC Airbnb Numeric Feature Histograms")

And the outcome variable by each numeric feature:

train_df %>%
  select_at(vars(all_of(chart))) %>%
  pivot_longer(
    cols = -price,
    names_to = "key",
    values_to = "value"
  ) %>%
  filter(!is.na(value)) %>%
  ggplot() +
  geom_point(
    mapping = aes(x = value, y = 10^price + 1),
    alpha = 0.1,
    shape = 20,
    show.legend = FALSE
  ) +
  geom_smooth(aes(
    x = value,
    y = 10^price + 1,
    color = key
  ),
  method = "gam", show.legend = FALSE
  ) +
  facet_wrap(~key, scales = "free", ncol = 3) +
  scale_y_log10(labels = scales::dollar_format(accuracy = 1)) +
  labs(x = NULL, y = "Price", title = "NYC Airbnb")

Adapted from Julia Silge’s demonstration

usa_data <- map_data("usa")

train_df %>%
  ggplot(aes(longitude, latitude, z = price)) +
  stat_summary_hex(bins = 100) +
  labs(fill = "Mean price(log10)") +
  cowplot::theme_map() +
  labs(title = "NYC Airbnb Price Ranges")

theme(
  legend.position = c(0.1, 0.8),
  legend.background = element_rect(color = "white")
)
List of 2
 $ legend.background:List of 5
  ..$ fill         : NULL
  ..$ colour       : chr "white"
  ..$ size         : NULL
  ..$ linetype     : NULL
  ..$ inherit.blank: logi FALSE
  ..- attr(*, "class")= chr [1:2] "element_rect" "element"
 $ legend.position  : num [1:2] 0.1 0.8
 - attr(*, "class")= chr [1:2] "theme" "gg"
 - attr(*, "complete")= logi FALSE
 - attr(*, "validate")= logi TRUE
cr1 <- train_df %>%
  select(-price) %>%
  keep(is.numeric) %>%
  cor(use = "pair")

corrplot::corrplot(cr1, type = "upper")

Conclusions:

Preprocessiong

I am going to train on almost all of the train data. The 1% left is a quick confirmation of validity. The provided file labeled test has no labels.

set.seed(2021)
split <- train_df %>%
  initial_split(
    strata = price,
    prop = .99
  )
train <- training(split)
valid <- testing(split)

There are only 344 held out from training as a last check before submission.

basic_rec <-
  recipe(price ~ ., train) %>%
  # ---- set aside the row id's
  update_role(id, host_name, new_role = "id") %>%
  step_novel(neighbourhood) %>%
  step_other(neighbourhood, threshold = 0.01) %>%
  step_novel(host_id) %>%
  step_other(host_id, threshold = 0.01) %>%
  step_tokenize(name) %>%
  step_stopwords(name) %>%
  step_texthash(name, num_terms = 16) %>%
  step_indicate_na(last_review, reviews_per_month) %>%
  step_mutate(last_review = if_else(is.na(last_review),
    min(train$last_review, na.rm = TRUE), last_review
  )) %>%
  step_holiday(last_review) %>%
  step_date(last_review,
    features = "year",
    keep_original_cols = FALSE
  ) %>%
  step_ns(longitude, latitude, deg_free = 4) %>%
  step_normalize(all_numeric_predictors()) %>%
  step_nzv(all_predictors())
basic_rec %>%
  #  finalize_recipe(list(num_comp = 2)) %>%
  prep() %>%
  juice()
ABCDEFGHIJ0123456789
name_hash01
<dbl>
name_hash02
<dbl>
name_hash03
<dbl>
name_hash04
<dbl>
name_hash05
<dbl>
name_hash06
<dbl>
name_hash07
<dbl>
name_hash08
<dbl>
-0.24802552.3659184-0.7355386-0.0020337080.006263972-0.059547240.1912205-0.0847194
1.95417590.2280928-0.7355386-0.0020337080.006263972-0.059547240.1912205-2.2381047
1.95417590.22809280.5180589-0.0020337082.338526663-2.450044580.1912205-0.0847194
-0.24802550.22809280.5180589-0.0020337080.006263972-0.059547240.1912205-0.0847194
-0.24802550.22809280.5180589-0.0020337080.006263972-2.450044580.1912205-0.0847194
-0.2480255-1.90973280.5180589-0.0020337082.338526663-0.059547240.19122054.2220511
1.95417590.22809280.51805893.8260823270.006263972-0.059547240.1912205-0.0847194
-0.24802550.2280928-0.7355386-0.0020337080.006263972-0.059547240.1912205-0.0847194
-0.2480255-1.9097328-0.7355386-0.0020337080.006263972-0.059547240.1912205-0.0847194
-0.24802550.22809280.5180589-0.0020337080.006263972-0.059547240.1912205-0.0847194
Next
123456
...
1000
Previous
1-10 of 10,000 rows | 1-8 of 38 columns

We will use 5-fold cross validation and stratify between the rain and no-rain classes.

train_folds <- vfold_cv(
  data = train,
  strata = price,
  v = 5
)

Machine Learning

We will build a specification for simple shallow random forest and a specification for catboost.

catboost_spec <- boost_tree(
  trees = 1000,
  min_n = tune(),
  learn_rate = tune(),
  tree_depth = tune()
) %>%
  set_engine("catboost") %>%
  set_mode("regression")

bag_spec <-
  bag_tree(min_n = 10) %>%
  set_engine("rpart", times = 50) %>%
  set_mode("regression")

The yardstick default RMSE is on the log of price, not RMSLE on price. This will create a custom function to track RMSLE:

library(rlang)

rmsle_vec <- function(truth, estimate, na_rm = TRUE, ...) {
  rmsle_impl <- function(truth, estimate) {
    sqrt(mean((log(truth + 1) - log(estimate + 1))^2))
  }

  metric_vec_template(
    metric_impl = rmsle_impl,
    truth = truth,
    estimate = estimate,
    na_rm = na_rm,
    cls = "numeric",
    ...
  )
}

rmsle <- function(data, ...) {
  UseMethod("rmsle")
}

rmsle <- new_numeric_metric(rmsle, direction = "minimize")

rmsle.data.frame <- function(data, truth, estimate, na_rm = TRUE, ...) {
  metric_summarizer(
    metric_nm = "rmsle",
    metric_fn = rmsle_vec,
    data = data,
    truth = !!enquo(truth),
    estimate = !!enquo(estimate),
    na_rm = na_rm,
    ...
  )
}

mset <- metric_set(rmsle)

To speed up computation we will use a parallel backend.

all_cores <- parallelly::availableCores(omit = 1)
all_cores
system 
    11 
future::plan("multisession", workers = all_cores) # on Windows

Lets make a cursory check of the recipe and variable importance, which comes out of rpart for free. This workflow also handles factors without dummies.

bag_wf <-
  workflow() %>%
  add_recipe(basic_rec) %>%
  add_model(bag_spec)

set.seed(123)
bag_fit <- parsnip::fit(bag_wf, data = train)

extract_fit_parsnip(bag_fit)$fit$imp %>%
  mutate(term = fct_reorder(term, value)) %>%
  ggplot(aes(value, term)) +
  geom_point() +
  geom_errorbarh(aes(
    xmin = value - `std.error` / 2,
    xmax = value + `std.error` / 2
  ),
  height = .3
  ) +
  labs(
    title = "Feature Importance",
    x = NULL, y = NULL
  )

We see that room_type and the geographical information will be very important for this model.

Now that we have some confidence that the features have predictive power, lets tune up a set of catboost models.

catboost_params <-
  dials::parameters(
    min_n(), # min data in leaf
    tree_depth(range = c(4, 15)),
    learn_rate(
      range = c(-3, -0.7),
      trans = log10_trans()
    )
  )

cbst_grid <- dials::grid_max_entropy(catboost_params,
  size = 40
)
cbst_grid
ABCDEFGHIJ0123456789
min_n
<int>
tree_depth
<int>
learn_rate
<dbl>
5140.008347083
11110.132580588
2750.001677371
1260.113515427
2250.009718247
37130.009451095
3110.052376601
3680.198293765
840.005399231
23120.001388250
Next
1234
Previous
1-10 of 40 rows
cv_res_catboost <-
  workflow() %>%
  add_recipe(basic_rec) %>%
  add_model(catboost_spec) %>%
  tune_grid(
    resamples = train_folds,
    grid = cbst_grid,
    control = control_race(
      verbose = FALSE,
      save_pred = TRUE,
      save_workflow = TRUE,
      extract = extract_model,
      parallel_over = "resamples"
    ),
    metrics = mset
  )
autoplot(cv_res_catboost)

show_best(cv_res_catboost) %>%
  select(-.estimator)
ABCDEFGHIJ0123456789
min_n
<int>
tree_depth
<int>
learn_rate
<dbl>
.metric
<chr>
mean
<dbl>
n
<int>
std_err
<dbl>
.config
<chr>
2390.1883862rmsle0.0606115650.0005664685Preprocessor1_Model35
790.1655137rmsle0.0607264850.0005829796Preprocessor1_Model17
11110.1325806rmsle0.0607353950.0006244535Preprocessor1_Model02
3680.1982938rmsle0.0607478450.0006251578Preprocessor1_Model08
13140.1300412rmsle0.0607503450.0006326557Preprocessor1_Model38
5 rows
cat_wf_best <-
  workflow() %>%
  add_recipe(basic_rec) %>%
  add_model(catboost_spec) %>%
  finalize_workflow(select_best(cv_res_catboost))

cat_fit_best <- cat_wf_best %>%
  parsnip::fit(data = train)

Catboost model performance

predict(cat_fit_best, new_data = valid) %>%
  cbind(valid) %>%
  ggplot(aes(10^price + 1,
    10^.pred + 1,
    color = neighbourhood_group
  )) +
  geom_abline(
    slope = 1,
    lty = 2,
    color = "gray50",
    alpha = 0.5
  ) +
  geom_point(alpha = 0.8, shape = 21) +
  scale_x_log10(labels = scales::dollar_format(accuracy = 1)) +
  scale_y_log10(labels = scales::dollar_format(accuracy = 1)) +
  labs(
    color = NULL,
    x = "True price",
    y = "Predicted price"
  )

predict(cat_fit_best, new_data = valid) %>%
  cbind(valid) %>%
  rmsle(10^price - 1, 10^.pred - 1)
ABCDEFGHIJ0123456789
.metric
<chr>
.estimator
<chr>
.estimate
<dbl>
rmslestandard0.3922326
1 row

This catboost figure is somewhat better than the leaderboard RMSLE of 0.40758, so it would have been worthy of submission.

Lastly, we build the submission file

bind_cols(predict(cat_fit_best, test_df), test_df) %>%
  select(id, price = .pred) %>%
  write_csv(file = path_export)

and make the submission to the Kaggle board

shell(glue::glue('kaggle competitions submit -c { competition_name } -f { path_export } -m "Catboosted"'))

sessionInfo()
R version 4.1.1 (2021-08-10)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 22000)

Matrix products: default

locale:
[1] LC_COLLATE=English_United States.1252 
[2] LC_CTYPE=English_United States.1252   
[3] LC_MONETARY=English_United States.1252
[4] LC_NUMERIC=C                          
[5] LC_TIME=English_United States.1252    

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] rlang_0.4.11        catboost_0.26       baguette_0.1.1     
 [4] themis_0.1.4        stacks_0.2.1        finetune_0.1.0     
 [7] treesnip_0.1.0.9000 textrecipes_0.4.1   yardstick_0.0.8    
[10] workflowsets_0.1.0  workflows_0.2.3     tune_0.1.6         
[13] rsample_0.1.0       recipes_0.1.17      parsnip_0.1.7.900  
[16] modeldata_0.1.1     infer_1.0.0         dials_0.0.10       
[19] scales_1.1.1        broom_0.7.9         tidymodels_0.1.4   
[22] tidytext_0.3.2      lubridate_1.7.10    hrbrthemes_0.8.0   
[25] forcats_0.5.1       stringr_1.4.0       dplyr_1.0.7        
[28] purrr_0.3.4         readr_2.0.2         tidyr_1.1.4        
[31] tibble_3.1.4        ggplot2_3.3.5       tidyverse_1.3.1    
[34] workflowr_1.6.2    

loaded via a namespace (and not attached):
  [1] utf8_1.2.2           R.utils_2.11.0       tidyselect_1.1.1    
  [4] grid_4.1.1           pROC_1.18.0          munsell_0.5.0       
  [7] codetools_0.2-18     ragg_1.1.3           future_1.22.1       
 [10] withr_2.4.2          colorspace_2.0-2     highr_0.9           
 [13] knitr_1.36           rstudioapi_0.13      Rttf2pt1_1.3.8      
 [16] listenv_0.8.0        labeling_0.4.2       git2r_0.28.0        
 [19] TeachingDemos_2.12   lgr_0.4.3            farver_2.1.0        
 [22] bit64_4.0.5          DiceDesign_1.9       rprojroot_2.0.2     
 [25] mlr_2.19.0           parallelly_1.28.1    vctrs_0.3.8         
 [28] generics_0.1.0       float_0.2-6          ipred_0.9-12        
 [31] xfun_0.26            R6_2.5.1             doParallel_1.0.16   
 [34] lhs_1.1.3            cachem_1.0.6         assertthat_0.2.1    
 [37] vroom_1.5.5          promises_1.2.0.1     nnet_7.3-16         
 [40] gtable_0.3.0         Cubist_0.3.0         globals_0.14.0      
 [43] timeDate_3043.102    BBmisc_1.11          systemfonts_1.0.2   
 [46] text2vec_0.6         splines_4.1.1        extrafontdb_1.0     
 [49] butcher_0.1.5        stopwords_2.2        hexbin_1.28.2       
 [52] earth_5.3.1          checkmate_2.0.0      yaml_2.2.1          
 [55] reshape2_1.4.4       modelr_0.1.8         backports_1.2.1     
 [58] httpuv_1.6.3         tokenizers_0.2.1     extrafont_0.17      
 [61] inum_1.0-4           tools_4.1.1          lava_1.6.10         
 [64] usethis_2.0.1        ellipsis_0.3.2       jquerylib_0.1.4     
 [67] Rcpp_1.0.7           plyr_1.8.6           parallelMap_1.5.1   
 [70] rpart_4.1-15         ParamHelpers_1.14    viridis_0.6.1       
 [73] cowplot_1.1.1        haven_2.4.3          fs_1.5.0            
 [76] here_1.0.1           furrr_0.2.3          unbalanced_2.0      
 [79] magrittr_2.0.1       data.table_1.14.2    ggdist_3.0.0        
 [82] reprex_2.0.1         RANN_2.6.1           GPfit_1.0-8         
 [85] mlapi_0.1.0          mvtnorm_1.1-2        SnowballC_0.7.0     
 [88] whisker_0.4          ROSE_0.0-4           R.cache_0.15.0      
 [91] hms_1.1.1            evaluate_0.14        RhpcBLASctl_0.21-247
 [94] readxl_1.3.1         gridExtra_2.3        compiler_4.1.1      
 [97] maps_3.4.0           crayon_1.4.1         R.oo_1.24.0         
[100] htmltools_0.5.2      mgcv_1.8-36          later_1.3.0         
[103] tzdb_0.1.2           Formula_1.2-4        libcoin_1.0-9       
[106] DBI_1.1.1            corrplot_0.90        dbplyr_2.1.1        
[109] MASS_7.3-54          Matrix_1.3-4         cli_3.0.1           
[112] C50_0.1.5            R.methodsS3_1.8.1    parallel_4.1.1      
[115] gower_0.2.2          pkgconfig_2.0.3      rsparse_0.4.0       
[118] xml2_1.3.2           foreach_1.5.1        bslib_0.3.0         
[121] hardhat_0.1.6        plotmo_3.6.1         prodlim_2019.11.13  
[124] rvest_1.0.1          distributional_0.2.2 janeaustenr_0.1.5   
[127] digest_0.6.28        rmarkdown_2.11       cellranger_1.1.0    
[130] fastmatch_1.1-3      gdtools_0.2.3        nlme_3.1-152        
[133] lifecycle_1.0.1      jsonlite_1.7.2       viridisLite_0.4.0   
[136] fansi_0.5.0          pillar_1.6.3         lattice_0.20-44     
[139] fastmap_1.1.0        httr_1.4.2           plotrix_3.8-2       
[142] survival_3.2-11      glue_1.4.2           conflicted_1.0.4    
[145] FNN_1.1.3            iterators_1.0.13     bit_4.0.4           
[148] class_7.3-19         stringi_1.7.5        sass_0.4.0          
[151] rematch2_2.1.2       textshaping_0.3.5    partykit_1.2-15     
[154] styler_1.6.2         future.apply_1.8.1
LS0tDQp0aXRsZTogIlNsaWNlZCBOWUMgQWlyYm5iIg0KYXV0aG9yOiAiSmltIEdydW1hbiINCmRhdGU6ICJKdW5lIDI5LCAyMDIxIg0Kb3V0cHV0Og0KICB3b3JrZmxvd3I6OndmbG93X2h0bWw6DQogICAgdG9jOiBubw0KICAgIGNvZGVfZm9sZGluZzogaGlkZQ0KICAgIGNvZGVfZG93bmxvYWQ6IHRydWUNCiAgICBkZl9wcmludDogcGFnZWQNCmVkaXRvcl9vcHRpb25zOg0KICBjaHVua19vdXRwdXRfdHlwZTogY29uc29sZQ0KLS0tDQoNCltTTElDRURdKGh0dHBzOi8vd3d3Lm5vdGlvbi5zby9TTElDRUQtU2hvdy1jN2JkMjYzNTZlM2E0MjI3OWUyZGZiYWZiMDQ4MDA3MykgaXMgbGlrZSB0aGUgVFYgU2hvdyBDaG9wcGVkIGJ1dCBmb3IgZGF0YSBzY2llbmNlLiBDb21wZXRpdG9ycyBnZXQgYSBuZXZlci1iZWZvcmUtc2VlbiBkYXRhc2V0IGFuZCB0d28taG91cnMgdG8gY29kZSBhIHNvbHV0aW9uIHRvIGEgcHJlZGljdGlvbiBjaGFsbGVuZ2UuIENvbnRlc3RhbnRzIGdldCBwb2ludHMgZm9yIHRoZSBiZXN0IG1vZGVsIHBsdXMgYm9udXMgcG9pbnRzIGZvciBkYXRhIHZpc3VhbGl6YXRpb24sIHZvdGVzIGZyb20gdGhlIGF1ZGllbmNlLCBhbmQgbW9yZS4NCiANCltTZWFzb24gMSBFcGlzb2RlIDVdKGh0dHBzOi8vd3d3LmthZ2dsZS5jb20vYy9zbGljZWQtczAxZTA1LVdYeDdoOC9kYXRhKSBmZWF0dXJlZCBhIGNoYWxsZW5nZSB0byBwcmVkaWN0IEFpckJuYiBwcmljaW5nIGZvciBwcm9wZXJ0aWVzIGluIE5ldyBZb3JrIENpdHkuIFRoZSBldmFsdWF0aW9uIG1ldHJpYyBpbiB0aGlzIGNvbXBldGl0aW9uIGlzIHJlc2lkdWFsIG1lYW4gbG9nIHNxdWFyZWQgZXJyb3IuDQoNCiFbXShodHRwczovL3d3dy5ub3Rpb24uc28vaW1hZ2UvaHR0cHMlM0ElMkYlMkZzMy11cy13ZXN0LTIuYW1hem9uYXdzLmNvbSUyRnNlY3VyZS5ub3Rpb24tc3RhdGljLmNvbSUyRjdmN2JhNWY5LWQ3YmQtNDEwMS04OTMzLWExMTJiNGY3ODU3MCUyRkZyYW1lXzMucG5nP3RhYmxlPWJsb2NrJmlkPWM3YmQyNjM1LTZlM2EtNDIyNy05ZTJkLWZiYWZiMDQ4MDA3MyZzcGFjZUlkPTJjYzQwNGU2LWZlMjAtNDgzZC05ZWE1LTVkNDRlYjNkZDU4NiZ3aWR0aD0xNTEwJnVzZXJJZD0mY2FjaGU9djIpDQoNClRvIG1ha2UgdGhlIGJlc3QgdXNlIG9mIHRoZSByZXNvdXJjZXMgdGhhdCB3ZSBoYXZlLCB3ZSB3aWxsIGV4cGxvcmUgdGhlIGRhdGEgc2V0IGZlYXR1cmVzIHRvIHNlbGVjdCB0aG9zZSB3aXRoIHRoZSBtb3N0IHByZWRpY3RpdmUgcG93ZXIsIGJ1aWxkIGEgcmFuZG9tIGZvcmVzdCB0byBjb25maXJtIHRoZSByZWNpcGUsIGFuZCB0aGVuIHVzZSB0aGUgcmVzdCBvZiB0aGUgdGltZSB0byBidWlsZCBvbmUgb3IgbW9yZSBjYXRib29zdCBlbnNlbWJsZSBtb2RlbHMuIA0KTGV0J3MgbG9hZCB1cCBzb21lIHBhY2thZ2VzOg0KDQpgYGB7ciBzZXR1cH0NCg0Kc3VwcHJlc3NQYWNrYWdlU3RhcnR1cE1lc3NhZ2VzKHsNCmxpYnJhcnkodGlkeXZlcnNlKQ0KbGlicmFyeShocmJydGhlbWVzKQ0KbGlicmFyeShsdWJyaWRhdGUpDQpsaWJyYXJ5KHRpZHl0ZXh0KQ0KDQpsaWJyYXJ5KHRpZHltb2RlbHMpDQpsaWJyYXJ5KHRleHRyZWNpcGVzKQ0KbGlicmFyeSh0cmVlc25pcCkNCmxpYnJhcnkoZmluZXR1bmUpDQpsaWJyYXJ5KHN0YWNrcykNCmxpYnJhcnkodGhlbWlzKQ0KbGlicmFyeShiYWd1ZXR0ZSkNCiAgDQpsaWJyYXJ5KGNhdGJvb3N0KQ0KDQp9KQ0KDQpzb3VyY2UoaGVyZTo6aGVyZSgiY29kZSIsIl9jb21tb24uUiIpLA0KICAgICAgIHZlcmJvc2UgPSBGQUxTRSwNCiAgICAgICBsb2NhbCA9IGtuaXRyOjprbml0X2dsb2JhbCgpKQ0KDQpnZ3Bsb3QyOjp0aGVtZV9zZXQodGhlbWVfamltKGJhc2Vfc2l6ZSA9IDEyKSkNCg0KI2NyZWF0ZSBhIGRhdGEgZGlyZWN0b3J5DQpkYXRhX2RpciA8LSBoZXJlOjpoZXJlKCJkYXRhIixTeXMuRGF0ZSgpKQ0KaWYgKCFmaWxlLmV4aXN0cyhkYXRhX2RpcikpIGRpci5jcmVhdGUoZGF0YV9kaXIpDQoNCiMgc2V0IGEgY29tcGV0aXRpb24gbWV0cmljDQptc2V0IDwtIG1ldHJpY19zZXQobW5fbG9nX2xvc3MpDQoNCiMgc2V0IHRoZSBjb21wZXRpdGlvbiBuYW1lIGZyb20gdGhlIHdlYiBhZGRyZXNzDQpjb21wZXRpdGlvbl9uYW1lIDwtICJzbGljZWQtczAxZTA1LVdYeDdoOCINCg0KemlwZmlsZSA8LSBwYXN0ZTAoZGF0YV9kaXIsIi8iLCBjb21wZXRpdGlvbl9uYW1lLCAiLnppcCIpDQoNCnBhdGhfZXhwb3J0IDwtIGhlcmU6OmhlcmUoImRhdGEiLFN5cy5EYXRlKCkscGFzdGUwKGNvbXBldGl0aW9uX25hbWUsIi5jc3YiKSkNCmBgYA0KDQpBIHF1aWNrIHJlbWluZGVyIGJlZm9yZSBkb3dubG9hZGluZyB0aGUgZGF0YXNldDogIEdvIHRvIHRoZSB3ZWIgc2l0ZSBhbmQgYWNjZXB0IHRoZSBjb21wZXRpdGlvbiB0ZXJtcyEhIQ0KDQojIEltcG9ydCBhbmQgRURBIHsudGFic2V0fQ0KDQpJIHdhcyBvdXQgb24gaG9saWRheSB0aGlzIHBhc3Qgd2VlayBhbmQgbWlzc2VkIHRoZSBsaXZlIGNvbXBldGl0aW9uLiBUaGlzIGZpbGUgaXMgYSBjb21waWxhdGlvbiBvZiBzb21lIG9mIHRoZSBiZXN0IHBhcnRzIG9mIHdoYXQgdGhlIGNvbnRlc3RhbnRzIGRlbW9uc3RyYXRlZCAobGl2ZSBjb2RpbmcgZnJvbSBzY3JhdGNoKSBhbmQgSnVsaWEgU2lsZ2UncyBbY3VzdG9tIG1ldHJpYyBibG9nIHBvc3RdKGh0dHBzOi8vanVsaWFzaWxnZS5jb20vYmxvZy9ueWMtYWlyYm5iLykuDQoNCiMjIERpcmVjdCBJbXBvcnQgYW5kIFNraW0NCg0KV2UgaGF2ZSBiYXNpYyBzaGVsbCBjb21tYW5kcyBhdmFpbGFibGUgdG8gaW50ZXJhY3Qgd2l0aCBLYWdnbGUgaGVyZToNCg0KYGBge3Iga2FnZ2xlIGNvbXBldGl0aW9ucyB0ZXJtaW5hbCBjb21tYW5kcywgZXZhbD1GQUxTRX0NCiMgZnJvbSB0aGUgS2FnZ2xlIGFwaSBodHRwczovL2dpdGh1Yi5jb20vS2FnZ2xlL2thZ2dsZS1hcGkNCg0KIyB0aGUgbGVhZGVyYm9hcmQNCnNoZWxsKGdsdWU6OmdsdWUoJ2thZ2dsZSBjb21wZXRpdGlvbnMgbGVhZGVyYm9hcmQgeyBjb21wZXRpdGlvbl9uYW1lIH0gLXMnKSkNCg0KIyB0aGUgZmlsZXMgdG8gZG93bmxvYWQNCnNoZWxsKGdsdWU6OmdsdWUoJ2thZ2dsZSBjb21wZXRpdGlvbnMgZmlsZXMgLWMgeyBjb21wZXRpdGlvbl9uYW1lIH0nKSkNCg0KIyB0aGUgY29tbWFuZCB0byBkb3dubG9hZCBmaWxlcw0Kc2hlbGwoZ2x1ZTo6Z2x1ZSgna2FnZ2xlIGNvbXBldGl0aW9ucyBkb3dubG9hZCAtYyB7IGNvbXBldGl0aW9uX25hbWUgfSAtcCB7IGRhdGFfZGlyIH0nKSkNCg0KIyB1bnppcCB0aGUgZmlsZXMgcmVjZWl2ZWQNCnNoZWxsKGdsdWU6OmdsdWUoJ3VuemlwIHsgemlwZmlsZSB9IC1kIHsgZGF0YV9kaXIgfScpKQ0KDQpgYGANCg0KUmVhZGluZyBpbiB0aGUgY29udGVudHMgb2YgdGhlIGRhdGFmaWxlcyBoZXJlOg0KDQpgYGB7cn0NCnRyYWluX2RmIDwtDQogIHJlYWRfY3N2KGZpbGUgPSBnbHVlOjpnbHVlKHsNCiAgICBkYXRhX2Rpcg0KICB9LCAiL3RyYWluLmNzdiIpKSAlPiUNCiAgbXV0YXRlKGFjcm9zcyhjKGlkLCBob3N0X2lkKSwgYXMuY2hhcmFjdGVyKSkgJT4lDQogIG11dGF0ZShhY3Jvc3MoDQogICAgYyhob3N0X25hbWUsIG5laWdoYm91cmhvb2RfZ3JvdXAsIG5laWdoYm91cmhvb2QsIHJvb21fdHlwZSksDQogICAgYXMuZmFjdG9yDQogICkpICU+JQ0KICBtdXRhdGUocHJpY2UgPSBsb2cxMChwcmljZSArIDEpKQ0KDQp0ZXN0X2RmIDwtDQogIHJlYWRfY3N2KGZpbGUgPSBnbHVlOjpnbHVlKHsNCiAgICBkYXRhX2Rpcg0KICB9LCAiL3Rlc3QuY3N2IikpICU+JQ0KICBtdXRhdGUoYWNyb3NzKGMoaWQsIGhvc3RfaWQpLCBhcy5jaGFyYWN0ZXIpKSAlPiUNCiAgbXV0YXRlX2lmKGlzLmNoYXJhY3RlciwgYXMuZmFjdG9yKSANCg0KYGBgDQoNClNvbWUgcXVlc3Rpb25zIHRvIGFuc3dlciBoZXJlOg0KV2hhdCBmZWF0dXJlcyBoYXZlIG1pc3NpbmcgZGF0YSwgYW5kIGltcHV0YXRpb25zIG1heSBiZSByZXF1aXJlZD8NCldoYXQgZG9lcyB0aGUgb3V0Y29tZSB2YXJpYWJsZSBsb29rIGxpa2UsIGluIHRlcm1zIG9mIGltYmFsYW5jZT8NCg0KYGBge3IsIGV2YWw9RkFMU0V9DQpza2ltcjo6c2tpbSh0cmFpbl9kZikNCmBgYA0KDQpPdXRjb21lIHZhcmlhYmxlIGBsb2cxMChwcmljZSlgIGhhcyBhIG1lYW4gb2YgMi4wNiBhbmQgYSByYW5nZSBiZXR3ZWVuIDAgYW5kIDQuIE51bWVyaWNhbCBmZWF0dXJlIGByZXZpZXdzX3Blcl9tb250aGAgYW5kIGRhdGUgYGxhc3RfcmV2aWV3YCBhcmUgbWlzc2luZyBhYm91dCAyMCUgb2YgdGhlIHRpbWUgaW4gdHJhaW5pbmcgZGF0YS4gQ2F0ZWdvcmljYWwgdmFyaWFibGUgYG5laWdoYm91cmhvb2RgIGhhcyAyMTcgbGV2ZWxzLg0KDQojIyBDYXRlZ29yaWNhbCBGZWF0dXJlIFBsb3RzDQoNCmBgYHtyLCBmaWcuYXNwPTEuMn0NCnN1bW1hcml6ZV9wcmljZXMgPC0gZnVuY3Rpb24odGJsKXsNCiAgdGJsICU+JSANCiAgICBzdW1tYXJpemUobWVkaWFuX3ByaWNlID0gMTBebWVkaWFuKHByaWNlKSAtIDEsDQogICAgICAgICAgICAgIG4gPSBuKCksDQogICAgICAgICAgICAgIG1lYW5fcHJpY2UgPSAxMF5tZWFuKHByaWNlKSAtIDEpICU+JSANCiAgICBhcnJhbmdlKGRlc2MobikpDQp9DQoNCnRyYWluX2RmICU+JQ0KICBncm91cF9ieShuZWlnaGJvdXJob29kX2dyb3VwID0gd2l0aGZyZXEobmVpZ2hib3VyaG9vZF9ncm91cCkpICU+JQ0KICBnZ3Bsb3QoYWVzKDEwIF4gcHJpY2UsIA0KICAgICAgICAgICAgIG5laWdoYm91cmhvb2RfZ3JvdXAsIA0KICAgICAgICAgICAgIGNvbG9yID0gbmVpZ2hib3VyaG9vZF9ncm91cCkpICsNCiAgZ2dkaXN0OjpzdGF0X2RvdHMoDQogICAgYWVzKGZpbGwgPSBuZWlnaGJvdXJob29kX2dyb3VwKSwNCiAgICBzaWRlID0gInRvcCIsDQogICAgYWxwaGEgPSAwLjIsDQogICAganVzdGlmaWNhdGlvbiA9IC0wLjEsDQogICAgYmlud2lkdGggPSAwLjAzLA0KICAgIGRvdHNpemUgPSAuNSwNCiAgICBzdGFja3JhdGlvID0gLjEsDQogICAgbm9ybWFsaXplID0gImdyb3VwcyIsDQogICAgc2hvdy5sZWdlbmQgPSBGQUxTRQ0KICApICsNCiAgZ2VvbV9ib3hwbG90KA0KICAgIHdpZHRoID0gMC4xLA0KICAgIG91dGxpZXIuc2hhcGUgPSBOQSwNCiAgICBzaG93LmxlZ2VuZCA9IEZBTFNFDQogICkgKw0KICBzY2FsZV94X2xvZzEwKGxhYmVscyA9IHNjYWxlczo6ZG9sbGFyX2Zvcm1hdChhY2N1cmFjeSA9IDEpKSArDQogIGxhYnMoeSA9IE5VTEwsIHggPSAiUHJpY2UiLCB0aXRsZSA9ICJOWUMgQWlyYm5iIGJ5IE5laWdoYm9yaG9vZCBHcm91cHMiKSArDQogIHRoZW1lKHBhbmVsLmdyaWQubWFqb3IueSA9IGVsZW1lbnRfYmxhbmsoKSkNCg0KdHJhaW5fZGYgJT4lDQogIG11dGF0ZShob3N0X2lkID0gZmN0X2x1bXAoaG9zdF9pZCwgMzApLA0KICAgICAgICAgaG9zdF9pZCA9IGZjdF9yZW9yZGVyKGhvc3RfaWQsIHByaWNlKSkgJT4lDQogIGdyb3VwX2J5KGhvc3RfaWQgPSB3aXRoZnJlcShob3N0X2lkKSkgJT4lDQogIGdncGxvdChhZXMoMTAgXiBwcmljZSAsIGhvc3RfaWQpKSArDQogIGdlb21fYm94cGxvdChzaG93LmxlZ2VuZCA9IEZBTFNFKSArDQogIHNjYWxlX3hfbG9nMTAobGFiZWxzID0gc2NhbGVzOjpkb2xsYXJfZm9ybWF0KGFjY3VyYWN5ID0gMSkpICsNCiAgbGFicyh5ID0gTlVMTCwgeCA9ICJQcmljZSIsIHRpdGxlID0gIk5ZQyBBaXJibmIgYnkgSG9zdCBJRHMiKQ0KDQp0cmFpbl9kZiAlPiUNCiAgbXV0YXRlKHJvb21fdHlwZSA9IGZjdF9yZW9yZGVyKHJvb21fdHlwZSwgcHJpY2UpKSAlPiUNCiAgZ3JvdXBfYnkocm9vbV90eXBlKSAlPiUNCiAgZ2dwbG90KGFlcygxMCBeIHByaWNlLCANCiAgICAgICAgICAgICByb29tX3R5cGUsDQogICAgICAgICAgICAgY29sb3IgPSByb29tX3R5cGUpKSArDQogIGdnZGlzdDo6c3RhdF9kb3RzKA0KICAgIGFlcyhmaWxsID0gcm9vbV90eXBlKSwNCiAgICBzaWRlID0gInRvcCIsDQogICAgYWxwaGEgPSAwLjIsDQogICAganVzdGlmaWNhdGlvbiA9IC0wLjEsDQogICAgYmlud2lkdGggPSAwLjAzLA0KICAgIGRvdHNpemUgPSAuNSwNCiAgICBzdGFja3JhdGlvID0gLjA4LA0KICAgIG5vcm1hbGl6ZSA9ICJncm91cHMiLA0KICAgIHNob3cubGVnZW5kID0gRkFMU0UNCiAgKSArDQogIGdlb21fYm94cGxvdCgNCiAgICB3aWR0aCA9IDAuMSwNCiAgICBvdXRsaWVyLnNoYXBlID0gTkEsDQogICAgc2hvdy5sZWdlbmQgPSBGQUxTRQ0KICApICsNCiAgc2NhbGVfeF9sb2cxMChsYWJlbHMgPSBzY2FsZXM6OmRvbGxhcl9mb3JtYXQoYWNjdXJhY3kgPSAxKSkgKw0KICBsYWJzKHkgPSBOVUxMLCB4ID0gIlByaWNlIiwgdGl0bGUgPSAiTllDIEFpcmJuYiBieSBSb29tIFR5cGUiKQ0KDQp0cmFpbl9kZiAlPiUNCiAgdW5uZXN0X3Rva2Vucyh3b3JkLCBuYW1lKSAlPiUNCiAgYW50aV9qb2luKHN0b3Bfd29yZHMpICU+JSANCiAgZ3JvdXBfYnkod29yZCApICU+JQ0KICBzdW1tYXJpemVfcHJpY2VzKCkgJT4lDQogIGhlYWQoMzApICU+JQ0KICBtdXRhdGUod29yZCA9IGZjdF9yZW9yZGVyKHdvcmQsIG1lYW5fcHJpY2UpKSAlPiUNCiAgZ2dwbG90KGFlcyhtZWFuX3ByaWNlLCB3b3JkLCBzaXplID0gbikpICsNCiAgZ2VvbV9wb2ludCgpICsNCiAgc2NhbGVfeF9sb2cxMChsYWJlbHMgPSBzY2FsZXM6OmRvbGxhcl9mb3JtYXQoYWNjdXJhY3kgPSAxKSkgKw0KICBsYWJzKHNpemUgPSAiTnVtYmVyIG9mIExpc3RpbmdzIiwgdGl0bGUgPSAiTllDIEFpckJOQiBQcm9wZXJ0eSBEZXNjcmlwdGlvbiBOTFAiLCB5ID0gTlVMTCkgKw0KICB0aGVtZShsZWdlbmQucG9zaXRpb24gPSBjKDAuOCwgMC4zKSwNCiAgICAgICAgbGVnZW5kLmJhY2tncm91bmQgPSBlbGVtZW50X3JlY3QoY29sb3IgPSAid2hpdGUiKSkNCg0KdHJhaW5fZGYgJT4lIA0KICBncm91cF9ieShuZWlnaGJvdXJob29kKSAlPiUgDQogIHN1bW1hcml6ZV9wcmljZXMoKSAlPiUgDQogIGFycmFuZ2UoLW1lZGlhbl9wcmljZSkgDQoNCmBgYA0KDQojIyBOdW1lcmljIEZlYXR1cmUgUGxvdHMNCg0KVGhlIG91dGNvbWUgdmFyaWFibGUgaXRzZWxmIGlzIHNrZXdlZCBhY3Jvc3MgYWxsIG9ic2VydmF0aW9ucyBpbiB0aGUgdHJhaW5pbmcgZGF0YSwgYXMgcHJpY2VzIG9mdGVuIGFyZS4NCg0KYGBge3J9DQp0cmFpbl9kZiAlPiUNCiAgZ2dwbG90KGFlcygxMF5wcmljZSArIDEsIGZpbGwgPSBuZWlnaGJvdXJob29kX2dyb3VwKSkgKw0KICBnZW9tX2hpc3RvZ3JhbShwb3NpdGlvbiA9ICJpZGVudGl0eSIsIA0KICAgICAgICAgICAgICAgICBhbHBoYSA9IDAuNSwgDQogICAgICAgICAgICAgICAgIGJpbnMgPSA0MCkgKw0KICBzY2FsZV94X2xvZzEwKGxhYmVscyA9IHNjYWxlczo6ZG9sbGFyX2Zvcm1hdChhY2N1cmFjeSA9IDEpLA0KICAgICAgICAgICAgICAgIGJyZWFrcyA9IGMoNSwgMTAsIDEwMCwgMTAwMCkpICsNCiAgbGFicyhmaWxsID0gTlVMTCwgeCA9ICJwcmljZSBwZXIgbmlnaHQiLA0KICAgICAgIHRpdGxlID0gIk5ZQyBBaXJibmIiKSArDQogIHRoZW1lKGxlZ2VuZC5wb3NpdGlvbiA9IGMoMC44LCAwLjUpLA0KICAgICAgICBsZWdlbmQuYmFja2dyb3VuZCA9IGVsZW1lbnRfcmVjdChjb2xvciA9ICJ3aGl0ZSIpKQ0KYGBgDQoNCkxldCdzIGV4cGxvcmUgdGhlIHJlbGF0aW9uc2hpcHMgYmV0d2VlbiB0aGUgZmVhdHVyZXMgYW5kIHRoZSBudW1lcmljIG91dGNvbWUuIA0KDQpBIHBsb3Qgb2YgdGhlIHRpbWUgc2VyaWVzIGBsYXN0X3Jldmlld2AgYnkgeWVhciBhbmQgdGhlIGNvcnJlc3BvbmRpbmcgcmFuZ2VzIG9mIHByaWNlDQoNCmBgYHtyfQ0KdHJhaW5fZGYgJT4lDQogIGdyb3VwX2J5KHllYXIgPSB5ZWFyKGxhc3RfcmV2aWV3KSkgJT4lDQogIHN1bW1hcml6ZShtZWFuX3ByaWNlID0gbWVhbigxMF5wcmljZSAtIDEpLA0KICAgICAgICAgICAgbiA9IG4oKSwNCiAgICAgICAgICAgIGxvdyA9IHF1YW50aWxlKDEwXnByaWNlIC0gMSwgcHJvYnMgPSAwLjI1LCBuYS5ybSA9IFRSVUUpLA0KICAgICAgICAgICAgaGlnaCA9IHF1YW50aWxlKDEwXnByaWNlIC0gMSwgcHJvYnMgPSAwLjc1LCBuYS5ybSA9IFRSVUUpLA0KICAgICAgICAgICAgICAuZ3JvdXBzID0gImRyb3AiKSAlPiUNCiAgZmlsdGVyKCFpcy5uYSh5ZWFyKSkgJT4lIA0KICBnZ3Bsb3QoYWVzKHllYXIsIG1lYW5fcHJpY2UpKSArDQogIGdlb21fbGluZSgpICsNCiAgZ2VvbV9wb2ludChhZXMoc2l6ZSA9IG4pKSArDQogIGdlb21fcmliYm9uKGFlcyh5bWluID0gbG93LCB5bWF4ID0gaGlnaCksIGFscGhhID0gLjEpICsNCiAgZXhwYW5kX2xpbWl0cyh5ID0gMCkgKw0KICBzY2FsZV94X2NvbnRpbnVvdXMoYnJlYWtzID0gc2VxKDIwMTEsIDIwMTcsIDIpKSArDQogIHNjYWxlX3lfY29udGludW91cyhsYWJlbHMgPSBzY2FsZXM6OmRvbGxhcl9mb3JtYXQoYWNjdXJhY3kgPSAxKSkgKw0KICBsYWJzKHggPSAiWWVhciIsIHkgPSAiTWVhbiBQcmljZSBhbmQgSVFSIiwNCiAgICAgICBzaXplID0gIlJldmlld3MiLCB0aXRsZSA9ICJOWUMgQWlyYm5iIikgKw0KICB0aGVtZShsZWdlbmQucG9zaXRpb24gPSBjKDAuODUsIDAuMiksDQogICAgICAgIGxlZ2VuZC5iYWNrZ3JvdW5kID0gZWxlbWVudF9yZWN0KGNvbG9yID0gIndoaXRlIikpDQpgYGANCg0KSGlzdG9ncmFtcyBvZiB0aGUgZGlzdHJpYnV0aW9ucyBvZiBlYWNoIG51bWVyaWMgZmVhdHVyZToNCg0KYGBge3IgbnVtZXJpY19mZWF0dXJlMSwgZmlnLmFzcD0xfQ0KdHJhaW5fbnVtZXJpYyA8LSB0cmFpbl9kZiAlPiUga2VlcChpcy5udW1lcmljKSAlPiUgY29sbmFtZXMoKQ0KDQpjaGFydCA8LSBjKHRyYWluX251bWVyaWMpDQoNCnRyYWluX2RmICU+JQ0KICBzZWxlY3RfYXQodmFycyhhbGxfb2YoY2hhcnQpKSkgJT4lDQogIHNlbGVjdCgtcHJpY2UpICU+JSANCiAgcGl2b3RfbG9uZ2VyKGNvbHMgPSBldmVyeXRoaW5nKCksDQogICAgbmFtZXNfdG8gPSAia2V5IiwNCiAgICB2YWx1ZXNfdG8gPSAidmFsdWUiDQogICkgJT4lIA0KICBmaWx0ZXIoIWlzLm5hKHZhbHVlKSkgJT4lIA0KICBnZ3Bsb3QoKSArDQogIGdlb21faGlzdG9ncmFtKG1hcHBpbmcgPSBhZXMoeCA9IHZhbHVlLCBmaWxsID0ga2V5KSwNCiAgICAgICAgICAgICAgICAgYmlucyA9IDUwLCBzaG93LmxlZ2VuZCA9IEZBTFNFKSArDQogIGZhY2V0X3dyYXAofiBrZXksIHNjYWxlcyA9ICJmcmVlIiwgbmNvbCA9IDMpICsNCiAgbGFicyh0aXRsZSA9ICJOWUMgQWlyYm5iIE51bWVyaWMgRmVhdHVyZSBIaXN0b2dyYW1zIikNCg0KYGBgDQoNCkFuZCB0aGUgb3V0Y29tZSB2YXJpYWJsZSBieSBlYWNoIG51bWVyaWMgZmVhdHVyZToNCg0KYGBge3J9DQp0cmFpbl9kZiAlPiUNCiAgc2VsZWN0X2F0KHZhcnMoYWxsX29mKGNoYXJ0KSkpICU+JQ0KICBwaXZvdF9sb25nZXIoY29scyA9IC1wcmljZSwNCiAgICAgICAgICAgICAgIG5hbWVzX3RvID0gImtleSIsDQogICAgICAgICAgICAgICB2YWx1ZXNfdG8gPSAidmFsdWUiKSAlPiUNCiAgZmlsdGVyKCFpcy5uYSh2YWx1ZSkpICU+JQ0KICBnZ3Bsb3QoKSArDQogIGdlb21fcG9pbnQoDQogICAgbWFwcGluZyA9IGFlcyh4ID0gdmFsdWUsIHkgPSAxMCBeIHByaWNlICsgMSksDQogICAgYWxwaGEgPSAwLjEsDQogICAgc2hhcGUgPSAyMCwNCiAgICBzaG93LmxlZ2VuZCA9IEZBTFNFDQogICkgKw0KICBnZW9tX3Ntb290aChhZXMoDQogICAgeCA9IHZhbHVlLA0KICAgIHkgPSAxMCBeIHByaWNlICsgMSAsDQogICAgY29sb3IgPSBrZXkpLA0KICAgIG1ldGhvZCA9ICJnYW0iLCBzaG93LmxlZ2VuZCA9IEZBTFNFKSArDQogIGZhY2V0X3dyYXAofiBrZXksIHNjYWxlcyA9ICJmcmVlIiwgbmNvbCA9IDMpICsNCiAgc2NhbGVfeV9sb2cxMChsYWJlbHMgPSBzY2FsZXM6OmRvbGxhcl9mb3JtYXQoYWNjdXJhY3kgPSAxKSkgKw0KICBsYWJzKHggPSBOVUxMLCB5ID0gIlByaWNlIiwgdGl0bGUgPSAiTllDIEFpcmJuYiIpDQpgYGANCg0KIyMgTWFwIG9mIHByaWNlcyANCg0KQWRhcHRlZCBmcm9tIEp1bGlhIFNpbGdlJ3MgZGVtb25zdHJhdGlvbg0KDQpgYGB7ciwgZmlnLmFzcD0xfQ0KdXNhX2RhdGEgPSBtYXBfZGF0YSgidXNhIikNCg0KdHJhaW5fZGYgJT4lDQogIGdncGxvdChhZXMobG9uZ2l0dWRlLCBsYXRpdHVkZSwgeiA9IHByaWNlKSkgKw0KICBzdGF0X3N1bW1hcnlfaGV4KGJpbnMgPSAxMDApICsNCiAgbGFicyhmaWxsID0gIk1lYW4gcHJpY2UobG9nMTApIikgKw0KICBjb3dwbG90Ojp0aGVtZV9tYXAoKSArDQogIGxhYnModGl0bGUgPSAiTllDIEFpcmJuYiBQcmljZSBSYW5nZXMiKQ0KICB0aGVtZShsZWdlbmQucG9zaXRpb24gPSBjKDAuMSwgMC44KSwNCiAgICAgICAgbGVnZW5kLmJhY2tncm91bmQgPSBlbGVtZW50X3JlY3QoY29sb3IgPSAid2hpdGUiKSkNCmBgYA0KDQojIyBOdW1lcmljIEZlYXR1cmUgQ29ycmVsYXRpb25zDQoNCmBgYHtyIGNvcnJwbG90LCBmaWcuYXNwPTF9DQpjcjEgPC0gdHJhaW5fZGYgJT4lDQogIHNlbGVjdCgtcHJpY2UpICU+JQ0KICBrZWVwKGlzLm51bWVyaWMpICU+JQ0KICBjb3IodXNlID0gInBhaXIiKQ0KDQpjb3JycGxvdDo6Y29ycnBsb3QoY3IxLCB0eXBlID0gInVwcGVyIikNCg0KYGBgDQoNCiMgey19DQoNCkNvbmNsdXNpb25zOg0KDQoqIE5laWdoYm9yaG9vZCBsb2NhdGlvbiBkcml2ZXMgcHJpY2UsIHRocm91Z2ggYm90aCBuYW1lZCBuZWlnaGJvcmhvb2QgYW5kIHRocm91Z2ggbG9uZ2l0dWRlIGFuZCBsYXRpdHVkZS4NCiogVGhlIGxpc3RpbmcgbmFtZXMgaGF2ZSBzb21lIGludGVyZXN0aW5nIHdvcmRzLg0KKiBTb21lIG9mIHRoZSBob3N0cyBkcmF3IGhpZ2hlciBwcmljaW5nLg0KKiB0aGUgbnVtZXJpYyBmZWF0dXJlcyBkbyBub3QgcHJvdmlkZSBhcyBtdWNoIHByZWRpY3RpdmUgcG93ZXIgYWxvbmUNCiogdGhlcmUgYXJlIEFpckJOQiBsaXN0aW5ncyB0aGF0IGhhdmUgbmVpdGhlciByZXZpZXdzIG5vciBsYXN0X3JldmlldyBkYXRlcy4gDQoNCiMgUHJlcHJvY2Vzc2lvbmcgey50YWJzZXR9DQoNCiMjIFRoZSByZWNpcGUgZnJhbWV3b3JrDQoNCkkgYW0gZ29pbmcgdG8gdHJhaW4gb24gYWxtb3N0IGFsbCBvZiB0aGUgdHJhaW4gZGF0YS4gVGhlIDElIGxlZnQgaXMgYSBxdWljayBjb25maXJtYXRpb24gb2YgdmFsaWRpdHkuICBUaGUgcHJvdmlkZWQgZmlsZSBsYWJlbGVkIGB0ZXN0YCBoYXMgbm8gbGFiZWxzLg0KDQpgYGB7cn0NCnNldC5zZWVkKDIwMjEpDQpzcGxpdCA8LSB0cmFpbl9kZiAlPiUgDQogIGluaXRpYWxfc3BsaXQoc3RyYXRhID0gcHJpY2UsDQogICAgICAgICAgICAgICAgICAgICAgIHByb3AgPSAuOTkpDQp0cmFpbiA8LSB0cmFpbmluZyhzcGxpdCkNCnZhbGlkIDwtIHRlc3Rpbmcoc3BsaXQpDQpgYGANCg0KVGhlcmUgYXJlIG9ubHkgYHIgbnJvdyh2YWxpZClgIGhlbGQgb3V0IGZyb20gdHJhaW5pbmcgYXMgYSBsYXN0IGNoZWNrIGJlZm9yZSBzdWJtaXNzaW9uLg0KDQpgYGB7cn0NCmJhc2ljX3JlYyA8LQ0KICByZWNpcGUocHJpY2UgfiAuLCB0cmFpbikgJT4lDQogICMgLS0tLSBzZXQgYXNpZGUgdGhlIHJvdyBpZCdzDQogIHVwZGF0ZV9yb2xlKGlkLCBob3N0X25hbWUsIG5ld19yb2xlID0gImlkIikgJT4lIA0KICBzdGVwX25vdmVsKG5laWdoYm91cmhvb2QpICU+JQ0KICBzdGVwX290aGVyKG5laWdoYm91cmhvb2QsIHRocmVzaG9sZCA9IDAuMDEpICU+JQ0KICBzdGVwX25vdmVsKGhvc3RfaWQpICU+JQ0KICBzdGVwX290aGVyKGhvc3RfaWQsIHRocmVzaG9sZCA9IDAuMDEpICU+JQ0KICBzdGVwX3Rva2VuaXplKG5hbWUpICU+JQ0KICBzdGVwX3N0b3B3b3JkcyhuYW1lKSAlPiUNCiAgc3RlcF90ZXh0aGFzaChuYW1lLCBudW1fdGVybXMgPSAxNikgJT4lIA0KICBzdGVwX2luZGljYXRlX25hKGxhc3RfcmV2aWV3LCByZXZpZXdzX3Blcl9tb250aCkgJT4lIA0KICBzdGVwX211dGF0ZShsYXN0X3JldmlldyA9IGlmX2Vsc2UoaXMubmEobGFzdF9yZXZpZXcpLA0KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWluKHRyYWluJGxhc3RfcmV2aWV3LCBuYS5ybSA9IFRSVUUpLCBsYXN0X3JldmlldykpICU+JSANCiAgc3RlcF9ob2xpZGF5KGxhc3RfcmV2aWV3KSAlPiUgDQogIHN0ZXBfZGF0ZShsYXN0X3JldmlldywgZmVhdHVyZXMgPSAieWVhciIsDQogICAgICAgICAgICBrZWVwX29yaWdpbmFsX2NvbHMgPSBGQUxTRSkgJT4lIA0KICBzdGVwX25zKGxvbmdpdHVkZSwgbGF0aXR1ZGUsIGRlZ19mcmVlID0gNCkgJT4lDQogIHN0ZXBfbm9ybWFsaXplKGFsbF9udW1lcmljX3ByZWRpY3RvcnMoKSkgJT4lIA0KICBzdGVwX256dihhbGxfcHJlZGljdG9ycygpKQ0KICAgIA0KYGBgDQoNCiMjIHRoZSBwcmUtcHJvY2Vzc2VkIGRhdGENCg0KYGBge3J9DQpiYXNpY19yZWMgJT4lIA0KIyAgZmluYWxpemVfcmVjaXBlKGxpc3QobnVtX2NvbXAgPSAyKSkgJT4lIA0KICBwcmVwKCkgJT4lIA0KICBqdWljZSgpIA0KYGBgDQoNCiMjIENyb3NzIFZhbGlkYXRpb24NCg0KV2Ugd2lsbCB1c2UgNS1mb2xkIGNyb3NzIHZhbGlkYXRpb24gYW5kIHN0cmF0aWZ5IGJldHdlZW4gdGhlIHJhaW4gYW5kIG5vLXJhaW4gY2xhc3Nlcy4NCg0KYGBge3J9DQp0cmFpbl9mb2xkcyA8LSB2Zm9sZF9jdihkYXRhID0gdHJhaW4sDQogICAgICAgICAgICAgICAgICAgICAgICBzdHJhdGEgPSBwcmljZSwNCiAgICAgICAgICAgICAgICAgICAgICAgIHYgPSA1KQ0KDQpgYGANCg0KIyB7LX0NCg0KIyBNYWNoaW5lIExlYXJuaW5nIHsudGFic2V0fQ0KDQojIyBNb2RlbCBTcGVjaWZpY2F0aW9ucw0KDQpXZSB3aWxsIGJ1aWxkIGEgc3BlY2lmaWNhdGlvbiBmb3Igc2ltcGxlIHNoYWxsb3cgcmFuZG9tIGZvcmVzdCBhbmQgYSBzcGVjaWZpY2F0aW9uIGZvciBjYXRib29zdC4gDQoNCmBgYHtyfQ0KY2F0Ym9vc3Rfc3BlYyA8LSBib29zdF90cmVlKHRyZWVzID0gMTAwMCwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBtaW5fbiA9IHR1bmUoKSwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZWFybl9yYXRlID0gdHVuZSgpLA0KICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRyZWVfZGVwdGggPSB0dW5lKCkpICU+JSANCiAgc2V0X2VuZ2luZSgiY2F0Ym9vc3QiKSAlPiUNCiAgc2V0X21vZGUoInJlZ3Jlc3Npb24iKQ0KDQpiYWdfc3BlYyA8LQ0KICBiYWdfdHJlZShtaW5fbiA9IDEwKSAlPiUNCiAgc2V0X2VuZ2luZSgicnBhcnQiLCB0aW1lcyA9IDUwKSAlPiUNCiAgc2V0X21vZGUoInJlZ3Jlc3Npb24iKQ0KDQpgYGANCg0KIyMgVGhlIFJNU0xFIGN1c3RvbSBtZXRyaWMNCg0KVGhlIHlhcmRzdGljayBkZWZhdWx0IFJNU0UgaXMgb24gdGhlIGxvZyBvZiBwcmljZSwgbm90IFJNU0xFIG9uIHByaWNlLiBUaGlzIHdpbGwgY3JlYXRlIGEgY3VzdG9tIGZ1bmN0aW9uIHRvIHRyYWNrIFJNU0xFOg0KDQpgYGB7cn0NCmxpYnJhcnkocmxhbmcpDQoNCnJtc2xlX3ZlYyA8LSBmdW5jdGlvbih0cnV0aCwgZXN0aW1hdGUsIG5hX3JtID0gVFJVRSwgLi4uKSB7DQogIHJtc2xlX2ltcGwgPC0gZnVuY3Rpb24odHJ1dGgsIGVzdGltYXRlKSB7DQogICAgc3FydChtZWFuKChsb2codHJ1dGggKyAxKSAtIGxvZyhlc3RpbWF0ZSArIDEpKV4yKSkNCiAgfQ0KDQogIG1ldHJpY192ZWNfdGVtcGxhdGUoDQogICAgbWV0cmljX2ltcGwgPSBybXNsZV9pbXBsLA0KICAgIHRydXRoID0gdHJ1dGgsDQogICAgZXN0aW1hdGUgPSBlc3RpbWF0ZSwNCiAgICBuYV9ybSA9IG5hX3JtLA0KICAgIGNscyA9ICJudW1lcmljIiwNCiAgICAuLi4NCiAgKQ0KfQ0KDQpybXNsZSA8LSBmdW5jdGlvbihkYXRhLCAuLi4pIHsNCiAgVXNlTWV0aG9kKCJybXNsZSIpDQp9DQoNCnJtc2xlIDwtIG5ld19udW1lcmljX21ldHJpYyhybXNsZSwgZGlyZWN0aW9uID0gIm1pbmltaXplIikNCg0Kcm1zbGUuZGF0YS5mcmFtZSA8LSBmdW5jdGlvbihkYXRhLCB0cnV0aCwgZXN0aW1hdGUsIG5hX3JtID0gVFJVRSwgLi4uKSB7DQogIG1ldHJpY19zdW1tYXJpemVyKA0KICAgIG1ldHJpY19ubSA9ICJybXNsZSIsDQogICAgbWV0cmljX2ZuID0gcm1zbGVfdmVjLA0KICAgIGRhdGEgPSBkYXRhLA0KICAgIHRydXRoID0gISFlbnF1byh0cnV0aCksDQogICAgZXN0aW1hdGUgPSAhIWVucXVvKGVzdGltYXRlKSwNCiAgICBuYV9ybSA9IG5hX3JtLA0KICAgIC4uLg0KICApDQp9DQoNCm1zZXQgPSBtZXRyaWNfc2V0KHJtc2xlKQ0KYGBgDQoNCiMjIFBhcmFsbGVsIGJhY2tlbmQNCg0KVG8gc3BlZWQgdXAgY29tcHV0YXRpb24gd2Ugd2lsbCB1c2UgYSBwYXJhbGxlbCBiYWNrZW5kLg0KDQpgYGB7cn0NCmFsbF9jb3JlcyA8LSBwYXJhbGxlbGx5OjphdmFpbGFibGVDb3JlcyhvbWl0ID0gMSkNCmFsbF9jb3Jlcw0KDQpmdXR1cmU6OnBsYW4oIm11bHRpc2Vzc2lvbiIsIHdvcmtlcnMgPSBhbGxfY29yZXMpICMgb24gV2luZG93cw0KDQpgYGANCg0KIyMgQSBxdWljayBSYW5kb20gRm9yZXN0DQoNCkxldHMgbWFrZSBhIGN1cnNvcnkgY2hlY2sgb2YgdGhlIHJlY2lwZSBhbmQgdmFyaWFibGUgaW1wb3J0YW5jZSwgd2hpY2ggY29tZXMgb3V0IG9mIGBycGFydGAgZm9yIGZyZWUuIFRoaXMgd29ya2Zsb3cgYWxzbyBoYW5kbGVzIGZhY3RvcnMgd2l0aG91dCBkdW1taWVzLg0KDQpgYGB7ciByYW5kb21fZm9yZXN0X2ZpdCwgZmlnLmFzcD0xfQ0KYmFnX3dmIDwtDQogIHdvcmtmbG93KCkgJT4lDQogIGFkZF9yZWNpcGUoYmFzaWNfcmVjKSAlPiUNCiAgYWRkX21vZGVsKGJhZ19zcGVjKQ0KDQpzZXQuc2VlZCgxMjMpDQpiYWdfZml0IDwtIHBhcnNuaXA6OmZpdChiYWdfd2YsIGRhdGEgPSB0cmFpbikNCg0KZXh0cmFjdF9maXRfcGFyc25pcChiYWdfZml0KSRmaXQkaW1wICU+JQ0KICBtdXRhdGUodGVybSA9IGZjdF9yZW9yZGVyKHRlcm0sIHZhbHVlKSkgJT4lDQogIGdncGxvdChhZXModmFsdWUsIHRlcm0pKSArDQogIGdlb21fcG9pbnQoKSArDQogIGdlb21fZXJyb3JiYXJoKGFlcygNCiAgICB4bWluID0gdmFsdWUgLSBgc3RkLmVycm9yYCAvIDIsDQogICAgeG1heCA9IHZhbHVlICsgYHN0ZC5lcnJvcmAgLyAyDQogICksDQogIGhlaWdodCA9IC4zKSArDQogIGxhYnModGl0bGUgPSAiRmVhdHVyZSBJbXBvcnRhbmNlIiwNCiAgICAgICB4ID0gTlVMTCwgeSA9IE5VTEwpDQoNCmBgYA0KDQpXZSBzZWUgdGhhdCBgcm9vbV90eXBlYCBhbmQgdGhlIGdlb2dyYXBoaWNhbCBpbmZvcm1hdGlvbiB3aWxsIGJlIHZlcnkgaW1wb3J0YW50IGZvciB0aGlzIG1vZGVsLg0KDQojIyBUdW5pbmcgQ2F0Ym9vc3QNCg0KTm93IHRoYXQgd2UgaGF2ZSBzb21lIGNvbmZpZGVuY2UgdGhhdCB0aGUgZmVhdHVyZXMgaGF2ZSBwcmVkaWN0aXZlIHBvd2VyLCBsZXRzIHR1bmUgdXAgYSBzZXQgb2YgYGNhdGJvb3N0YCBtb2RlbHMuIA0KDQpgYGB7ciBjYXRib29zdF90dW5pbmdfcGFyYW1zfQ0KDQpjYXRib29zdF9wYXJhbXMgPC0NCiAgZGlhbHM6OnBhcmFtZXRlcnMobWluX24oKSwgIyBtaW4gZGF0YSBpbiBsZWFmDQogICAgICAgICAgICAgICAgICAgIHRyZWVfZGVwdGgocmFuZ2UgPSBjKDQsIDE1KSksDQogICAgICAgICAgICAgICAgICAgIGxlYXJuX3JhdGUocmFuZ2UgPSBjKC0zLCAtMC43KSwgDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgdHJhbnMgPSBsb2cxMF90cmFucygpKQ0KICAgICAgICAgICAgICAgICAgICApDQogICAgICAgICAgICAgICAgICAgIA0KY2JzdF9ncmlkIDwtIGRpYWxzOjpncmlkX21heF9lbnRyb3B5KGNhdGJvb3N0X3BhcmFtcywNCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBzaXplID0gNDAgDQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgKQ0KY2JzdF9ncmlkDQpgYGANCg0KYGBge3IgY2F0Ym9vc3RfdHVuaW5nX25vX2V2YWwsIGV2YWw9RkFMU0V9DQpjdl9yZXNfY2F0Ym9vc3QgPC0NCiAgd29ya2Zsb3coKSAlPiUgDQogIGFkZF9yZWNpcGUoYmFzaWNfcmVjKSAlPiUgDQogIGFkZF9tb2RlbChjYXRib29zdF9zcGVjKSAlPiUgDQogIHR1bmVfZ3JpZCggICAgDQogICAgcmVzYW1wbGVzID0gdHJhaW5fZm9sZHMsDQogICAgZ3JpZCA9IGNic3RfZ3JpZCwNCiAgICBjb250cm9sID0gY29udHJvbF9yYWNlKHZlcmJvc2UgPSBGQUxTRSwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgIHNhdmVfcHJlZCA9IFRSVUUsIA0KICAgICAgICAgICAgICAgICAgICAgICAgICAgc2F2ZV93b3JrZmxvdyA9IFRSVUUsDQogICAgICAgICAgICAgICAgICAgICAgICAgICBleHRyYWN0ID0gZXh0cmFjdF9tb2RlbCwNCiAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsX292ZXIgPSAicmVzYW1wbGVzIiksDQogICAgbWV0cmljcyA9IG1zZXQNCikNCmBgYA0KDQpgYGB7ciBjYXRib29zdF90dW5pbmdfbm9faW5jbHVkZSwgaW5jbHVkZT1GQUxTRX0NCmlmIChmaWxlLmV4aXN0cyhoZXJlOjpoZXJlKCJkYXRhIiwiYWlyYm5iY2F0Ym9vc3QucmRzIikpKSB7DQoNCmN2X3Jlc19jYXRib29zdCA8LSByZWFkX3JkcyhoZXJlOjpoZXJlKCJkYXRhIiwiYWlyYm5iY2F0Ym9vc3QucmRzIikpDQogIA0KfSBlbHNlIHsgIA0KY3ZfcmVzX2NhdGJvb3N0IDwtDQogIHdvcmtmbG93KCkgJT4lIA0KICBhZGRfcmVjaXBlKGJhc2ljX3JlYykgJT4lIA0KICBhZGRfbW9kZWwoY2F0Ym9vc3Rfc3BlYykgJT4lIA0KICB0dW5lX2dyaWQoICAgIA0KICAgIHJlc2FtcGxlcyA9IHRyYWluX2ZvbGRzLA0KICAgIGdyaWQgPSBjYnN0X2dyaWQsDQogICAgY29udHJvbCA9IGNvbnRyb2xfcmFjZSh2ZXJib3NlID0gRkFMU0UsDQogICAgICAgICAgICAgICAgICAgICAgICAgICBzYXZlX3ByZWQgPSBUUlVFLCANCiAgICAgICAgICAgICAgICAgICAgICAgICAgIHNhdmVfd29ya2Zsb3cgPSBUUlVFLA0KICAgICAgICAgICAgICAgICAgICAgICAgICAgZXh0cmFjdCA9IGV4dHJhY3RfbW9kZWwsDQogICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbF9vdmVyID0gInJlc2FtcGxlcyIpLA0KICAgIG1ldHJpY3MgPSBtc2V0DQopDQoNCndyaXRlX3Jkcyhjdl9yZXNfY2F0Ym9vc3QsIGhlcmU6OmhlcmUoImRhdGEiLCJhaXJibmJjYXRib29zdC5yZHMiKSkNCn0NCmBgYA0KDQpgYGB7ciBjYXRib29zdF90dW5pbmdfcGVyZm9ybWFuY2V9DQphdXRvcGxvdChjdl9yZXNfY2F0Ym9vc3QpDQoNCnNob3dfYmVzdChjdl9yZXNfY2F0Ym9vc3QpICU+JSANCiAgc2VsZWN0KC0uZXN0aW1hdG9yKQ0KDQpjYXRfd2ZfYmVzdCA8LSAgIA0KICB3b3JrZmxvdygpICU+JSANCiAgYWRkX3JlY2lwZShiYXNpY19yZWMpICU+JSANCiAgYWRkX21vZGVsKGNhdGJvb3N0X3NwZWMpICU+JSANCiAgZmluYWxpemVfd29ya2Zsb3coc2VsZWN0X2Jlc3QoY3ZfcmVzX2NhdGJvb3N0KSkNCg0KY2F0X2ZpdF9iZXN0IDwtIGNhdF93Zl9iZXN0ICU+JQ0KICBwYXJzbmlwOjpmaXQoZGF0YSA9IHRyYWluKQ0KYGBgDQoNCiMgey19DQoNCkNhdGJvb3N0IG1vZGVsIHBlcmZvcm1hbmNlDQoNCmBgYHtyfQ0KcHJlZGljdChjYXRfZml0X2Jlc3QsIG5ld19kYXRhID0gdmFsaWQpICU+JQ0KICBjYmluZCh2YWxpZCkgJT4lDQogIGdncGxvdChhZXMoMTBecHJpY2UgKyAxLCANCiAgICAgICAgICAgICAxMF4ucHJlZCArIDEsIA0KICAgICAgICAgICAgIGNvbG9yID0gbmVpZ2hib3VyaG9vZF9ncm91cCkpICsNCiAgZ2VvbV9hYmxpbmUoDQogICAgc2xvcGUgPSAxLA0KICAgIGx0eSA9IDIsDQogICAgY29sb3IgPSAiZ3JheTUwIiwNCiAgICBhbHBoYSA9IDAuNQ0KICApICsNCiAgZ2VvbV9wb2ludChhbHBoYSA9IDAuOCwgc2hhcGUgPSAyMSkgKw0KICBzY2FsZV94X2xvZzEwKGxhYmVscyA9IHNjYWxlczo6ZG9sbGFyX2Zvcm1hdChhY2N1cmFjeSA9IDEpKSArDQogIHNjYWxlX3lfbG9nMTAobGFiZWxzID0gc2NhbGVzOjpkb2xsYXJfZm9ybWF0KGFjY3VyYWN5ID0gMSkpICsNCiAgbGFicyhjb2xvciA9IE5VTEwsIA0KICAgICAgIHggPSAiVHJ1ZSBwcmljZSIsIA0KICAgICAgIHkgPSAiUHJlZGljdGVkIHByaWNlIikNCg0KcHJlZGljdChjYXRfZml0X2Jlc3QsIG5ld19kYXRhID0gdmFsaWQpICU+JQ0KICBjYmluZCh2YWxpZCkgJT4lDQogIHJtc2xlKDEwXnByaWNlIC0gMSwgMTBeLnByZWQgLSAxKQ0KDQpgYGANCg0KVGhpcyBjYXRib29zdCBmaWd1cmUgaXMgc29tZXdoYXQgYmV0dGVyIHRoYW4gdGhlIGxlYWRlcmJvYXJkIFJNU0xFIG9mIDAuNDA3NTgsIHNvIGl0IHdvdWxkIGhhdmUgYmVlbiB3b3J0aHkgb2Ygc3VibWlzc2lvbi4NCg0KTGFzdGx5LCB3ZSBidWlsZCB0aGUgc3VibWlzc2lvbiBmaWxlIA0KDQpgYGB7ciwgZXZhbD1GQUxTRX0NCg0KYmluZF9jb2xzKHByZWRpY3QoY2F0X2ZpdF9iZXN0LCB0ZXN0X2RmKSwgdGVzdF9kZikgJT4lIA0KICBzZWxlY3QoaWQsIHByaWNlID0gLnByZWQpICU+JQ0KICB3cml0ZV9jc3YoZmlsZSA9IHBhdGhfZXhwb3J0KQ0KDQpgYGANCg0KYW5kIG1ha2UgdGhlIHN1Ym1pc3Npb24gdG8gdGhlIEthZ2dsZSBib2FyZA0KDQpgYGB7ciwgZXZhbCA9IEZBTFNFfQ0Kc2hlbGwoZ2x1ZTo6Z2x1ZSgna2FnZ2xlIGNvbXBldGl0aW9ucyBzdWJtaXQgLWMgeyBjb21wZXRpdGlvbl9uYW1lIH0gLWYgeyBwYXRoX2V4cG9ydCB9IC1tICJDYXRib29zdGVkIicpKQ0KYGBgDQoNCg0KDQo=