# 5. Matching different data sources

One common task when working with spatio-temporal data is to match nearby sites. For example, we may want to verify the location of an old list of stations with current stations, or we may want to match the data from different data sources. In this vignette, we will introduce the spatial and temporal matching in cubble using an example on matching river level data with precipitation in Victoria, Australia.

In cubble, spatial and temporal matching are performed using the functions `match_spatial()` and `match_temporal()`. The `match_spatial()` function calculates the spatial distance between observations in two cubble objects. Various distance measures are available (check `sf::st_distance`). Analysts can specify the number of matched groups to output using the `spatial_n_group` argument (default to 4 groups) and the number of matches per group using the `spatial_n_group` argument (default to 1, one-to-one matching). The syntax to use `match_spatial()` is:

    match_spatial(<cubble_obj1>, <cubble_obj2>, ...)

The function `match_temporal()` calculates the similarity between time series within spatially matched groups. Two identifiers are required: one for separating each matched group (`match_id`) and one for separating the two data sources (`data_id`). The argument `temporal_by` uses the `by` syntax from dplyr’s `*_join` to specify the temporal variables to match.

The similarity score between two time series is calculated using a matching function, which can be customised by the analysts. The matching function takes two time series as a list and returns a single numerical score. This allows for flexibility in using existing time series distance calculation implementation. By default, cubble implements a simple peak matching algorithm (`match_peak`) that counts the number of peaks in two time series that fall within a specified temporal window. The syntax to use `match_temporal()` is

    match_temporal(
      <cubble_obj_from_match_spatial>,
      data_id = , match_id = ,
      temporal_by = c("..." = "...")
    )

# Spatial matching

Now let’s consider an example of matching water data from river gauges with precipitation. The [water level data]((http://www.bom.gov.au/metadata/catalogue/19115/ANZCW0503900528?template=full), collected by the Bureau of Meteorology, can be compared with the precipitation since rainfall can directly impact water level in river. Here is the location of available weather stations and water gauges in Victoria, Australia:

Both `climate_vic` and `river` are cubble objects, and we can obtain a summary of the 10 closest pairs between them:

    (res_sp <- match_spatial(climate_vic, river, spatial_n_group = 10))
    #> # A tibble: 10 × 4
    #>    from        to      dist group
    #>    <chr>       <chr>    [m] <int>
    #>  1 ASN00088051 406213 1838.     1
    #>  2 ASN00084145 222201 2185.     2
    #>  3 ASN00085072 226027 3282.     3
    #>  4 ASN00080015 406704 4034.     4
    #>  5 ASN00085298 226027 4207.     5
    #>  6 ASN00082042 405234 6153.     6
    #>  7 ASN00086038 230200 6167.     7
    #>  8 ASN00086282 230200 6928.     8
    #>  9 ASN00085279 224217 7431.     9
    #> 10 ASN00080091 406756 7460.    10

The result can also be returned as cubble objects by setting the argument `return_cubble = TRUE`. The output is be a list where each element is a paired cubble object. To combine all the results into a single cubble, you can use `bind_rows()`. In the case when a site in the second cubble (the `river` data here) is matched to two stations in the first cubble (`climate_vic` here), the binding may not be successful since cubble requires unique rows in the nested form. In the summary table above, the river station `226027` is matched to more than one weather station: `ASN00085072` (group 3) and `ASN00085298` (group 5). Similarly, the river station `230200` is matched in group 7 and 8). In such cases, you can either deselect one pair before combining, or work with the list output with the `purrr::map` syntax:

    res_sp <- match_spatial(climate_vic, river, spatial_n_group = 10, return_cubble = TRUE)
    str(res_sp, max.level = 0)
    #> List of 10
    res_sp[[1]]
    #> # cubble:   key: id [2], index: date, nested form, [sf]
    #> # spatial:  [144.5203, -37.0194, 144.540295, -37.015122], WGS 84
    #> # temporal: date [date], prcp [dbl], tmax [dbl], tmin [dbl]
    #>   id      long   lat  elev name  wmo_id ts       type              geometry
    #>   <chr>  <dbl> <dbl> <dbl> <chr>  <dbl> <list>   <chr>          <POINT [°]>
    #> 1 ASN00…  145. -37.0   290 rede…  94859 <tibble> clim…  (144.5203 -37.0194)
    #> 2 406213  145. -37.0    NA CAMP…     NA <tibble> river (144.5403 -37.01512)
    #> # ℹ 2 more variables: group <int>, dist [m]
    (res_sp <- res_sp[-c(5, 8)] %>% bind_rows())
    #> # cubble:   key: id [16], index: date, nested form, [sf]
    #> # spatial:  [144.5203, -38.144913, 148.4667, -36.128657], WGS 84
    #> # temporal: date [date], prcp [dbl], tmax [dbl], tmin [dbl]
    #>    id     long   lat  elev name  wmo_id ts       type              geometry
    #>    <chr> <dbl> <dbl> <dbl> <chr>  <dbl> <list>   <chr>          <POINT [°]>
    #>  1 ASN0…  145. -37.0 290   rede…  94859 <tibble> clim…  (144.5203 -37.0194)
    #>  2 4062…  145. -37.0  NA   CAMP…     NA <tibble> river (144.5403 -37.01512)
    #>  3 ASN0…  148. -37.7  62.7 orbo…  95918 <tibble> clim…  (148.4667 -37.6922)
    #>  4 2222…  148. -37.7  NA   SNOW…     NA <tibble> river  (148.451 -37.70739)
    #>  5 ASN0…  147. -38.1   4.6 east…  94907 <tibble> clim…  (147.1322 -38.1156)
    #>  6 2260…  147. -38.1  NA   LA T…     NA <tibble> river (147.1278 -38.14491)
    #>  7 ASN0…  145. -36.2  96   echu…  94861 <tibble> clim…  (144.7642 -36.1647)
    #>  8 4067…  145. -36.1  NA   DEAK…     NA <tibble> river (144.7693 -36.12866)
    #>  9 ASN0…  146. -36.8 502   stra…  95843 <tibble> clim…  (145.7308 -36.8472)
    #> 10 4052…  146. -36.9  NA   SEVE…     NA <tibble> river (145.6828 -36.88701)
    #> 11 ASN0…  145. -37.7  78.4 esse…  95866 <tibble> clim…  (144.9066 -37.7276)
    #> 12 2302…  145. -37.7  NA   MARI…     NA <tibble> river (144.8365 -37.72771)
    #> 13 ASN0…  148. -37.9  49.4 bair…  94912 <tibble> clim…  (147.5669 -37.8817)
    #> 14 2242…  148. -37.8  NA   MITC…     NA <tibble> river   (147.5722 -37.815)
    #> 15 ASN0…  145. -36.3 105   kyab…  95833 <tibble> clim…   (145.0638 -36.335)
    #> 16 4067…  145. -36.3  NA   MOSQ…     NA <tibble> river (144.9809 -36.32871)
    #> # ℹ 2 more variables: group <int>, dist [m]

# Temporal matching

For temporal matching, we match the variable `Water_course_level` from the river data to `prcp` in the weather station data. The variable `group` and `types` identify the matching group and the two datasets:

    (res_tm <- res_sp %>%
      match_temporal(
        data_id = type, match_id = group,
        temporal_by = c("prcp" = "Water_course_level")))
    #> # A tibble: 8 × 2
    #>   group match_res
    #>   <int>     <dbl>
    #> 1     1        30
    #> 2     2         5
    #> 3     3        14
    #> 4     4        20
    #> 5     6        23
    #> 6     7        26
    #> 7     9        21
    #> 8    10        14

Similarly, the cubble output can be returned using the argument `return_cubble = TRUE`. Here we select the four pairs with the highest number of matching peaks:

    res_tm <- res_sp %>%
      match_temporal(
        data_id = type, match_id = group,
        temporal_by = c("prcp" = "Water_course_level"),
        return_cubble = TRUE)
    (res_tm <- res_tm %>% bind_rows() %>% filter(group %in% c(1, 7, 6, 9)))
    #> # cubble:   key: id [8], index: date, nested form, [sf]
    #> # spatial:  [144.5203, -37.8817, 147.572223, -36.8472], WGS 84
    #> # temporal: date [date], matched [dbl]
    #>   id         long   lat  elev name  wmo_id type              geometry group
    #>   <chr>     <dbl> <dbl> <dbl> <chr>  <dbl> <chr>          <POINT [°]> <int>
    #> 1 ASN00088…  145. -37.0 290   rede…  94859 clim…  (144.5203 -37.0194)     1
    #> 2 406213     145. -37.0  NA   CAMP…     NA river (144.5403 -37.01512)     1
    #> 3 ASN00082…  146. -36.8 502   stra…  95843 clim…  (145.7308 -36.8472)     6
    #> 4 405234     146. -36.9  NA   SEVE…     NA river (145.6828 -36.88701)     6
    #> 5 ASN00086…  145. -37.7  78.4 esse…  95866 clim…  (144.9066 -37.7276)     7
    #> 6 230200     145. -37.7  NA   MARI…     NA river (144.8365 -37.72771)     7
    #> 7 ASN00085…  148. -37.9  49.4 bair…  94912 clim…  (147.5669 -37.8817)     9
    #> 8 224217     148. -37.8  NA   MITC…     NA river   (147.5722 -37.815)     9
    #> # ℹ 3 more variables: dist [m], ts <list>, match_res <dbl>

And then we can visualise them in space or across time: