version 6.0

• Expands the data to 2023 but now it starts from 1988 (the year when the Harmonized System was first implemented). The previous version covered 1980-2021.
• Uses the most recent HS revision (HS2022) covering over 8,000 products.
• I converted all the data from the original SITC/HS reported revisions to HS2022.
• The new UN Comtrade Plus includes HS codes in an “incremental” way. The data is reported and when some countries report in HS20xx after 20xx they still use the previous revisions to include specific products not present in the revision they declare (e.g., the HS code for blood transfusion products is not in the HS17 but the code is inherited from HS12).
• I changed the API to minimize the need for joins, therefore the data downloading is much faster. The downside to this is that the data now comes with extra columns by default (chapter and section name/code), which you can ignore or drop if you do not need them.

version 5.0

• Expands data to 1980-2021 (previously it covered 2002-2020).
• All the data was converted to HS12 from the original SITC2, HS92, HS02, HS07 and HS12 sources.

version 4.5

• Reflects changes in the API and therefore reads JSON data.
• Continues to use data.table for the internals and tibble to display the results nicely.
• Future versions will only use tibble but that would require effort.

version 4.2

Updates * Adds dyadic distances table (ots_distances) for gravity modelling

Breaking changes * The API now returns Parquet files instead of JSON for all the cases (except for available years and tables) * All the tests were adapted to reflect changes in the DB (i.e., the test “multiple country match = error” no longer returns an error because there are no two codes for Germany in 2002-2020) * The command use_localhost was removed because the Shiny app now connects directly to PostgreSQL (i.e., this saves resources) * The column EU-28 member was removed from the countries table (i.e., avoid UK confusion after Brexit)

version 4.1

Updates * Uses GDP deflator to convert dollars from one year to another (previously it used reported inflation) Breaking changes * New port for local instance (8080 -> 4949)

version 4.0

Updates * Provides ysrpc table to visualize products, replacing yc tables. * The new default option is to download imputed data, as there is no direct API access to raw data. * A new method to correct import/exports mismatches was applied and the datasets now start from 1980 until I test enough the model results for older years. * Drops yr-sections and yr-groups tables * Drops ‘group’ columns in the final data (and replaces it for ‘section’ columns) * Allows to access both raw and imputed data from the API * Allows to search for special codes in the API (i.e., e-490 and other codes) * All these changes have resulted in large speedups with both data downloading and the Open Trade Statistics dashboard

Breaking changes * Most of the tables in the API were renamed, as now I made available an imputation method to remove transportation costs (and correct mismatching flows)

version 3.0.3

Minor fixes * Adds attributes to parquet tables (i.e., it now does the joins to add product name, section color, etc.)

Updates * Uses “_name” instead of “_fullname_english” in final tables colnames

version 3.0.2

Updates * Allows to obtain tables in Parquet format from the API, giving a speed-up of ~50% for the final user. * Uses tibble instead of DT to produce lighter vignettes

version 3.0.1

Updates * Adds section colors data for visualization, this is taken from the palette used in shiny.tradestatistics.io

Version 3.0

Updates * Removes all references to tables using communities or short names (both unofficial), reflecting changes in the API * The functionality remains the same, but now the end user functions don’t add a 21-colors palette to the data (i.e. see the data section)

Data

• Switches from HS92 to HS12 to reflect product changes with less aggregation
• Drops any data from Harvard (communities and short product names) as these depend on using HS92 4 digits, therefore the color palettes were removed as these depended on the communities table
• The inflation data was trimmed to a window since the year 2000
• The commodities data now contains information for +5000 products instead of +1200 as the aggregation level changed in the API
• Adds RTAs and MFN tariffs for gravity modelling

Version 2.0

Updates

• Uses ISO codes as is (affects Aruba, Roumania, Timor-Leste, Antarctica, Saint Barthelemy, Curacao, Sint Maarten and South Sudan)

Version 1.0

Updates

• Reflects API changes with less aggregated data
• Follows UN COMTRADE notation (i.e. commodity instead of product)
• Does not impute data before hand, which is better for most of gravity models use cases
• Provides the data exactly as in the API, returning commodity level data to allow users to do their own aggregation
• Does not drop reference year with inflation adjustment (https://github.com/ropensci/tradestatistics/issues/38)
• Takes max and min available years from the API instead of hardcoded values (https://github.com/ropensci/tradestatistics/pull/39)

Version 0.4.0

Updates

• Includes yrpc-ga, yrpc-sa, yrc-ga and yr-sa tables reflecting API updates
• Simplifies end-user functions a bit (i.e. removes include_groups option)
• Optimizes the code a bit, specially at the joins with tables in the package
• Fixes codes duplication when both product and group/community match for a search
• Includes both official and shortened section names

Version 0.3.1

Updates

• Removes yrp_short option reflecting last DB changes

Version 0.3

Updates

• Much improved coverage to detect almost any possible error
• Fixes case in inflation adjustment when year = reference year

Version 0.2.8

Updates

• Adds caching (in memory or on disk) option (partial contributions from
• Includes forwards and backwards testing for inflation adjustment
• Testing for in memory caching

Version 0.2.7

Updates

• Adds feedback provided by @danidlsa
• Now ots_create_tidy_data() has both reporter and partner set to “all” by default

Version 0.2.5

Updates

• Added dependency on R >= 3.5.0 because serialized objects in serialize/load version 3 cannot be read in older versions of R
• Minimal changes in ots_create_tidy_data() to allow multiple countries as arguments, in line with API changes from September 2019

Version 0.2.4

Updates

• Removes product_code_length
• The API was updated with simplified parameters and 2018 data

Version 0.2.3

Updates

• Fixtures for testthat evaluation

Fixes

• Specific Windows error during check

Version 0.2.2

Adds

• Inflation data
• Inflation adjustment function
• Minor changes in vignettes

Version 0.2.1

Fixes

• Consistent use of colour vs color, color is used from now
• Fixed available tables description
• Adds yrp_short to available tables
• Adds use_localhost option for our own server or users who want to clone the database locally, therefore avoid having a separate branh for server installation