Recomputes sha256 byte and shape checksums for every file declared
in the bundle's provenance: block and compares against the
recorded values. Returns a tibble of expected vs observed; flags
drift on each axis separately.
Arguments
- cfg
An
lnk_configobject fromlnk_config().- strict
Logical. When
TRUE, errors if any file has drifted on either axis. DefaultFALSEwarns and returns the tibble for inspection.
Value
A tibble with columns:
file— path relative tocfg$dirbyte_expected— byte checksum recorded in the manifestbyte_observed— byte checksum recomputed from the current filebyte_drift— logical,TRUEwhen byte checksums differshape_expected— shape checksum recorded in the manifest, orNAwhen the manifest has noshape_checksumfieldshape_observed— shape checksum recomputed from the current file's header lineshape_drift— logical,TRUEwhen shape checksums differ (and the manifest had ashape_expectedto compare against)missing— logical,TRUEwhen the file no longer exists on disk (observed values areNA)
The tibble carries one row per provenanced file. When the bundle
has no provenance: block (cfg$provenance is NULL) returns
an empty tibble with the same columns.
Details
Byte drift (byte_drift) — file content changed (rows
added/edited/removed, or whole-file re-shape). Detected via sha256
of the full file. Catches every kind of change but doesn't tell you
WHAT kind.
Shape drift (shape_drift) — file's header changed (column
added / renamed / removed / reshaped). Detected via sha256 of the
first line of the file (whitespace-normalized). A pure-value
change (rows added with no column change) shows byte_drift = TRUE
but shape_drift = FALSE. A column rename shows both TRUE.
Header-only fingerprint catches the dominant failure mode (column
structure change); type changes within stable columns are not
detected — they require value-level inspection that's out of scope
here.
Use this at run time to detect silent drift — a file that was
edited without re-recording its checksum, or an external CSV that
was re-synced under the same path. Drift between two pipeline runs
on the same DB state with the same package versions almost always
traces back to a config-file edit; lnk_config_verify() is the
fastest way to localize the change.
Examples
cfg <- lnk_config("bcfishpass")
verify <- lnk_config_verify(cfg)
verify
#> file
#> 1 presence_groups.csv
#> 2 rules.yaml
#> 3 dimensions.csv
#> 4 parameters_fresh.csv
#> 5 parameters_habitat_thresholds.csv
#> 6 parameters_habitat_method.csv
#> 7 overrides/user_habitat_classification.csv
#> 8 overrides/observation_exclusions.csv
#> 9 overrides/wsg_species_presence.csv
#> 10 overrides/wsg_species_presence_overlay.csv
#> 11 overrides/user_modelled_crossing_fixes.csv
#> 12 overrides/user_pscis_barrier_status.csv
#> 13 overrides/pscis_modelledcrossings_streams_xref.csv
#> 14 overrides/user_barriers_definite.csv
#> 15 overrides/user_barriers_definite_control.csv
#> 16 overrides/user_crossings_misc.csv
#> 17 overrides/cabd_additions.csv
#> 18 overrides/cabd_blkey_xref.csv
#> 19 overrides/cabd_exclusions.csv
#> 20 overrides/cabd_passability_status_updates.csv
#> 21 overrides/dfo_known_sockeye_lakes.csv
#> 22 overrides/wcrp_watersheds.csv
#> byte_expected
#> 1 sha256:966209116a44bd072cb4ebf1ffbea1fe514c208bae2bb09ce12d257020130a18
#> 2 sha256:e9b9ea721ac24e33ada3e2972ec789b6a00c7ef441b4ad269f76a4a3f6d2b6f7
#> 3 sha256:a48aadd609e2c5dd49501ed23f61bdf85386a41359a7a100394b648f04ffb496
#> 4 sha256:12511bf355e3cb545555cf30d4d838ec407eabc5e2293082498d179d52a6bec1
#> 5 sha256:0220ade85955bb29a1b1c898b4414ebf2143ab667917867fc8d3d2777f984aab
#> 6 sha256:9802bb71bdd7f7d296e917d138567f096a69dab12dbc7c0f331e55206e5f6a0a
#> 7 sha256:80b69d0954563660c13bc481b2e955000748e0597d4e10ce0c16462d9a5df966
#> 8 sha256:ad901c57ca42e71e4affffd6e583045a2ce423f15088c211c9c2f72976f5d36a
#> 9 sha256:2ea57578dbc5836d0e24ea6468534f081c7f5f37c72534ca2e3c0f06a6be4c18
#> 10 sha256:841e8780a1cba082be7ef32e98c9536a64f429f4fbf04f6944a60e65e13bfd14
#> 11 sha256:d5c84fb00906acae110249c2976907860b829d4430e43ffaf2671e02e8e40037
#> 12 sha256:66c11defba1a1cab36adb56b395536279d83e481bcb948f93fb04db580753027
#> 13 sha256:cd9202d46904fac2865acff36be1b4d104c299f3b803bde6993d537e8bc03ead
#> 14 sha256:56c66cddf279a1c2b0c0be1fc9ba9c758dc93d4ad820e0bf2c5caf4ecce05fb6
#> 15 sha256:8f34e2c006733e0f06248a90dc0b8abe4719880590f497581f80fe5f62fde203
#> 16 sha256:e569fdfcf8c98eb0c7928b52a3de894a3c46e2599cafb04e746d4f858dffc711
#> 17 sha256:75022b62d83d8a3dafd3d19e7cc8871948818e4b75e84af8e775b1199786e930
#> 18 sha256:3f55fcf2726fdc9aa2bb2b5bb3d22f989bc29d5aab971e82de8d4d432744a2dc
#> 19 sha256:fa22681c9dd0a881b4a4ba7f03c46cee20393faf0d77ce3bc30f759772e8efa6
#> 20 sha256:671793805fe2f4ec30a2844bd12db648b3e04e059d40470a1e01177349c6a00b
#> 21 sha256:4a8d7d1a3a3697d1536c5463364805916077aa171bd1e4d19fc8a9e2250979f7
#> 22 sha256:52c7544b5bc9a033e2c50fe39f41b722598700cb2faa8655ca07010f342f21f8
#> byte_observed
#> 1 sha256:966209116a44bd072cb4ebf1ffbea1fe514c208bae2bb09ce12d257020130a18
#> 2 sha256:e9b9ea721ac24e33ada3e2972ec789b6a00c7ef441b4ad269f76a4a3f6d2b6f7
#> 3 sha256:a48aadd609e2c5dd49501ed23f61bdf85386a41359a7a100394b648f04ffb496
#> 4 sha256:12511bf355e3cb545555cf30d4d838ec407eabc5e2293082498d179d52a6bec1
#> 5 sha256:0220ade85955bb29a1b1c898b4414ebf2143ab667917867fc8d3d2777f984aab
#> 6 sha256:9802bb71bdd7f7d296e917d138567f096a69dab12dbc7c0f331e55206e5f6a0a
#> 7 sha256:80b69d0954563660c13bc481b2e955000748e0597d4e10ce0c16462d9a5df966
#> 8 sha256:ad901c57ca42e71e4affffd6e583045a2ce423f15088c211c9c2f72976f5d36a
#> 9 sha256:2ea57578dbc5836d0e24ea6468534f081c7f5f37c72534ca2e3c0f06a6be4c18
#> 10 sha256:841e8780a1cba082be7ef32e98c9536a64f429f4fbf04f6944a60e65e13bfd14
#> 11 sha256:d5c84fb00906acae110249c2976907860b829d4430e43ffaf2671e02e8e40037
#> 12 sha256:66c11defba1a1cab36adb56b395536279d83e481bcb948f93fb04db580753027
#> 13 sha256:cd9202d46904fac2865acff36be1b4d104c299f3b803bde6993d537e8bc03ead
#> 14 sha256:56c66cddf279a1c2b0c0be1fc9ba9c758dc93d4ad820e0bf2c5caf4ecce05fb6
#> 15 sha256:8f34e2c006733e0f06248a90dc0b8abe4719880590f497581f80fe5f62fde203
#> 16 sha256:e569fdfcf8c98eb0c7928b52a3de894a3c46e2599cafb04e746d4f858dffc711
#> 17 sha256:75022b62d83d8a3dafd3d19e7cc8871948818e4b75e84af8e775b1199786e930
#> 18 sha256:3f55fcf2726fdc9aa2bb2b5bb3d22f989bc29d5aab971e82de8d4d432744a2dc
#> 19 sha256:fa22681c9dd0a881b4a4ba7f03c46cee20393faf0d77ce3bc30f759772e8efa6
#> 20 sha256:671793805fe2f4ec30a2844bd12db648b3e04e059d40470a1e01177349c6a00b
#> 21 sha256:4a8d7d1a3a3697d1536c5463364805916077aa171bd1e4d19fc8a9e2250979f7
#> 22 sha256:52c7544b5bc9a033e2c50fe39f41b722598700cb2faa8655ca07010f342f21f8
#> byte_drift
#> 1 FALSE
#> 2 FALSE
#> 3 FALSE
#> 4 FALSE
#> 5 FALSE
#> 6 FALSE
#> 7 FALSE
#> 8 FALSE
#> 9 FALSE
#> 10 FALSE
#> 11 FALSE
#> 12 FALSE
#> 13 FALSE
#> 14 FALSE
#> 15 FALSE
#> 16 FALSE
#> 17 FALSE
#> 18 FALSE
#> 19 FALSE
#> 20 FALSE
#> 21 FALSE
#> 22 FALSE
#> shape_expected
#> 1 sha256:f26bcf4fdd8096a93bed0c0ddd8f62bb50fe46186d82b121b66a4d5c84ad93e4
#> 2 sha256:4fec0f2db7523d71ba7542e0d52217c91d9bab5b55d714b689f614380f5c2eb9
#> 3 sha256:65b9416981cf2687332a98923d9e4cdfc6800f4d55a85c5d0348c64cafb41155
#> 4 sha256:52dcadd062f584fa7e7828d580fbf6f3dd44261d6a6d37e7b831aa0e0b9be2d3
#> 5 sha256:b837e5dabbce8e69488a1523214bf111827682e4edf87526557231c377fa538e
#> 6 sha256:cf285e3c204249a6b628424979ef780baa271add44cc8ea6512a44d6671a9eb5
#> 7 sha256:35604598f352c0cc958e8330e80627ec65154e4eaba9dbba8cac92c8516706a0
#> 8 sha256:c0c0c5a6e478bae9d98c0251870fb73ef12ec5033de08589bad08ed03be02a31
#> 9 sha256:161bef58151083d80bd226022a46aed5a35a5acd1526dfc3deac42cb6ae952fc
#> 10 sha256:eb72f24aa4e2850578d9ce3feadf0125eb8bd1c95a16215705e8c57dc8aee324
#> 11 sha256:acbddab3bd06ac4790eb129201198e614c1d4c08b83cd18ee94e4cdfafa09ab2
#> 12 sha256:fb611fc77ebbe15429826d7acfe57d487118d7815dea9b2ad5a3f94f03a487e8
#> 13 sha256:c2cebcc7398ddd12d0803eefafbe219f3551e6948051f18d89d7984130c1589d
#> 14 sha256:d39b1ef2a8b3fd26974a3138a3f4e9516a65bddd34e9b50ab65c50a0cbfdc9c1
#> 15 sha256:2a6dd20fd0fe0d9ebc4d54bedafa95054ba3167ac255f98cd2a76dd082800591
#> 16 sha256:463bc63156786be38c39d5479bfe07ce7b593e1174ecba6f7d9e5ac52c2c6bfd
#> 17 sha256:cca1f4ecdd08ae9acfaa968767f2d911ce23115500ea2aa595b393c0e76b2cb9
#> 18 sha256:62169e677bf9a7e50893f2407408a573a8137011e7797685a14d979d27e0d171
#> 19 sha256:6f13d737481c9e94be585861490fe8c35a81cc026875b5e873345e47ec59ad0e
#> 20 sha256:0975cea50456c610de6a229949f2e6d7233613ec57e1aa7dfdb51d05c1216ef8
#> 21 sha256:33ac6f1f2766d6b4d138782b549d4f7156d7fe05485d8f66b4a9a55a431f88cb
#> 22 sha256:2b0eaf185855f06731bfb8f98294a0c7938aef26a5c7265beec167ce0bb46f41
#> shape_observed
#> 1 sha256:f26bcf4fdd8096a93bed0c0ddd8f62bb50fe46186d82b121b66a4d5c84ad93e4
#> 2 sha256:4fec0f2db7523d71ba7542e0d52217c91d9bab5b55d714b689f614380f5c2eb9
#> 3 sha256:65b9416981cf2687332a98923d9e4cdfc6800f4d55a85c5d0348c64cafb41155
#> 4 sha256:52dcadd062f584fa7e7828d580fbf6f3dd44261d6a6d37e7b831aa0e0b9be2d3
#> 5 sha256:b837e5dabbce8e69488a1523214bf111827682e4edf87526557231c377fa538e
#> 6 sha256:cf285e3c204249a6b628424979ef780baa271add44cc8ea6512a44d6671a9eb5
#> 7 sha256:35604598f352c0cc958e8330e80627ec65154e4eaba9dbba8cac92c8516706a0
#> 8 sha256:c0c0c5a6e478bae9d98c0251870fb73ef12ec5033de08589bad08ed03be02a31
#> 9 sha256:161bef58151083d80bd226022a46aed5a35a5acd1526dfc3deac42cb6ae952fc
#> 10 sha256:eb72f24aa4e2850578d9ce3feadf0125eb8bd1c95a16215705e8c57dc8aee324
#> 11 sha256:acbddab3bd06ac4790eb129201198e614c1d4c08b83cd18ee94e4cdfafa09ab2
#> 12 sha256:fb611fc77ebbe15429826d7acfe57d487118d7815dea9b2ad5a3f94f03a487e8
#> 13 sha256:c2cebcc7398ddd12d0803eefafbe219f3551e6948051f18d89d7984130c1589d
#> 14 sha256:d39b1ef2a8b3fd26974a3138a3f4e9516a65bddd34e9b50ab65c50a0cbfdc9c1
#> 15 sha256:2a6dd20fd0fe0d9ebc4d54bedafa95054ba3167ac255f98cd2a76dd082800591
#> 16 sha256:463bc63156786be38c39d5479bfe07ce7b593e1174ecba6f7d9e5ac52c2c6bfd
#> 17 sha256:cca1f4ecdd08ae9acfaa968767f2d911ce23115500ea2aa595b393c0e76b2cb9
#> 18 sha256:62169e677bf9a7e50893f2407408a573a8137011e7797685a14d979d27e0d171
#> 19 sha256:6f13d737481c9e94be585861490fe8c35a81cc026875b5e873345e47ec59ad0e
#> 20 sha256:0975cea50456c610de6a229949f2e6d7233613ec57e1aa7dfdb51d05c1216ef8
#> 21 sha256:33ac6f1f2766d6b4d138782b549d4f7156d7fe05485d8f66b4a9a55a431f88cb
#> 22 sha256:2b0eaf185855f06731bfb8f98294a0c7938aef26a5c7265beec167ce0bb46f41
#> shape_drift missing
#> 1 FALSE FALSE
#> 2 FALSE FALSE
#> 3 FALSE FALSE
#> 4 FALSE FALSE
#> 5 FALSE FALSE
#> 6 FALSE FALSE
#> 7 FALSE FALSE
#> 8 FALSE FALSE
#> 9 FALSE FALSE
#> 10 FALSE FALSE
#> 11 FALSE FALSE
#> 12 FALSE FALSE
#> 13 FALSE FALSE
#> 14 FALSE FALSE
#> 15 FALSE FALSE
#> 16 FALSE FALSE
#> 17 FALSE FALSE
#> 18 FALSE FALSE
#> 19 FALSE FALSE
#> 20 FALSE FALSE
#> 21 FALSE FALSE
#> 22 FALSE FALSE
if (FALSE) { # \dontrun{
# In a verification log: error on either drift kind
lnk_config_verify(cfg, strict = TRUE)
} # }
