diff options
| author | Lukasz Kasprzak <lukas@labunix.xyz> | 2026-07-30 08:56:34 +0200 |
|---|---|---|
| committer | Lukasz Kasprzak <lukas@labunix.xyz> | 2026-07-30 08:56:34 +0200 |
| commit | d7da4b09f7775276231d0241cfe2700d247728ee (patch) | |
| tree | 4261695c37f457782abea2f3e6cc997921731245 /sources/README.md | |
| parent | bda838b0e5e2882b17af0440d85c2c7e079dd892 (diff) | |
| download | lectio-d7da4b09f7775276231d0241cfe2700d247728ee.tar.gz lectio-d7da4b09f7775276231d0241cfe2700d247728ee.zip | |
sources: store the snapshot as one compressed archive
Replace the ~1600 raw per-provider files (24 MB) with a single solid
sources/snapshot.tar.gz (6 MB); manifest.tsv + README stay uncompressed
for browsing. The extracted per-provider dirs are now git-ignored;
snapshot-sources.sh gains pack/unpack, and the README documents the
unpack -> refresh -> pack cycle. Distribution-ready: one archive, not a
file tree.
Diffstat (limited to 'sources/README.md')
| -rw-r--r-- | sources/README.md | 15 |
1 files changed, 12 insertions, 3 deletions
diff --git a/sources/README.md b/sources/README.md index b177c3d..f746d29 100644 --- a/sources/README.md +++ b/sources/README.md @@ -7,9 +7,18 @@ re-audited offline** if those sites change, move, or disappear — the project's 25-year-longevity aim. Reading references are facts, not creative works; this is a provenance cache, not redistribution of anyone's edition. -Refresh or extend with `sh scripts/snapshot-sources.sh [provider ...]` -(idempotent: existing non-empty files are skipped). Every file is recorded in -`manifest.tsv` (path, url, sha256, bytes). First archived **2026-07-29**. +The data ships as a single compressed archive, **`sources/snapshot.tar.gz`** +(~6 MB); `manifest.tsv` (path, url, sha256, bytes) and this README stay +uncompressed for browsing. First archived **2026-07-29**. + +```sh +# unpack the archived data (into git-ignored per-provider dirs): +sh scripts/snapshot-sources.sh unpack # or: tar xzf sources/snapshot.tar.gz -C sources +# refresh/extend from the live sites (idempotent — skips files already present): +sh scripts/snapshot-sources.sh # all four providers +# re-roll the archive after refreshing: +sh scripts/snapshot-sources.sh pack # or: tar czf sources/snapshot.tar.gz -C sources <dirs> +``` ## What's here |