gedih3.doctor.diagnoses.soc_health#
soc_health diagnosis — invalid HDF5 files + download log drift.
- Detects:
SOC HDF5 files that fail
h5_is_valid().Download log entries marked DOWNLOADED but with the file missing or empty.
- Remedies (safe):
Mark drifted entries FAILED so the next
gh3_download --resumeretries.Invalid HDF5 files are reported only (could be in-progress); deletion is not auto-applied (see
--delete-invalidfuture flag).
- Performance pillar (v0.8.x lessons backport):
SOC file enumeration always walks the tree in parallel via
gedih3.parallel.walk_soc_parallel(). The legacy_soc_manifest.txtshortcut was removed from the read path because external population (manual rsync, NASA delivery) bypasses the producer-driven refresh and silently narrows the doctor’s view.Per-file
h5_is_validchecks are dispatched in parallel viagedih3.doctor.parallel.parallel_map()when a dask client is registered.
Functions#
|
|
|
Module Contents#
- gedih3.doctor.diagnoses.soc_health.soc_health_check(ctx: gedih3.doctor.report.DoctorContext) gedih3.doctor.report.Report[source]#
- gedih3.doctor.diagnoses.soc_health.soc_health_fix(ctx: gedih3.doctor.report.DoctorContext, report: gedih3.doctor.report.Report) gedih3.doctor.report.Report[source]#