TSDP 3.2.6 is a Windows desktop application for downloading and processing astronomical FITS data. It supports multi-HDU inputs, WCS-aware mosaics, normalization, alignment, previews, recovery, and optional Telegram control.
Run TSDP-Setup-3.2.6.exe. The installer uses the current Windows account, supports installing over a previous version, creates Start menu shortcuts, and can optionally create a desktop shortcut. Python is not required for the installed application.
A portable ZIP is also provided. Extract the entire folder before running TSDP.exe; do not run the executable from inside the ZIP.
On the first launch, the setup assistant checks folders, dependencies, available memory and disk space, aria2, and optional integrations. The same checks remain available from Check Setup and from Settings. The bundled aria2c.exe enables managed downloads out of the box.
Use Python 3.10 or newer:
cd C:\Users\egeme\Downloads\tsdp
python -m pip install -e ".[all,dev]"
python TSDP2.pyThe normal workflow is Download & Process -> Mosaic -> Align & Composite. Recovery can resume or repair interrupted disk-backed mosaic work. Large reprojections use float32 memmaps, resource-adaptive workers, disk preflight checks, chunked calculations, and cancellation checks rather than forcing complete detector frames into RAM.
Before a mosaic starts, TSDP shows estimated peak working memory, final-product size, scratch-disk use, and free space. Disk-backed Turbo worker counts are not limited to three: they adapt to the requested value, tile count, CPU threads, geometry, and currently available RAM.
Every organized processing run receives an isolated, collision-safe job folder. Directories are created only when needed:
Job_Name/
|-- final/{aligned,mosaics,normalized}/<filter>/
|-- previews/{png,jpeg}/
|-- diagnostics/{footprints,coverage_maps,masks,seam_maps,weight_maps,rejected_frames}/
|-- intermediate/{reprojected,cropped,normalized,temporary_fits,memmaps}/
|-- recovery/{manifests,checkpoints}/
|-- metadata/{logs,reports,file_lists}/
`-- job_manifest.json
Final FITS products are never removed with intermediates. Existing flat folders are not moved, renamed, or deleted; a newly numbered job folder is created by default. The manifest uses relative product paths so jobs can be moved safely.
Configure the chat ID and notification choices in Settings. Tokens are read from Windows Credential Manager through keyring, or from JWST_SUITE_TELEGRAM_TOKEN. Legacy plaintext tokens are migrated out of the JSON settings file atomically. Token values and token-bearing Telegram URLs are redacted from logs and excluded from job manifests.
The existing command set is preserved, including guided /newjob, /status, /rerun, /stop, reference selection, output/previews/FITS/log delivery, ZIP delivery, CSV upload, blink GIFs, cleanup, and /flush.
tsdp2/astronomy: FITS, WCS, normalization, coverage, mosaic, and seam algorithmstsdp2/downloads: aria2, queue, MAST import, and post-download servicestsdp2/telegram: client, parser, listener, orchestration, and output deliverytsdp2/recovery: manifests, cleanup, repair, and recovery UItsdp2/ui: focused tabs, dialogs, onboarding, installation check, and Abouttsdp2/utilities: resource planning, release checks, and Tk dispatchtsdp2/product.py,config.py,output_paths.py,logging_config.py, andmodels.py: shared infrastructure
TSDP2.py is a small launcher. Runtime monkey-patching is not used.
Tests use synthetic offline data:
python -m pytest -qBuild the portable app and installer with:
powershell -ExecutionPolicy Bypass -File packaging\build_release.ps1Release artifacts and SHA-256 hashes are written to release/. The release build also supports a non-GUI packaged FITS/WCS/reprojection smoke check.
The Windows distribution bundles aria2 1.37.0 and its COPYING file. aria2 remains covered by its own license. TSDP's Python astronomy and UI dependencies are included in the packaged application.
DECam optical bands (u, g, r, i, z, Y), descriptive FITS filter headers, and names such as g.fits, field_r_001.fits, and z.fits.fz are recognized. Headers take precedence over filenames, and custom FILTER names are retained. Truly unlabelled inputs remain separate UNKNOWN groups and can be assigned with the Mosaic tab's group rename/move controls.
The Mosaic tab enables Auto (safe RAM) by default. It selects per-group worker limits from CPU capacity and currently available RAM, leaves two CPU threads free, and budgets at most 60% of free memory for processing. Disable Auto to use the manual thread limit; memory limits still apply. Full-resolution mosaics use float32 blocks and reusable feather-blend workspaces. GPU acceleration is not used.
The WCS coverage window includes an output scale control and live output dimensions for each selected filter. Resize, move, or rotate an area to update its width x height in output pixels. Scale changes are synchronized with the Mosaic tab; per-filter scale overrides continue to apply and each readout shows its effective scale.
SkyView cutouts use a bounded HTTPS FITS request. If the service is unavailable, a celestial WCS grid keeps selection and size estimation usable offline. A ten-percent coverage overlay is composited once per filter, so repeated frames do not hide the background.
Mosaics automatically use robust overlap matching: spatial median cells reject star/cosmic-ray residuals, then a joint sparse fit estimates relative additive sky offsets and gradients. This replaces whole-tile histogram matching, which could mistake a galaxy for background. Mean, median and feather modes use the same model in RAM and on disk. No photometric gain is applied. One reference plane is retained per connected component; a common gradient cannot be measured from overlap differences alone.
For Fast Draft, Source-masked draft sky normalization additionally estimates sky planes from each detector's clipped spatial cells before blending. This reduces steps across detector gaps. Disable it for an overlap-only draft when extended emission fills the detectors: a sky model cannot distinguish that emission from illumination without an external reference. Full-resolution science mosaics retain overlap-only matching; cosmetic cleaned copies are separate outputs. See normalization validation.
Every Mosaic-tab run, including Fast Draft, checks its output automatically before the cleaned copy is generated. The scan includes single-pixel NaN/Inf holes and joins components across scan strips. Enclosed holes are repaired from valid original pixels, matched to the surrounding background. Exterior no-data areas and valid dark/zero-valued astronomical pixels are preserved. After source-backed repair, drafts can cosmetically interpolate remaining enclosed gaps. This is enabled by default and writes an interpolation mask; turn off Fill remaining draft holes cosmetically to retain visible gaps. Full-resolution science data is not cosmetically filled.
The completion status reports recovered and remaining pixels. Organized jobs
save JSON reports in diagnostics/quality; flat outputs receive a neighboring
*_quality.json. FITS headers include AUTOCHK, FIXPIX, and HOLEPIX.
Coverage and relative-weight maps are updated only for measured source recovery. Cosmetic fills retain zero measured coverage, are marked by COSMFILL/COSMPIX, and have a separate *_interpolated_mask.fits (or organized diagnostics mask). Reports distinguish measured recovery from cosmetic interpolation.
To bound repair work, one automatic pass retains up to 2,000 regions and
repairs context rectangles of at most two million pixels; deferred regions
are counted in the quality report. Cancellation preserves the existing image.
Native DECam saturation thresholds exclude known saturated samples. Bright star charge trails below those thresholds need supplied bleed-trail masks or clean overlapping exposures; the app does not erase bright lines by guessing. See NOIRLab's DECam saturation description.
Draft sky normalization and the separate high-resolution normalized copy now apply a full-field source-masked model after the relative overlap stage. This removes broad illumination and remaining detector pedestals, including areas that do not have overlapping exposures, and sets each band's visual sky to zero. Multiscale structure masks stars and resolved sources; clipped sky cells interpolate beneath them. A source-free local median surface follows background discontinuities. Pixel values retain their original linear flux scale: this is additive sky subtraction, without multiplicative gain fitting.
The global stage runs before cosmetic draft hole filling. Raw science mosaics
and original input FITS are preserved. The high-resolution normalized copy is
a visual background-subtracted product, not an absolute sky calibration.
Very faint diffuse emission can be confused with background without a supplied
source mask or an external sky reference; use the original science output for
measurements. FITS flags BGCLMETH, BGSRCFR, BGSKY0, and BGCLSTR describe
the operation, and quality JSON includes its model summary.
Analysis is capped at 500,000 sample pixels; full-resolution application is streamed in row blocks. See global normalization validation.