Tickets Addressed in Release 28.0.1

  • DM-47538: Fix seed placement in Gaussian Process generator. [meas_algorithms]

  • DM-48197: Monochromator test failures on jenkins macos-arm64 [cp_pipe]

Tickets Addressed in Release 28.0.0

Tickets merged after w_2024_42 and backported

  • DM-46940: Failed to build docs for ip_isr [ip_isr]

  • DM-47944: Fix calibration summary bug in v28 [daf_butler]

Tickets merged before w_2024_42

  • DM-10454: imageDifference should warn if template and science not in same filter [ip_diffim]

  • DM-21789: Compute uncertainties from MultiProFit GMM Jacobians [meas_extensions_multiprofit]

  • DM-22302: cp_pipe combineHeaders does not construct date endpoints correctly [cp_pipe, obs_lsst]

  • DM-24304: Investigate Kafka compression of the alert stream [ap_association]

  • DM-26658: Clean up FileFormatter vs Formatter hierarchy [atmospec, daf_butler, meas_transiNet, obs_base, obs_cfht, obs_decam, obs_lsst, obs_subaru, pipe_base, pipe_tasks]

  • DM-27275: Use enable_if to disambiguate pixel operators [afw]

  • DM-29176: Create meas_extensions_multiprofit [meas_extensions_multiprofit]

  • DM-29421: Add AP plots in analysis_ap using analysis_tools [analysis_ap]

  • DM-31046: Write a Task for preparing diaSource cutouts for Zooniverse [analysis_ap]

  • DM-31193: Add new PSF chi2/npixels fields to apdb [analysis_ap]

  • DM-31594: Create analysis_ap [analysis_ap]

  • DM-31833: Replace LoadDiaCatalogs with a PipelineTask [ap_association, ap_pipe, ap_verify]

  • DM-33763: Add option to disable tests in sconsUtils [sconsUtils]

  • DM-34048: Add objectTable_tract completeness/purity plots to analysis_tools [analysis_tools, drp_pipe, source_injection]

  • DM-34188: ResourcePath.transfer_from requires extra Google permissions [resources]

  • DM-34627: Move analysis utilities from ap_pipe-notebooks to analysis_ap [analysis_ap]

  • DM-35145: Add ping method to HTCondor plugin [ctrl_bps_htcondor]

  • DM-36457: Finalize RFC-878 and RFC-879 removals [analysis_tools, daf_butler]

  • DM-36739: Test failure in zooniverseCutouts [analysis_ap]

  • DM-36768: Add psf image to alert cutouts [ap_association]

  • DM-36790: Add option to include ancillary information in zooniverseCutouts images [analysis_ap]

  • DM-36808: Add citation metadata to some middleware repos [daf_butler]

  • DM-37145: Redesign APDB connection interface [analysis_ap]

  • DM-37169: allCol option not fully propagated in analysis_ap legacy functions [analysis_ap]

  • DM-37196: Modernize APDB schema to reflect desired usage (decl -> dec) [analysis_ap]

  • DM-37203: Add snr column to srcTables’s reduced default list in legacyApdbUtils.py [analysis_ap]

  • DM-37269: Parallelize cutouts creation in ZooniverseCutouts [analysis_ap]

  • DM-37340: Add pixel scale bar to zooniverseCutouts [analysis_ap]

  • DM-37356: Add spuriousness scores to diaSource cutouts [analysis_ap]

  • DM-37378: Provide helper functions to ease flag filtering of DIASources [analysis_ap]

  • DM-37379: Add a utility for simbad lookup of diaSources [analysis_ap]

  • DM-37388: Add single sourceId/objectId getters to apdbQuery [analysis_ap]

  • DM-37414: Fix load_sources_for_object limit and tests [analysis_ap]

  • DM-37432: Modify cursor execute commands in apdb.py and legacyApdbUtils.py [analysis_ap]

  • DM-37475: Replace connection context managers with sqlalchemy [analysis_ap]

  • DM-37952: Add psfApCorrDelta & psfApFluxDelta metrics to exposure summaries. [afw, analysis_tools, drp_tasks, obs_lsst, pipe_tasks, sdm_schemas]

  • DM-37986: Write utility to compare object changes in AP CI runs [analysis_ap]

  • DM-38041: Remove quantum graph dependency from PreExecInit [ctrl_mpexec, pipe_base]

  • DM-38123: Update zooniverseCutouts to use new HSM flags [analysis_ap]

  • DM-38152: Make zooniverseCutouts interface for getting footprint-based cutouts [analysis_ap]

  • DM-38177: reorganize how to map rubin jobs to panda jobs [ctrl_bps_panda]

  • DM-38191: IPython import in nb_utils fails flake8 on Jenkins [analysis_ap]

  • DM-38538: Describe how to release held jobs in ctrl_bps_htcondor docs [ctrl_bps_htcondor]

  • DM-38544: Allow getCutouts to extend off the edge of chips [analysis_ap]

  • DM-38605: Rename analysis_ap’s zooniverseCutouts task, script, and docs [analysis_ap]

  • DM-38616: Use GSL for C++ evaluation of SersicComponent weights in gauss2dfit [meas_extensions_multiprofit]

  • DM-38619: Re-implement priors in MultiProFit [meas_extensions_multiprofit]

  • DM-38632: Create task to measure Normalized Compensated Tophat fluxes [cp_verify, fgcmcal, meas_algorithms, meas_base, obs_lsst, obs_subaru, pipe_tasks, pipelines_check, sdm_schemas]

  • DM-38671: Migrate or remove legacy analysis_ap code [analysis_ap]

  • DM-38960: Update APDB query tools and docs [analysis_ap]

  • DM-39168: Include proper motion/parallax in astrometry metric calculations [analysis_tools, drp_pipe, drp_tasks, gbdes, obs_lsst, obs_subaru]

  • DM-39170: Add spuriousness min/max arguments to plotImageSubtractionCutouts [analysis_ap]

  • DM-39224: Create cutouts in multiple sizes [analysis_ap]

  • DM-39256: Implement AB1, AB2, and ABF1 metrics in analysis_tools [analysis_tools, drp_pipe]

  • DM-39363: Size PSF residuals over the focal plane [analysis_tools]

  • DM-39378: Rename “spuriousness” to “reliability” in the DiaSource table [analysis_ap]

  • DM-39503: Update analysis_ap to reflect APDB schema change [analysis_ap]

  • DM-39557: Create estimated depth metric difference imaging [ip_diffim]

  • DM-39858: Integrate new CalibrateImageTask with AP pipeline [analysis_ap]

  • DM-39895: Switch analysis_ap apdb query from makePackerTask to using dimensions [analysis_ap]

  • DM-39900: Develop improved metrics for completeness based on injected sources [analysis_tools, ap_pipe]

  • DM-40178: Improve dynamic range (normalization) of pixels in cutout generation [analysis_ap]

  • DM-40203: Add a method for creating all sky plots of metrics in analysis_tools [analysis_tools]

  • DM-40342: Remove support for the execution butler from BPS [ctrl_bps]

  • DM-40387: Validate new CalibrateImage with ap_verify_ci datasets [analysis_ap]

  • DM-40443: Remove interfaces deprecated by RFC-949 [ctrl_mpexec, pipe_base]

  • DM-40545: Fix LRU bug in image subtraction cutouts maker [analysis_ap]

  • DM-40562: Read pixel units from the FITS file [cell_coadds]

  • DM-40563: Pass ObservationalIdentifiers when reading in a file [cell_coadds]

  • DM-40751: Build Rucio registration into merge job for multi-site processing [rucio_register]

  • DM-40826: Remove the import redirects of coaddition tasks [pipe_tasks]

  • DM-40853: Implement new source injection for AP [ap_pipe, ap_verify]

  • DM-40855: Deprecate ApPipeWithFakes [ap_pipe, pipe_tasks]

  • DM-40903: Get upstream changes of ISRTask to ISRTaskLSST [ip_isr]

  • DM-40939: visit and detector unpacking not working for all instruments in apdb.py [analysis_ap]

  • DM-40981: Fix bug in compare_sources [analysis_ap]

  • DM-41063: Add nPixel filter for edge trailed sources and ignore filtering nans [analysis_tools, ap_association, ap_pipe, ap_verify, meas_extensions_trailedSources, sdm_schemas]

  • DM-41209: Make eups configs for multiprofit and depedencies [meas_extensions_multiprofit]

  • DM-41210: Add a pipeline for tract level injected catalog matching to source_injection [meas_astrom, pipe_tasks, source_injection]

  • DM-41310: Integrate schema-browser with LTD-style versioned artifact “edition” tracking [sdm_schemas]

  • DM-41326: Remove APIs deprecated on DM-34340/RFC-834 [daf_butler, obs_base, pipe_base, pipe_tasks, skymap]

  • DM-41345: DM-39895 broke analysis_ap tests [analysis_ap]

  • DM-41442: Add focal plane mosaic construction to cp_pipe/cp_verify [cp_pipe, cp_verify, ip_isr, pipe_tasks]

  • DM-41478: Making a maskedImage with None segfaults [afw]

  • DM-41507: 5 instances of detectAndMeasureDiaSources segfault on w13+ [ip_diffim]

  • DM-41520: Add unit test for ISR LSST task [ip_isr]

  • DM-41530: Add individual flag fields to APDB schema [alert_packet, ap_association, sdm_schemas]

  • DM-41605: Command-line aggregator for pipetask report [ctrl_mpexec, pipe_base]

  • DM-41670: Account for non-atomic APDB writes in error-handling [dax_apdb]

  • DM-41671: Implement Apdb.containsVisitDetector for Cassandra [dax_apdb]

  • DM-41672: Create symbolic link to bps submit directory named after BPS job ID [ctrl_bps]

  • DM-41711: Upgrade QuantumGraphExecutionReport to handle multiple overlapping graphs [ctrl_mpexec, pipe_base]

  • DM-41811: Add doc build to multiprofit [meas_extensions_multiprofit]

  • DM-41873: Add maxFootprintSize for alert packets [ap_association]

  • DM-41982: Understand why requiring isolated sources makes single frame astrometry slightly worse for AP [meas_astrom, pipe_tasks]

  • DM-42030: nb_utils import fails in non-development environment [analysis_ap]

  • DM-42087: Interesting characterizeImage streak masking failure mode [ip_diffim, meas_algorithms]

  • DM-42091: Remove deprecated S3 test functions from resources [resources]

  • DM-42102: Warn and/or provide guidance if full shear parameters are not provided to source_injection [source_injection]

  • DM-42157: Improve configuration for multiprofit fitters (including bootstrap) [meas_extensions_multiprofit]

  • DM-42176: Integrate new PeekExposureTask as fallback in atmospec [afwdata, atmospec, pipe_tasks, summit_utils]

  • DM-42282: Fix how FieldValidationError is raised in shapeHSM validate calls and add relevant tests [meas_extensions_shapeHSM]

  • DM-42290: Investigate effects of window smoothing on amp-to-amp offsets [ip_isr]

  • DM-42435: Migrate DM schemas from ccdVisitId to (visit, detector) [ap_association, ap_verify, dax_apdb, pipe_tasks, sdm_schemas]

  • DM-42438: Add realistic brighter-fatter to IsrMockLSST and add it to IsrTaskLSST [ip_isr]

  • DM-42445: afw display cleanups [display_firefly]

  • DM-42458: Adjust variance plane during source injection [source_injection]

  • DM-42519: Test running gbdes on multiple bands [drp_tasks]

  • DM-42576: Write task to compute predicted positions for an upcoming visit [ap_association, ap_pipe, ap_verify, obs_decam, obs_subaru]

  • DM-42579: Add call to allocateNodes inside bps [ctrl_bps, ctrl_bps_htcondor]

  • DM-42595: Write Task to aggregate metric bundles into a table [analysis_tools]

  • DM-42606: Provide self-consistent alert schema version numbers [alert_packet, ap_association]

  • DM-42695: Prevent github action uploading to PyPI if no changes to repo [sphgeom]

  • DM-42744: Fix random seeds for ap_association unit tests [ap_association]

  • DM-42766: Update non-linearity correction code to use Pierre Astier’s temp coeff fitting [cp_pipe, ip_isr]

  • DM-42811: Log unexpected measurement exceptions as WARNING [meas_base, pipe_tasks]

  • DM-42815: Implement unit testing for MatrixPlot plot type in analysis_tools [analysis_tools]

  • DM-42828: Add camera team crosstalk nonlinearity results [cp_pipe, ip_isr, obs_lsst, obs_lsst_data]

  • DM-42863: Add method to evaluate PTC model in ptcDataset [cp_pipe, ip_isr]

  • DM-42870: Add MultiProFit fit reconstructor [meas_extensions_multiprofit]

  • DM-42900: Easier to turn off bps output collection chaining. [ctrl_bps]

  • DM-42927: Update cp_verify connections/classes/outputs for analysis_tools [analysis_tools, cp_verify, ip_isr]

  • DM-42935: Refactor TAP module to use Pydantic data model [felis, sdm_schemas]

  • DM-42981: Convert AstrometryTask to new exception handling system [meas_astrom, pipe_tasks]

  • DM-43012: Move RSP validation into core Pydantic data model [felis]

  • DM-43020: Implement region and time extraction for preload [ap_pipe, daf_butler, pipe_base, pipe_tasks]

  • DM-43064: Create PSF-matched warps from directWarp [pipe_tasks]

  • DM-43078: Integrate HealSparse property map metadata into analysis_tools visualizations [analysis_tools]

  • DM-43115: Add missing primary keys or indices to fix foreign key relationships [sdm_schemas]

  • DM-43316: Use atomic chain operations where appropriate in Prompt Processing [daf_butler]

  • DM-43332: Improve match_probabilistic performance and implement distance metrics [analysis_tools, drp_pipe, meas_astrom, pipe_tasks]

  • DM-43338: Some psf plots are still in analysis_drp and need to be moved to analysis_tools. [analysis_tools, drp_pipe]

  • DM-43357: Improve MultiProFit PSF fitting runtime performance [meas_extensions_multiprofit]

  • DM-43370: Turn streakMasking off in characterizeImage and on in detectAndMeasure [ip_diffim, pipe_tasks]

  • DM-43371: Add validation check on length for sized datatypes [felis]

  • DM-43377: Add more features to defect finding code [cp_pipe]

  • DM-43401: Add error handling to DivideScalar action [analysis_tools]

  • DM-43416: Migrate AP code to external APDB configs [afw, ap_association, ap_pipe, ap_verify, dax_apdb, verify]

  • DM-43418: Divide AP pipeline into preload and prompt subsets [ap_pipe, ap_verify]

  • DM-43490: Put correct size in PixelGrid for PSF estimation [meas_extensions_piff, pipe_tasks]

  • DM-43493: Address additional change requests in dm_rucio_register [rucio_register]

  • DM-43495: Fix day offset calculation for ComCamSim [obs_lsst]

  • DM-43515: Evaluate the PSF image by coadding warped PSF images [drp_tasks]

  • DM-43531: Implement queryDatasetTypes in RemoteButler [daf_butler]

  • DM-43568: Update LSSTCam translators to support can_see_sky [obs_lsst]

  • DM-43583: Configure flake8/ruff to be able to lint obs_lsst configs [obs_lsst]

  • DM-43586: Add versioning to FITS serialization for cell-based coadds [cell_coadds]

  • DM-43593: `star_source_selector` is too strict [meas_base, pipe_tasks]

  • DM-43597: Remove outdated Felis modules [felis]

  • DM-43599: Add progress logs to TransiNetTask [ap_association, meas_base, meas_transiNet, utils]

  • DM-43623: Improve handling of replication factor when creating Cassandra APDB schema [dax_apdb]

  • DM-43668: Remove JSON-LD commands from Felis [felis]

  • DM-43673: change to Rucio configuration lfn2pfn to “identity” impacts registration script [rucio_register]

  • DM-43682: Test and adopt display_matplotlib efficiency contributions [display_matplotlib]

  • DM-43685: Generate single multi-panel version of AP plots [analysis_tools]

  • DM-43697: Improve lifetime management of server-side database cursor [daf_butler]

  • DM-43716: Eliminate all redundant type overrides for numeric types in all sdm_schemas schemas [sdm_schemas]

  • DM-43741: Implement minimal QueryDriver for DirectButler [daf_butler]

  • DM-43751: Change default type mapping of boolean for MySQL [felis]

  • DM-43753: Make columns nullable by default [felis]

  • DM-43787: Update Felis documentation workflow [felis]

  • DM-43788: Add sphinx documentation to Felis [felis]

  • DM-43800: Rewrite Felis user guide [felis]

  • DM-43801: Add towncrier support to Felis documentation [felis]

  • DM-43831: Deprecate diff_matched output in DiffMatchedTractCatalog [drp_pipe, pipe_tasks]

  • DM-43845: Implement default data ID for RemoteButler [daf_butler]

  • DM-43849: Create spatiallySampledMetric to visualize the diffim kernel [analysis_tools, ap_verify, ip_diffim]

  • DM-43855: Improve getTemplateTask runtime [afw, ip_diffim, skymap]

  • DM-43856: Add support for ApPipe with a Cassandra APDB in batch mode [ap_association, ap_pipe, dax_apdb, meas_base]

  • DM-43874: Add option to run gbdes using input camera model [drp_tasks]

  • DM-43894: Avoid division warnings in HSM higher order moments plugin [meas_extensions_shapeHSM]

  • DM-43898: Create PlotInfo analysis tools plot element [analysis_tools]

  • DM-43906: Add gauss2d and gauss2dfit to lsst_distrib [lsst_distrib, meas_extensions_multiprofit]

  • DM-43907: Add multiprofit to lsst_distrib [lsst_distrib, meas_extensions_multiprofit, multiprofit]

  • DM-43925: Due to a pandas bug, writing a masked astropy table to a parquet DataFrame gets mangled [daf_butler]

  • DM-43932: bps report KeyError total_jobs [ctrl_bps, ctrl_bps_htcondor]

  • DM-43933: Improve metrics collection from APDB [dax_apdb]

  • DM-43935: Enable higher order moments plugin in single frame processing [pipe_tasks]

  • DM-43937: Add instrument model for simulated LSSTCam data [obs_lsst]

  • DM-43942: Update fgcmcal/fgcm to serialize QA images into the butler [drp_pipe, fgcm, fgcmcal]

  • DM-43945: Update showVisitSkyMap.py to better handle large sky area coverage [skymap]

  • DM-43946: Fix lengths and datatypes on sized columns, primarily in ObsCore-related schemas [sdm_schemas]

  • DM-43956: Eliminate all redundant fixed-length string type overrides from sdm_schemas [sdm_schemas]

  • DM-43958: Eliminate overrides of Felis “boolean” to MySQL “BOOLEAN” [sdm_schemas]

  • DM-43959: Use Binned2CorrConfig as config to treecorr rather than picking arguments [analysis_tools]

  • DM-43960: Spatial sample metrics task breaks fakes pipeline [ap_pipe, pipe_base]

  • DM-43962: Add GCC_COLORS to preserved envvars [sconsUtils]

  • DM-43969: Fix errors in ClassificationSizeExtendedness in DRP [meas_base]

  • DM-43970: Fix unexpected errors in HsmShapeRegauss reported as warnings [meas_extensions_shapeHSM]

  • DM-43973: Fix errors in ClassificationSizeExtendedness in AP runs [pipe_tasks]

  • DM-43974: Fix errors in ext_trailedSources_Naive [meas_extensions_trailedSources]

  • DM-43982: Raise FatalAlgorithmError or something equivalent if shapes are not in schema for sizeExtendedness [meas_base]

  • DM-43985: Create bps report API [ctrl_bps]

  • DM-43998: Default values not handled properly in MetaData builder [felis, sdm_schemas]

  • DM-44000: Test ingesting and matching external galaxy catalogs against precursor (HSC) data [analysis_tools, meas_astrom, meas_extensions_multiprofit, pipe_tasks]

  • DM-44002: DatasetRef warning when using the analysis_tools reconstructor [analysis_tools]

  • DM-44007: Fix dimensions-config migration script to support sqlite. [daf_butler, daf_butler_migrate]

  • DM-44009: Ingest doesn’t warn if the exposure timespan is nonsensical [obs_base]

  • DM-44025: Improve PTC turnoff computation for odd duck amps that have “normal” variance above the dip [cp_pipe, ip_isr]

  • DM-44029: Deprecate NaiveDipoleCentroid/NaiveDipoleFlux [ip_diffim]

  • DM-44049: Speed up variance plane tests in ip_isr [ip_isr]

  • DM-44050: Mitigate failed database connections after idle time [daf_butler]

  • DM-44058: Enable CI on sdm_schemas to catch future use of redundant type overrides [sdm_schemas]

  • DM-44059: Understand the use of “datetime” / “TIMESTAMP” data types in the data model and devise a way forward [sdm_schemas]

  • DM-44068: Add FAQ guidance relating to writing injected outputs back into the butler [source_injection]

  • DM-44075: Extend analysis_ap to run queries against Cassandra. [analysis_ap]

  • DM-44078: Investigate PDR2 characterizeImage+fitAffineWcs error: Failed to determine psfex psf: too few good stars. [meas_extensions_psfex]

  • DM-44080: Investigate PDR2 characterizeImage+fitAffineWcs error: No objects passed our cuts for consideration as psf stars [meas_algorithms]

  • DM-44085: Allow all input dataset refs to run method in AnalysisPipelineTask [analysis_tools]

  • DM-44087: Catch high trailed source flux failures [meas_extensions_trailedSources]

  • DM-44091: Pipetask report drops some failures [ctrl_mpexec, pipe_base]

  • DM-44092: Remove placeholder timeseries feature columns from DIAObject schemas [sdm_schemas]

  • DM-44095: Implement queryDimensionRecords in RemoteButler [daf_butler]

  • DM-44105: Allow plotInfo to be None for focalPlane plots [analysis_tools]

  • DM-44107: bps report MISFITS after condor_release [ctrl_bps_htcondor]

  • DM-44109: Remote butler tests fail if httpx is found but server dependencies are not [daf_butler]

  • DM-44110: Add ability for WMS-specific default configs [ctrl_bps, ctrl_bps_htcondor, ctrl_bps_parsl]

  • DM-44114: Add filter scan task to cp_pipe [cp_pipe]

  • DM-44129: Implement automated replication from APDB to PPDB [dax_apdb]

  • DM-44130: Increase default signal-to-noise cut for star selection for PSFs in FinalizeCharacterizationTask [obs_lsst, pipe_tasks]

  • DM-44147: Modify butler template code now that group/day_obs exists [daf_butler]

  • DM-44150: Discuss and remove possibly unnecessary DetectAndMeasure plugins [ip_diffim, meas_extensions_trailedSources]

  • DM-44153: Error reading PSF matching kernel with the butler [daf_butler]

  • DM-44156: Include memoryLimit in BPS defaults [ctrl_bps]

  • DM-44157: Clean up analysis_ap and add it to lsst_distrib [analysis_ap, lsst_distrib]

  • DM-44158: Add database tests to sdm_schemas [sdm_schemas]

  • DM-44159: Replace Pandas DataFrames with Astropy Tables in MatchTractCatalogTask [meas_astrom, pipe_tasks]

  • DM-44161: Create a Summit ConsDB schema including flexible metadata [sdm_schemas]

  • DM-44167: Resolve warning “Cannot compute CoaddPsf” in RC2 subset nightly runs [afw, ap_association, meas_algorithms, meas_base, pipe_tasks, sdm_schemas]

  • DM-44168: Change bps to use QuantumGraph.pipeline_graph [ctrl_bps]

  • DM-44169: Resolve warning “Array must be square” in RC2 subset nightly runs [meas_base]

  • DM-44171: Address non-standard logging in PIFF [meas_extensions_piff]

  • DM-44175: Resolve “Overriding default configuration file with .dustmapsrc” log messages in RC2 subset nightly runs [faro, pipe_tasks]

  • DM-44177: Remove deprecated connection and configs inside pipe_tasks [pipe_tasks]

  • DM-44184: Resolve FGCM warning “Divide by zero encountered in divide” in RC2 subset nightly runs [meas_algorithms]

  • DM-44186: Remove doSigmaClip config field following deprecation [ap_pipe, drp_tasks, obs_lsst, obs_subaru]

  • DM-44187: Resolve warning “Invalid value encountered in multiply” in RC2 subset nightly runs [scarlet_lite]

  • DM-44188: Fix template validation [daf_butler]

  • DM-44200: In documentation, make section on the automatic retries with requestMemory increase [ctrl_bps]

  • DM-44221: cell_coadds contains an unnecessary python/SConscript [cell_coadds]

  • DM-44232: Replace MakeWarp with MakeDirectWarp and MakePSFMatchedWarp tasks in the DRP pipeline [ap_pipe, drp_pipe, obs_lsst, obs_subaru]

  • DM-44233: Drop using packed integer bits in cell coadds [cell_coadds, drp_tasks]

  • DM-44235: Add retries for add_replicas in dm_rucio_register [rucio_register]

  • DM-44237: Write schema migration script for APDB visit/detector [dax_apdb]

  • DM-44241: Analyze and either remove or explicitly confirm non-redundant overrides of numeric types in existing schemas [sdm_schemas]

  • DM-44246: Update SingleFrameMeasurementTask so that additional footprints can be sent to the noise replacer [meas_base, pipe_tasks]

  • DM-44250: Rename matched difference metrics [analysis_tools]

  • DM-44254: Make SkyCorrectionTask respect disabling sky frames [pipe_tasks]

  • DM-44255: Resolve warning “‘FilterFractionPlugin’ object has no attribute ‘key’” in RC2 subset nightly runs [obs_subaru]

  • DM-44259: Rename calibration and verification pipelines according to RFC-1013 [cp_pipe, cp_verify]

  • DM-44261: Add IVOA SIAv2 POS parser to sphgeom [sphgeom]

  • DM-44267: Fix ForcedPhotCcdFromDataFrameTask failing to measure local background due to missing wcs [meas_base]

  • DM-44268: Fix bitrot in atmospec pipeline [atmospec, pipe_tasks]

  • DM-44275: Remove apdbSchemaVersion method from Apdb interface [dax_apdb]

  • DM-44279: Remove extra print statement from FilterDiaSourceCatalogTask [ap_association]

  • DM-44280: Dataset transfer does not work with type compatibility [daf_butler]

  • DM-44287: Gaap error handling doesn’t handle exceptions, flags, and logging correctly. [meas_extensions_gaap]

  • DM-44290: remove deprecated doPackFlags from DRP pipelines [ap_association, drp_pipe]

  • DM-44294: Implement partial queryDataIds for RemoteButler [daf_butler]

  • DM-44300: Modify plotImageSubtractionCutouts to save raw cutouts [analysis_ap]

  • DM-44302: Implement photometric repeatability metrics and plots in analysis_tools with calib_fluxes [analysis_tools]

  • DM-44305: Implement Gaussian Process interpolation over bad pixels [ip_isr, meas_algorithms]

  • DM-44311: Tagged collection association adds unnecessary entries to summary tables [daf_butler]

  • DM-44312: Fix transition date for LSSTCam day obs offset [obs_lsst]

  • DM-44319: Refactor deblending in DetectAndMeasureTask [ip_diffim]

  • DM-44320: Remove analyzeBiasCorrExtended label from cpExtended subset [analysis_tools]

  • DM-44333: analyzeObjectTableCore failed on tract 9697 in w_2024_18 HSC_RC2 [analysis_tools]

  • DM-44341: Propagate subsetCtrl into subset_from_labels [pipe_base]

  • DM-44342: Fix NumDiaSourcesMetric now that flags are unpacked [analysis_tools]

  • DM-44346: Shape flag missing from meas_extensions_trailedSources [meas_extensions_trailedSources]

  • DM-44347: diaSource selection with exclude_flagged=True is broken for Postgres [analysis_ap]

  • DM-44349: Create a metric to count all vs “good” diaSources [analysis_tools]

  • DM-44351: Support generation of ApPipeWithFakes using source_injection tools [source_injection]

  • DM-44352: Build SFM input camera using global astrometric fit [afw, drp_tasks, obs_subaru]

  • DM-44362: Implement skypix data ID constraints in the new query system [daf_butler]

  • DM-44363: Investigate NOT_DEBLENDED regions in diffim without a detection [ip_diffim]

  • DM-44367: Calculate cell coadd variance from inputs’ variance plane [drp_tasks]

  • DM-44368: Include number of expected instances in pipetask report task-level summary [ctrl_mpexec, pipe_base]

  • DM-44382: Update GAIA refcat to DR3 in subtractBrightStars [pipe_tasks]

  • DM-44398: Downloading from the object store ignores umask and always creates files with mode 600. [resources]

  • DM-44399: Not assigning units to every element of a column in a table causes an error on write. [daf_butler]

  • DM-44401: Write script to produce DC2 truth labels for generated cutout triplets [analysis_ap]

  • DM-44410: Document dipole orientation angle [ip_diffim]

  • DM-44411: Fix bit-rot in AP pipelines [analysis_tools, ap_pipe]

  • DM-44414: Implement queryDatasets in RemoteButler [daf_butler]

  • DM-44429: Add CcdExposure and LSSTComCamSim to ConsDB [sdm_schemas]

  • DM-44441: Add imports and fix starmap usage in plotImageSubtractionCutouts [analysis_ap]

  • DM-44452: Add WholeSkyAnalysisTask to the DRP HSC reprocessing pipelines [analysis_tools, drp_pipe]

  • DM-44457: bps report summary not showing H state, but it does inside detailed report [ctrl_bps, ctrl_bps_htcondor]

  • DM-44459: Enable ApdbSql authentication with db-auth.yaml [dax_apdb]

  • DM-44460: FootprintSet.makeSources should reserve before creating new records [afw]

  • DM-44467: Merge the special test case for 45 degree rotation with the rest [meas_extensions_piff]

  • DM-44470: Update DiaForcedSource columns for the APDB [alert_packet, ap_association, sdm_schemas]

  • DM-44484: Ensure all isolated catalogs are input to SourceObjectTableAnalysisTask and check for no sources [analysis_tools]

  • DM-44486: Add SEEK_END support to ResourcePath handles [resources]

  • DM-44487: Fix PyPi upload for sphgeom [sphgeom]

  • DM-44488: Handle new pipe_base exception types in middleware executors [ctrl_mpexec, pipe_base, pipe_tasks]

  • DM-44489: Add visit tables and Rapid Analysis/quicklook output tables to ConsDB [sdm_schemas]

  • DM-44491: Exclude bad mask planes from detection on difference images [ip_diffim]

  • DM-44494: Save DipoleFit_orientation to radians [ip_diffim]

  • DM-44501: Implement expanded() for RemoteButler query shims [daf_butler]

  • DM-44502: Make RemoteButler query system stream results instead of buffering all rows in memory [daf_butler]

  • DM-44503: Clean up RemoteButler REST API [daf_butler]

  • DM-44507: Investigate unexpectedly large transform passed to WarpedPsf in diffim [ip_diffim]

  • DM-44511: Investigate UnboundLocalError: cannot access local variable ‘scores’ in meas_transiNet [meas_transiNet]

  • DM-44513: update ctrl_bps_panda default values [ctrl_bps_panda]

  • DM-44535: Update DiaSource.yaml to transform dipole, trail orientation from radians on detector to degrees on sky (Position Angle) [ap_association, pipe_tasks]

  • DM-44536: Add MEAN_PER_ROW overscan option to OverscanCorrectionTask [ip_isr]

  • DM-44545: Design initial calibration report format [analysis_tools, cp_verify]

  • DM-44547: Allow ResourcePath to fsspec conversion [resources]

  • DM-44548: Patches for calibration rehearsal 1 (CR1) [cp_pipe, cp_verify]

  • DM-44553: Remove base_ClassificationSizeExtendedness from characterizeImage [pipe_tasks]

  • DM-44565: Improve matching for AB1/ABF1 [analysis_tools, obs_subaru]

  • DM-44569: Make v27 middleware release notes [ctrl_bps, ctrl_bps_htcondor, ctrl_bps_panda, ctrl_bps_parsl, ctrl_mpexec, daf_butler, daf_relation, obs_base, pipe_base, resources]

  • DM-44583: Fix ci_middleware breakage from (probably) DM-43942 [analysis_tools, fgcmcal, pipe_base]

  • DM-44589: increase default memory for 5 pipetasks in resources file for bps [drp_pipe]

  • DM-44592: Remove ApTemplate from ap_pipe/ap_verify and docs [ap_pipe]

  • DM-44608: Update Nightly Validation, DRP, and quickLook Pipelines for OR4 [drp_pipe, obs_lsst]

  • DM-44609: Cutout plotter can’t handle pandas multi-indexed diaSource tables [analysis_ap]

  • DM-44612: Deprecate MakeWarp and WarpAndPsfMatch tasks [pipe_tasks]

  • DM-44617: Add missing obs_lsst dependency to fgcmcal [fgcmcal]

  • DM-44619: Update forced sources partitioning for new ra/dec columns [ap_association, dax_apdb]

  • DM-44623: Attach shrunk validPolygons to PSF-matched warp [drp_tasks, pipe_tasks]

  • DM-44625: fgcm multiprocessing needs to protect from trying to pickle ButlerQC object. [fgcm]

  • DM-44637: Resolve non-redundant overrides of string types [sdm_schemas]

  • DM-44647: Group datasets by dimension and storage class in output pipeline-dot files [ctrl_mpexec, pipe_base]

  • DM-44651: Transient failures in astro_metadata_translator tests [astro_metadata_translator]

  • DM-44666: Fix fgcmFitCycle generating many potential output datasets for LATISS [obs_lsst]

  • DM-44668: Allow specifications of exit codes for which NOT to retry failed HTCondor job. [ctrl_bps, ctrl_bps_htcondor]

  • DM-44678: Enforce consistency across makeWarp and assembleCoadd with matchingKernelSize [ap_pipe, drp_pipe, obs_lsst, obs_subaru, pipe_tasks]

  • DM-44691: Switch comCamSim back to using the comCam distortion model [obs_lsst]

  • DM-44721: Move database utilities into a separate package and refactor them [felis]

  • DM-44725: Add pyplot-less matplotlib Figure creation code to lsst.utils [utils]

  • DM-44744: Investigate LSSTComCamSim LinAlgError failure in analyzeObjectTableCore [analysis_tools]

  • DM-44747: Assign default background values to cpSkyImage [cp_pipe]

  • DM-44749: Test LATISS pipeline in unit tests [drp_pipe, obs_lsst]

  • DM-44756: Remove all characterizeImage doMaskStreaks config overrides [atmospec, drp_pipe]

  • DM-44762: Allow non-webdav URLs to work with http open() [resources]

  • DM-44764: Write out the artifact rejection masks from CompareWarpAssembleCoadd [drp_pipe, drp_tasks]

  • DM-44779: Add kafka header information to measure ingestion rate [ap_association]

  • DM-44790: Deprecate doUsePsfMatchedPolygons field in CompareWarpAssembleCoaddTask [drp_tasks]

  • DM-44793: Get amp-to-amp offset pedestals from ISR metadata into Chronograf [analysis_tools, ip_isr]

  • DM-44796: Deprecate tractInfo.inner_sky_polygon and replace with inner_sky_region [ap_pipe, obs_subaru, pipe_tasks, skymap]

  • DM-44802: Fix missing test coverage in CalibrateImage [pipe_tasks]

  • DM-44805: Fix setting of astromOffsetStd metric in meas_astrom [meas_astrom]

  • DM-44809: Fix ap_verify failure following DM-43685 [analysis_tools]

  • DM-44822: Implement database removal for Cassandra APDB. [dax_apdb]

  • DM-44825: Implement improvements to timestamp handling in Felis [felis, sdm_schemas]

  • DM-44826: Add EFD query support for electrometer data. [cp_pipe, ip_isr]

  • DM-44832: display_firefly doesn’t default correctly with firefly_client>=3.0.0 [display_firefly]

  • DM-44833: bps can’t launch PanDA jobs w/clustering in w24: BPSConfig[“cluster”] has ‘wmsServiceClass’ as key [ctrl_bps]

  • DM-44840: Change default temporary directory for HttpResourcePath downloads [resources]

  • DM-44842: Tutorial notebook 04b query failure with RemoteButler [daf_butler]

  • DM-44843: Overhead from running queries through Butler server unexpectedly high [daf_butler]

  • DM-44850: Add utility method to create an empty table matching sdm_schemas [ap_association]

  • DM-44854: Add expTime and pixelScale to visitSummary and ccdVisitTable [afw, analysis_tools, pipe_tasks, sdm_schemas]

  • DM-44855: Update effectiveTime fiducial values for comCamSim [obs_lsst]

  • DM-44868: Data ID queries with order_by fail on Postgres [daf_butler]

  • DM-44869: Add tract-level N-image plot to analysis_tools [analysis_tools]

  • DM-44878: TAP_SCHEMA validation issue - Size does not match arraysize for vector [felis, sdm_schemas]

  • DM-44884: TAPlint queries to dp01_dc2_catalogs fail (Remove dp01_dc2 from TAP_SCHEMA) [sdm_schemas]

  • DM-44902: Add info to apdb-cli list-cassandra [dax_apdb]

  • DM-44908: Use normalized compensated tophat flux in CalibrateImageTask [obs_lsst, pipe_tasks]

  • DM-44917: Pre-OR4 Rapid Analysis updates [drp_pipe, summit_extras, summit_utils]

  • DM-44928: Relax PSF quality metrics thresholds for inclusion in coadd for LSSTComCamSim [obs_lsst]

  • DM-44931: Task metadata writes with QBB are ignoring repo storage class, and transfer-from-graph silently ignores them [daf_butler, pipelines_check]

  • DM-44934: Add different types of color bar maps to WholeSkyPlot [analysis_tools, drp_pipe]

  • DM-44937: DiaForcedSource tables indexed by class, not integer [ap_association]

  • DM-44955: Document effTime metrics in sdm_schemas [sdm_schemas]

  • DM-44958: Update documentation for effTime scale factor metrics in sdm_schemas [sdm_schemas]

  • DM-44963: New isr overscan MEAN_PER_ROW is not working correctly [ip_isr]

  • DM-44967: Add VIGNETTE and VIGN_MIN to ConsDB [sdm_schemas]

  • DM-44983: Remove vestigial cp_pipe pipelines [cp_pipe]

  • DM-44990: ip_diffim fails with lmfit=1.3.1 [ip_diffim]

  • DM-44994: Modify condor_scratch directory structure for allocateNodes.py [ctrl_execute, ctrl_platform_s3df]

  • DM-44996: Discontinuous transform detected when generating AP cutouts [ap_association]

  • DM-44997: Alert Packager tries to compute template kernel where there is no coverage [ip_diffim]

  • DM-45002: Two detectors in HSC-RC2 w_2024_25 fail ‘calibrate’ in step1 [meas_algorithms, pipe_tasks]

  • DM-45004: Fix whitespace error in version.py [sconsUtils]

  • DM-45006: Ignore errors in rmtree test calls [afw, log, meas_transiNet]

  • DM-45007: Memory leak in Prompt Processing service [utils]

  • DM-45008: Calibration OR4 patches [cp_pipe, cp_verify]

  • DM-45010: AOS images failed SFM due to lack of aperture correction stars [meas_algorithms]

  • DM-45023: Add close to the kafka producer [ap_association]

  • DM-45028: Resolve ID mismatch error in assembleCoadd [drp_tasks]

  • DM-45045: Modify Butler formatter for Pydantic YAML to avoid alphabetization of attributes [daf_butler]

  • DM-45068: configure ruff/flake8 to lint subaru/decam/cfht configs [obs_cfht, obs_decam, obs_lsst, obs_subaru]

  • DM-45080: Modify analysis_tools match catalog task output names to distinguish between astrometry and photometry variants [analysis_tools, drp_pipe]

  • DM-45081: Use a unique Execute base in lscratch for each Glidein [ctrl_platform_s3df]

  • DM-45086: Replace the detection_tutorial task with detection [drp_pipe]

  • DM-45087: Kill step8 in RC2/DC2 and move tasks to subsets more similar to DRP production [analysis_tools, drp_pipe]

  • DM-45088: Fix RemoteButler unable to load DimensionUniverse [daf_butler]

  • DM-45099: UWS database not query-able in TAP [sdm_schemas]

  • DM-45100: Fix incompatible datataset type error for fringe frames [cp_pipe]

  • DM-45105: Fix incompatible dataset type definitions for verifyDefectsIndividualIsrExp and verifyDefectsPostFlatIsrExp [cp_verify]

  • DM-45106: Increase requestMemory for HSC-RC2 for consolidateForcedSourceOnDiaObjectTable and analyzeMatchedVisitCore [drp_pipe]

  • DM-45108: Increase requestMemory for HSC-RC2 for analyzeMatchedVisitCore to 120GB [drp_pipe]

  • DM-45113: Re-enable skipping and clobbering with LimitedButler [ctrl_mpexec]

  • DM-45117: Include DCR in astrometric fit [drp_tasks, gbdes]

  • DM-45119: Many butler queries on /repo/dc2 fail with MissingSpatialOverlapError due to healpix11 dimension [daf_butler]

  • DM-45131: Remove vestigial lsst.log usage from python code [afw, coadd_utils, display_firefly, fgcmcal, ip_diffim, ip_isr, jointcal, meas_algorithms, meas_deblender, meas_modelfit, obs_lsst, pipe_tasks, skymap]

  • DM-45135: Incorrect task names in cp_pipe LSSTCam pipeline yaml files [cp_pipe]

  • DM-45139: Felis load-tap fails when using mysql as the database engine [felis]

  • DM-45140: Support anonymous access to s3: resources [daf_butler]

  • DM-45144: AccumulatorMeanStack.add_masked_image claims to support vector weights but doesn’t [meas_algorithms]

  • DM-45151: Fix overscanIsInt configuration in OverscanCorrectionTask so it is operational [ip_isr]

  • DM-45159: Add debug output for Butler queries [daf_butler]

  • DM-45184: Update legacy imports [Spectractor]

  • DM-45191: Remove support for Oracle in Felis [felis]

  • DM-45192: Reconfigure RA for real ComCam [drp_pipe]

  • DM-45201: Fix fiber spectrograph fitting in CpMonochromatorScanTask [cp_pipe]

  • DM-45209: Fix warnings from new flake8 [alert_packet, ap_verify, astshim, ctrl_mpexec, daf_base, daf_butler, geom, ip_diffim, ip_isr, meas_astrom, obs_base, pex_config, pipe_base, pipe_tasks]

  • DM-45218: Refactor diaPipe and add detailed timing [ap_association]

  • DM-45221: Add skyCorr frame back to bright stars subtracted calexp [pipe_tasks]

  • DM-45224: Some tests in drp_tasks GBDes fail if run out of order [drp_tasks]

  • DM-45233: Avoid writing tombstones to Cassandra APDB tables [dax_apdb]

  • DM-45234: Some tests in pipe_tasks set logger level and break other tests [pipe_tasks]

  • DM-45236: Enable Apdb metrics output in pipelines. [dax_apdb]

  • DM-45237: Speed up butler import [daf_butler]

  • DM-45263: Add new module for loading schema data into TAP_SCHEMA [felis]

  • DM-45269: Read piff v1.3 pkls using piff v1.4 [meas_extensions_piff]

  • DM-45270: Record the number of bright stars that are subtracted from a bright-stars-subtracted calibrated exposure. [pipe_tasks]

  • DM-45272: Update IsrMockLSST and IsrTaskLSST with new v2.0 calibration boxes [cp_pipe, ip_isr]

  • DM-45284: Run pyupgrade on log package [log]

  • DM-45295: Raise an AlgorithmError when there are no psf_stars/stars cross matches [pipe_tasks]

  • DM-45299: Revert DM-45023 [ap_association]

  • DM-45300: Begin deprecation of task metadata in cp_pipe/cp_verify [cp_pipe, cp_verify]

  • DM-45317: Python package version retrieval in utils has stopped working [utils]

  • DM-45322: Correctly handle linearity bboxes for both trimmed and untrimmed exposures [cp_pipe, ip_isr]

  • DM-45325: Add realistic LSSTCam CTI to IsrMockLSST and IsrTaskLSST and tests [cp_pipe, ip_isr]

  • DM-45340: “getReport() called before execute()” raised if first task crashes [ctrl_mpexec]

  • DM-45342: meas.base.CCContext suppresses all raisables, not just exceptions [meas_base]

  • DM-45366: assembleCoadd throws zip() argument 2 is shorter than argument 1 in 5% of DC2 testing [drp_tasks]

  • DM-45378: Create initial ComCam crosstalk matrix from average of LSSTCam crosstalk terms on ITL rafts [obs_lsst, obs_lsst_data]

  • DM-45386: Problem serializing datetime64[us] data type to parquet from pandas/astropy with PyArrow [daf_butler]

  • DM-45391: Create initial comCam transmission curves in curated calibrations [obs_lsst, obs_lsst_data]

  • DM-45416: Fix minor problems in preparation for rubin-env 9. [daf_relation]

  • DM-45426: Ensure parity between new and old warping tasks [drp_tasks, pipe_tasks]

  • DM-45429: Add support for “general” query results to new butler query system [daf_butler]

  • DM-45431: Change Parquet formatter to support can_accept [daf_butler]

  • DM-45432: Confirm that SIAV2 queries can be handled by the new butler query system [daf_butler]

  • DM-45433: Remove lsst.utils.packages forwarding from base package [base]

  • DM-45452: fgcmcal test_fgcmcalTractPipeline FgcmcalTestHSC has an intermittent error [fgcm, fgcmcal]

  • DM-45457: Support optional regular input connections [ctrl_mpexec, pipe_base]

  • DM-45460: Use timestamp with timezone in APDB schema. [dax_apdb]

  • DM-45461: Fix file leaks in ci_hsc_gen3 tests [obs_base]

  • DM-45463: Add analyzeAmpOffsetMetadata from analysis_tools to HSC pipeline YAMLs [drp_pipe]

  • DM-45464: Fix handling of deprecated taskMetadata [cp_pipe, cp_verify]

  • DM-45465: Add EFD utility access to photodiode measurements part of cpPtcExtract [cp_pipe]

  • DM-45468: Remove unnecessary obs_base dependency from meas_base [meas_algorithms, meas_base]

  • DM-45483: Add /sys to paths to ignore in open file descriptor leak check [utils]

  • DM-45485: Allow constraints to be ignored in Felis schemas when generating DDL [felis]

  • DM-45486: Remove lsst/utils C++ shim [afw, astshim, geom, ip_diffim, jointcal, meas_algorithms, meas_base, meas_extensions_trailedSources, meas_modelfit]

  • DM-45489: Match RemoteButler queryDataIds handling to DirectButler [daf_butler]

  • DM-45492: Change a few Felis command line option names for create command [felis]

  • DM-45498: Allow daf_base DateTime to be sorted [daf_base]

  • DM-45506: Revise pipeline YAMLs to include analyzeAmpOffsetMetadata with properly configured doAmpOffset and doApplyAmpOffset options [drp_pipe]

  • DM-45507: Split amp offset config into measurement and application components [ip_isr, obs_subaru]

  • DM-45513: Update allocateNodes glidein config for sdfiana012, sdfiana013 [ctrl_platform_s3df]

  • DM-45516: Resolve incorrect astrometricRefCatPreSourceVisit output connection name [drp_pipe]

  • DM-45517: Support conversion of Parquet storage components [daf_butler]

  • DM-45519: Implement final pvi measurement task [drp_tasks, meas_base, meas_extensions_shapeHSM, pipe_tasks]

  • DM-45529: Investigate source injection magnitude error in trailed sources [source_injection]

  • DM-45536: Fix ci_middleware breakage involving lack of isr_metadata registration [pipe_base]

  • DM-45541: Add qp.Ensemble data type to storageClasses and formatters to enable reading ‘qp’ files with photoZ p(z) information [daf_butler]

  • DM-45556: Experiment with using the new query system in the butler command line tools [daf_butler]

  • DM-45562: Allow eupspkg build of spectractor to work with setuptools 72 [Spectractor]

  • DM-45573: Add m5 (point source 5-sigma limiting magnitude) to computeExposureSummaryStats [afw, pipe_tasks, sdm_schemas]

  • DM-45577: Add meas_extensions_multiprofit to lsst_distrib [drp_pipe, lsst_distrib, meas_extensions_multiprofit, multiprofit, pipe_tasks]

  • DM-45616: Control IDF DirectButler configuration from Phalanx [daf_butler]

  • DM-45617: Fix bitrot in atmospec pipeline again [atmospec]

  • DM-45618: Update ApPipe clustering configs [ap_pipe]

  • DM-45623: Constraint names in felis need to be unique within a schema, not a table [felis, sdm_schemas]

  • DM-45631: fix pandaDistributionEndpoint to support different protocols [ctrl_bps_panda]

  • DM-45635: Remove tmp directories created in TestClusteredQuantumGraph [ctrl_bps]

  • DM-45646: Account for possible moving of DiaObject position when filling DiaObjectLast table [dax_apdb]

  • DM-45651: Get LSSTCam ready for processing [drp_pipe, obs_lsst]

  • DM-45654: Allow BPS to process instruments with filters that have spaces in their name [ctrl_bps_htcondor]

  • DM-45662: Use non-settable shear type to simplify HsmShapeConfig and prevent user errors [meas_extensions_shapeHSM]

  • DM-45664: Fix incorrect definition for mosaics [cp_verify, pipe_tasks]

  • DM-45668: Investigate ApPipe TypeError in diaPipe [dax_apdb]

  • DM-45677: Remove MockApPipe.yaml and tests that need it [ap_verify]

  • DM-45680: Support boolean expressions in butler WHERE clauses [daf_butler]

  • DM-45681: Move dm_rucio_register from lsst-dm to lsst [lsst_distrib, rucio_register]

  • DM-45683: Apdb.from_uri recreates sqlite file after it was deleted [dax_apdb]

  • DM-45701: Move dotTools from ctrl_mpexec to pipe_base [ctrl_mpexec, pipe_base]

  • DM-45705: Increase requestMemory for assembleCoadd to 16GB for DC2 and RC2 and DRP [drp_pipe]

  • DM-45709: Explicitly evaluate pixelScale at the detector center for single frame processing [analysis_ap, ap_association, drp_tasks, fgcmcal, ip_diffim, meas_astrom, meas_extensions_gaap, meas_extensions_piff, pipe_tasks, source_injection]

  • DM-45722: CRITICAL logs on empty quantum graph [ctrl_mpexec, pipe_base]

  • DM-45724: SingleQuantumExecutor may unilaterally close the program [ctrl_mpexec]

  • DM-45725: Change default MySQL table engine to MyISAM [felis]

  • DM-45726: Change butler export transfer code to use a butler not registry [daf_butler, pipe_base]

  • DM-45732: Catch NoSuchKey in ResourcePath S3 handles [resources]

  • DM-45738: Develop new butler collection querying APIs [daf_butler, obs_base]

  • DM-45745: Paginate numpy outputs from PlotImageSubtractionCutouts [analysis_ap]

  • DM-45752: Add support for querying Butler spatially based on a point [daf_butler]

  • DM-45764: Return dataset ingest_date as astropy time [daf_butler]

  • DM-45773: Excessive memory usage by IsolatedStarAssociationTask [pipe_tasks]

  • DM-45775: Enable datastore caching in remote butler [daf_butler]

  • DM-45780: calibrate background output in calibrateImage [pipe_tasks]

  • DM-45782: Getting RuntimeError ‘Record data is not contiguous in memory.’ when processing Saha Bulge/Crowded Fields [meas_astrom]

  • DM-45784: Examine Sphinx docstring inheritance for overridden properties [meas_extensions_shapeHSM]

  • DM-45789: Optimize region for LoadDiaCatalogs [ap_association]

  • DM-45791: Change butler import backend to use butler rather than registry [daf_butler, daf_butler_migrate]

  • DM-45808: Fix offset in dipole diaSource locations [afw]

  • DM-45815: Add utility functions to get gain and readnoise set by ISR. [ip_isr]

  • DM-45829: fgcmcal test_fgcmcalTractPipeline FgcmcalTestHSC has an(other) intermittent error [fgcmcal]

  • DM-45833: sphgeom pypi uploads have stopped [sphgeom]

  • DM-45834: Fix C++17 deprecations and prepare code for C++20 [afw, cpputils, meas_algorithms]

  • DM-45844: ParserYacc construction is slow [daf_butler]

  • DM-45845: Make gbdesAstrometricFit output catalogs more user-friendly [analysis_tools, drp_tasks, gbdes]

  • DM-45848: Add sky brightness to sdm_schemas [sdm_schemas]

  • DM-45850: Summit electrometer readings need to be multiplied by the exposure time [cp_pipe]

  • DM-45856: Create updated calibration pipelines for new IsrTaskLSST [cp_pipe, cp_verify, ip_isr]

  • DM-45860: Write dax_obscore SIAv2-over-butler API [daf_butler, dax_obscore]

  • DM-45863: Resolve BPS parsl AttributeError relating to attribute ‘keys’ [ctrl_bps_parsl]

  • DM-45871: Fix confusing log message in ampOffset code [ip_isr]

  • DM-45872: Release new butler query wrapper simple APIs [daf_butler]

  • DM-45878: Split out obs_package fiducial configs into their own files for use in multiple tasks [obs_lsst, obs_subaru]

  • DM-45879: Clarify the use of midpointMjdTai in Source filtering. [dax_apdb]

  • DM-45882: Fix source_injection selection logic triggering when no input catalog is provided [source_injection]

  • DM-45886: Get SFM working for LSSTCam [drp_pipe, summit_extras]

  • DM-45888: Use miniforge instead of mambaforge [cell_coadds, dax_apdb, pipe_base, rucio_register, sconsUtils, utils]

  • DM-45893: Add StarTracker schemas to sdm_schemas [sdm_schemas]

  • DM-45894: pipetask run-qbb fails to unpickle non-default DimensionUniverse [ctrl_mpexec]

  • DM-45897: Add spectroFlat generation and application for LATISS [cp_pipe]

  • DM-45899: Write a Task to compute Ex for TEx [analysis_tools, meas_algorithms]

  • DM-45904: Fix incorrect universe call in source_injection [source_injection]

  • DM-45907: Fix out of memory for large query in Butler server [daf_butler]

  • DM-45908: Fix client-side timeout for slow-to-start query on Butler server [daf_butler]

  • DM-45915: dax_apdb timestamps tests fails with testing postgresql installed [dax_apdb]

  • DM-45918: Remove scarlet from pipelines build [meas_extensions_scarlet]

  • DM-45919: Investigate long run times when removing runs using butler remove-runs [daf_butler]

  • DM-45923: Add ability to ingest multiple input injection catalogs to the same dataset ref [source_injection]

  • DM-45933: Query system improvements spurred by integration with QG generation [ctrl_mpexec, daf_butler, pipe_base]

  • DM-45938: Add automatic identifier generation to Felis [felis]

  • DM-45939: Sphgeom is failing to build on conda-forge [sphgeom]

  • DM-45959: Update timing metrics for LoadDiaCatalogsTask [ap_verify]

  • DM-45970: Update spectractor test data cache for new version of calspec standard [Spectractor]

  • DM-45976: Fix units bugs with camera read noise / ptc read noise / effective ptc / variance plane creation [cp_pipe, ip_isr, meas_deblender, pipelines_check]

  • DM-45978: Add webdav support to ResourcePath.to_fsspec [resources]

  • DM-45993: Improve runtimes for butler query-datasets [daf_butler]

  • DM-46002: Error locations in the schema incorrectly reported for constraint objects during validation [felis]

  • DM-46009: Add mount induced image degradation columns to sdm_schema for LATISS and ComCam [sdm_schemas]

  • DM-46014: Look into single frame failures in the processing of the DECam Trifid Nebula dataset [astro_metadata_translator]

  • DM-46021: Fix the RC2 breakage from new warping tasks [pipe_tasks]

  • DM-46025: Make resources s3 tests more robust against external configuration [resources]

  • DM-46032: Fix problems with HSC injection match/analysis pipeline [source_injection]

  • DM-46038: Prefix source injection modules with underscores when lifted entirely into the package scope [source_injection]

  • DM-46046: bps restart with HTCondor doesn’t work with relative path as id [ctrl_bps_htcondor]

  • DM-46050: Speed up packaging alerts in diaPipe [ap_association, ap_pipe]

  • DM-46052: Miscellaneous ISR fixes for issues found in DM-45856 [ip_isr]

  • DM-46061: Add Metrics to calibrate task metadata [analysis_tools, drp_pipe, ip_diffim, pipe_tasks]

  • DM-46064: Support storage class conversions of components in PipelineGraph [pipe_base]

  • DM-46073: Switch consdb to multi-column primary key [sdm_schemas]

  • DM-46077: Bug introduced in DM-45683 [dax_apdb]

  • DM-46081: Update spectractor simbad test cache for latest version of query result. [Spectractor]

  • DM-46082: Allow to specify job requirements in BPS config file for Parsl site Ccin2p3 [ctrl_bps_parsl]

  • DM-46106: Fail gracefully if a validPolygon does not intersect bbox [pipe_tasks]

  • DM-46110: Add Sphinx automodapi to meas_extensions_shapeHSM now that it’s reimplemented in Python [meas_extensions_shapeHSM]

  • DM-46116: Fix out-of-family crosstalk matrix parameters in obs_lsst_data for LSSTCam [cp_pipe, ip_isr, obs_lsst, obs_lsst_data]

  • DM-46122: Replace verify metrics for Completeness and Count based on magnitudes [analysis_tools, ap_pipe, ap_verify]

  • DM-46123: Fix field not found error in subtractImages when re-running source detection [ip_diffim]

  • DM-46129: Add ButlerCollections.query_info end point for remote butler [daf_butler]

  • DM-46135: Remove deprecated finalizedPsfApCorrCatalog from subtractImages [ip_diffim]

  • DM-46139: Investigate signal-related delays in prompt production [resources]

  • DM-46141: Switch subtractImages _sourceSelector to use ScienceSourceSelector [ip_diffim]

  • DM-46145: ci_middleware fails due to step3-direct config mismatch [analysis_tools]

  • DM-46160: Remove spurious writes to scratch in allocateNodes auto noop [ctrl_execute]

  • DM-46164: Export extra columns in plotImageSubtractionCutouts.py [analysis_ap]

  • DM-46172: Build aarch64 wheel for sphgeom and enable conda build [sphgeom]

  • DM-46173: POINT queries in butler do not allow negative declinations in WHERE string [daf_butler]

  • DM-46174: Add a config option to flip XY in CloughTocher2DInterpolation [meas_algorithms]

  • DM-46177: Force LSSTComCamSim instruments to have fixed AZEL values when missing [obs_lsst]

  • DM-46187: Replace MakeWarp with MakeDirectWarp and MakePSFMatchedWarp tasks in the LSST[Com]Cam[Sim] pipelines [drp_pipe]

  • DM-46189: Add pipelines/LSSTCam/cpDarkForDefects.yaml to cp_pipe [cp_pipe]

  • DM-46259: Cryptic error message when specifying detector name and an invalid exposure number [daf_butler]

  • DM-46274: Fix source_injection consolidation masked column handling [source_injection]

  • DM-46287: Make image binning a subtask for IsrTask [ip_isr]

  • DM-46297: Make the label argument to write-curated-calibrations optionally positional and definitely required [obs_base]

  • DM-46298: Make Butler._clone() public [daf_butler, pipe_base]

  • DM-46308: Miscellaneous PTC fixes for issues found in DM-45856 [cp_pipe, ip_isr]

  • DM-46327: Fix failing fgcmBuildStarsBase tasks in LSSTCam/LSSTComCam pipelines [drp_pipe, obs_lsst]

  • DM-46331: Fix test amplifier prescan geometry [afw]

  • DM-46333: Reprocess OR4 with AP pipeline and Cassandra [dax_apdb]

  • DM-46339: Fix glob detection regression in query-datasets [daf_butler]

  • DM-46340: query-datasets CLI failing when run collection specified [daf_butler]

  • DM-46342: Reorder and pad artifact mask handles [drp_tasks]

  • DM-46345: Investigate and solve 1.5-arcsecond discrepancy in mpSky [ap_association]

  • DM-46347: butler.query_dimension_records() does not use governor dimensions from Butler() constructor [daf_butler]

  • DM-46351: Add debug output to _pipeline_graph to signify which task is being added [pipe_base]

  • DM-46352: Fix import for rucio_register [rucio_register]

  • DM-46354: Remove deprecated makeSupplementaryDataGen3 from assembleCoadd [drp_tasks]

  • DM-46357: Create new calibration pipelines for IsrTaskLSST for LSSTComCam/LSSTComCamSim [ap_pipe, cp_pipe, cp_verify, drp_pipe, obs_lsst]

  • DM-46363: Remove dependency on private SqlRegistry interface in dax_obscore [daf_butler, dax_obscore]

  • DM-46366: Fix ISR metadata key inconsistencies between isrTask and isrTaskLSST [ip_isr]

  • DM-46369: Decrease precision in mathematical comparison [pipelines_check]

  • DM-46381: Check forced sources validity in AP association [ap_association]

  • DM-46382: Clean up logging of LoadDiaCatalogsTask and DiaPipelineTask [ap_association]

  • DM-46387: Use Python logging in ctrl_execute [ctrl_execute]

  • DM-46389: Minimal documentation updates for new query system [daf_butler]

  • DM-46401: Queries involving multiple instruments don’t work [daf_butler]

  • DM-46407: Fix unsafe casts in numpy array assignment [meas_astrom]

  • DM-46425: Move DECam precursor step to its own pipeline [drp_pipe]

  • DM-46426: Create new IsrTaskLSST pipeline yaml for CTI [cp_pipe, ip_isr]

  • DM-46486: Update ReferenceObjectLoader to check for flux units before version [meas_algorithms]

  • DM-46492: Fix MultiProFit warnings on ci_imsim [meas_extensions_multiprofit]

  • DM-46513: bps dimension clustering doesn’t work with group and visit [ctrl_bps]

  • DM-46518: New IsrTaskLSST BFK pipeline needs gain ratio fixup [cp_pipe]

  • DM-46525: Flip the default for raise-on-partial-outputs, at least temporarily [ctrl_mpexec]

  • DM-46546: Linearizer residual testing uses a bad starting value for post-linear fit. [cp_pipe]

  • DM-46563: arrow_to_numpy function drops mask information [daf_butler]

  • DM-46567: Fix problems with and test completeness/purity metrics on DC2 [analysis_tools, meas_astrom]

  • DM-46575: Update parquet formatter to use fsspec [daf_butler]

  • DM-46581: slow butler query [daf_butler]

  • DM-46599: Implement old-query-system deprecations to unblock its eventual removal [ap_verify, ctrl_mpexec, daf_butler, obs_base, pipe_base]

  • DM-46601: Switch butler repositories to use nanoseconds for ingest_date [daf_butler]

  • DM-46616: Updated LSSTCam crosstalk matrices were not properly updated [obs_lsst, obs_lsst_data]

  • DM-46628: Migrate postISR median pixel to exposure_quicklook [sdm_schemas]

  • DM-46638: Crosstalk matrix fitGains has extra dummy dimension when read in from an astropy table. [ip_isr]

  • DM-46669: Handle AOS simulated data files with bad FOCUSZ headers [obs_lsst]

  • DM-46689: Check for list index before comparing to previous element in pipetask report cli [ctrl_mpexec]

  • DM-46699: Dummy output of GetRegionTimeFromVisitTask confuses provenance tools [pipe_tasks]

  • DM-46701: Make all URLs in dp02 registry relative [resources]

  • DM-46708: Revert switch to MakeDirectWarp/MakePsfMatchedWarp duo in DRP pipelines [ap_pipe, drp_pipe, obs_lsst, obs_subaru, pipe_tasks]

  • DM-46710: Meas_algorithms failure on linux aarch64 [ip_isr, meas_algorithms]

  • DM-46711: Error message about int64 when using dp02 butler on data-int [daf_butler]

  • DM-46725: Remove empty subsets from injection pipelines [source_injection]

  • DM-46750: Add linearityTurnoff and linearityMaxSignal to linearizer, and use these in fitting the linearity spline [cp_pipe, ip_isr]

  • DM-46768: Fix sdm_schemas typo in order to rerun GHA on main [sdm_schemas]

  • DM-46781: Unqualified butler query-datasets raises EmptyQueryResultError [daf_butler]

  • DM-46794: Fix butler get for seqnum+day_obs [daf_butler]

  • DM-46797: Fix astrometadata translate so it skips bad translations [astro_metadata_translator]

  • DM-46799: Refactor dataset record storage manager [daf_butler]

  • DM-46813: Add sequence_to_range_str function [utils]

  • DM-46844: Need to increase number of open file descriptors in allocateNodes [ctrl_execute, ctrl_platform_s3df]

  • DM-46845: Stop support for execution butler for remote job submission [ctrl_bps_panda]

  • DM-46903: Camera used ph_05 filter instead of ph_5 filter on 20241015 [obs_lsst]

  • DM-46905: ci_imsim failed in analyzeObjectTableSurveyCore [meas_algorithms]

  • DM-46923: Improve handling of Cassandra connection timeouts. [dax_apdb]

  • DM-46925: New curated crosstalk matrices for LSSTComCam cannot be loaded [ip_isr]