ASKAP Science Data Processor software - ASKAPsoft Version 0.22.0

ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:* Calibration* Spectral line imaging* Continuum imaging* Source detection and generation of source catalogs* Transient detectionASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).The processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.ASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:* g++* gfortran* openjdk-7-jdk* python-dev* flex* bison* openmpi-bin* libopenmpi-dev* libfreetype6-dev* libpng12-devMore information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.Source code can be accessed via the links in Related Materials section.-----This release sees a number of changes & improvements to both the processing software and the pipeline scripts.Pipelines: * New diagnostic plots produced, esp. for the spectral & continuum cubes. * Improved ability to specify the number of cores used for the continuum imaging. * Behaviour of source-finding in the selfcal has changed. Now fit the full set of Gaussian parameters, and require contiguous pixels for the islands. * Small bug fixes. * Parameter default changes: - DO_MAKE_THUMBNAILS: default true - DO_VALIDATION_SCIENCE: new, default true, to run cube validation. - Snapshot imaging off by default, better image quality. Also, number of w-planes has default value that changes with snapshot option: snapshot imaging has 99, non-snapshot imaging has 599. - Number of channels in MS tile exposed as a parameter for bandpass & science datasets, taking the same default value as previously (54). - "solver.Clean.solutiontype" parameter exposed as a pipeline parameter for all imaging jobs. - SB_JIRA_ISSUE replaced by JIRA_ANNOTATION_PROJECT for schedblock annotations (askapops user only).Applications: * Selavy: - Improved default values in Selavy HI catalogue, and fixed bad NaN values. - Fixed occasional dropping of components from the catalogue through the application of acceptance criteria. Optional, and off by default. - Fixed failing to calculate spectral indices in certain cases. - Deconvolved sizes in the components catalogue now calculated with better floating-point arithmetic, to avoid NaNs. - VOTable catalogue column widths are more tightly controlled, in line with the CASDA software. * Imaging: - Primary beam factory (used by linmos) able to handle elliptical Gaussian beams. Not fully implemented within linmos yet. - New gridder AltWProjectVisGridder that allows the dumping of uvgrids to casa images. - Added caching by channel in spectral-line imaging. - Spectral-line imager correctly writes the beam log when using multiple writers. - Fixed issue with failed beam fitting for very elongated beams.ASKAPsoft，即ASKAP科学数据处理器，可提供各类数据处理功能，涵盖： * 校准 * 谱线成像 * 连续谱成像 * 源探测与源目录生成 * 暂现源探测 ASKAPsoft是CSIRO旗下澳大利亚平方千米阵列探路者（Australian Square Kilometre Array Pathfinder, ASKAP）科学数据处理器组件的一部分，同时也是ASKAP系统的核心组成部分。它是存储与处理原始观测数据、并将最终科学数据产品归档至数据归档系统（CASDA）的核心软件。 ASKAPsoft内的处理流水线大多基于casacore与其他第三方库，采用C++编写。该软件在可行范围内支持并行化以提升运算性能。 ASKAPsoft设计为可在标准Unix/Linux环境中编译与运行，平台需满足核心依赖项要求，包括但不限于C/C++/Fortran编译器、Make、Python 2.7、Java 7以及MPI（消息传递接口）。更多特定依赖项将由ASKAPsoft的构建系统自动下载，并安装至ASKAPsoft的开发目录中。针对Debian平台，在完成Debian Wheezy（7.x）的标准安装后，需通过apt-get安装以下软件包： * g++ * gfortran * openjdk-7-jdk * python-dev * flex * bison * openmpi-bin * libopenmpi-dev * libfreetype6-dev * libpng12-dev 有关该软件的构建、安装与运行的更多信息，可在本数据集文件结构根目录下的README文件中查阅。源代码可通过"相关材料"部分的链接获取。 ----- 本版本对处理软件与流水线脚本均进行了多项改进与更新。 ### 流水线部分： * 新增诊断绘图功能，尤其针对谱线与连续谱立方体数据。 * 优化了连续谱成像所用核心数的指定方式。 * 自校准流程中的源探测行为已更新：当前将拟合全部高斯参数，并要求源岛包含连续像素。 * 修复了若干小缺陷。 * 参数默认值变更： - DO_MAKE_THUMBNAILS（生成缩略图）：默认值设为真 - DO_VALIDATION_SCIENCE（科学数据验证）：新增参数，默认值为真，用于执行立方体数据验证 - 快照成像默认关闭，以获得更优成像质量。此外，w平面数量的默认值会随快照选项变化：启用快照成像时默认值为99，未启用时为599。 - MS分块的通道数已作为带通与科学数据集的参数对外暴露，默认值与此前一致（54）。 - "solver.Clean.solutiontype"参数已作为所有成像任务的流水线参数对外暴露。 - SB_JIRA_ISSUE已替换为JIRA_ANNOTATION_PROJECT，用于观测块注释（仅askapops用户可用）。 ### 应用程序部分： * Selavy： - 优化了Selavy中性氢（HI）源目录的默认参数，并修复了无效NaN值问题。 - 修复了因应用验收准则而偶尔丢失目录中成分的问题（该功能默认为关闭状态，可选启用）。 - 修复了部分场景下无法计算谱指数的问题。 - 成分目录中的去卷积尺寸现已采用更精准的浮点运算进行计算，以避免生成NaN值。 - 虚拟观测表格（VOTable）目录的列宽已进行更严格的控制，以适配CASDA软件要求。 * 成像模块： - 主波束工厂（linmos所使用）现已支持椭圆高斯波束，但linmos中尚未完全实现该功能。 - 新增AltWProjectVisGridder网格化器，支持将uv网格导出为CASA图像。 - 为谱线成像添加了按通道缓存功能。 - 谱线成像器在使用多写入器时，可正确写入波束日志。 - 修复了极细长波束的波束拟合失败问题。