ASKAP Science Data Processor software - ASKAPsoft Version 0.18.0

ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:* Calibration* Spectral line imaging* Continuum imaging* Source detection and generation of source catalogs* Transient detectionASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).The processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.ASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:* g++* gfortran* openjdk-7-jdk* python-dev* flex* bison* openmpi-bin* libopenmpi-dev* libfreetype6-dev* libpng12-devMore information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.Source code can be accessed via the links in Related Materials section.-----New features and updates: * Scheduling block state changes, in conjunction with a new TOS release, to introduce a new OBSERVED state. Scheduling blocks will now transition from EXECUTING to OBSERVED and then through to PROCESSING.* Python library updates: - numpy, scipy, matplotlib, pywcs, pytz, and APLpy. The current astropy package has been added, and pyfits removed. - New script Analysis/evaluation/makeThumbnailImage.py, that produces grey-scale plots of continuum images, and has the capability to add weights contours and/or continuum components. * Calibration & Imaging changes: - Residual image is now the residual at the end of the last major cycle. (was the residual at the beginning of the last major cycle.) - The residual images now have units of Jy/beam not Jy/pixel, and have the restoring beam written to the header. - When the "restore preconditioner" option is used in imaging, the residual and psf.image are also written out for this preconditioner.* Pipeline updates: - There is a new pipeline parameter, CCALIBRATOR_MINUV, that allows the bandpass calibration to exclude baseline below some value. - Minor errors and inconsistencies in some catalogue specifications have been fixed, with the polarisation catalogue being updated to v0.7. - The spectral-line catalogue has been added to the CASDA upload part of the pipeline, and has been renamed to incorporate the image name (in the line of other data products). - There are new pipeline parameters SELFCAL_REF_ANTENNA & SELFCAL_REF_GAINS that allow the self-calibration to use a reference antenna and/or gain solution. - A weights cutoff for Selavy can now be specified via the config file using the new parameters SELAVY_WEIGHTS_CUTOFF & SELAVY_SPEC_WEIGHTS_CUTOFF (rather than using the linmos cutoff value). - The new imager is better integrated into the pipeline, with DO_ALT_IMAGER parameters for CONT, CONTCUBE & SPECTRAL. - It is possible to make use of the direct FITS output in the pipeline, by using IMAGETYPE_ parameters for CONT, CONTCUBE & SPECTRAL. Note that this is still somewhat of a work-in-progress.Various bug fixes - See the CHANGES file for details.ASKAPsoft即ASKAP科学数据处理器（ASKAP Science Data Processor），具备以下数据处理功能： * 校准 * 谱线成像 * 连续谱成像 * 源探测与源星表生成 * 暂现源探测 ASKAPsoft是澳大利亚联邦科学与工业研究组织（CSIRO）旗下ASKAP科学数据处理器组件的组成部分，亦是ASKAP系统的核心组件。其作为核心软件，负责原始数据的存储与处理，并启动将生成的科学数据产品归档至数据存档系统（CASDA）的流程。 ASKAPsoft内部的处理流水线大多基于casacore与其他第三方库，采用C++语言编写。该软件在可行范围内采用并行化设计以优化运行性能。 ASKAPsoft可在标准Unix/Linux环境下编译与运行，平台需满足核心依赖条件，包括但不限于C/C++/Fortran编译器、Make工具、Python 2.7、Java 7以及MPI。更多特定依赖项将由ASKAPsoft的构建系统自动下载，并安装至ASKAPsoft开发目录中。针对Debian平台，在完成Debian Wheezy（7.x）的标准安装后，需通过apt-get安装以下软件包： * g++ * gfortran * openjdk-7-jdk * python-dev * flex * bison * openmpi-bin * libopenmpi-dev * libfreetype6-dev * libpng12-dev 有关该软件的构建、安装与运行的更多详情，请参阅本资源集根目录下的README文件。源代码可通过「相关资料（Related Materials）」板块中的链接获取。 -----新功能与更新： * 调度块状态变更：配合新的TOS版本，新增OBSERVED状态。调度块将从EXECUTING状态过渡至OBSERVED状态，随后进入PROCESSING状态。 * Python库更新： - 更新numpy、scipy、matplotlib、pywcs、pytz及APLpy；新增astropy包，移除pyfits包。 - 新增脚本Analysis/evaluation/makeThumbnailImage.py，可生成连续谱图像的灰度图，支持添加权重等高线及/或连续谱分量。 * 校准与成像变更： - 残差图像现已更新为最后一次主循环结束时的残差（此前为最后一次主循环开始时的残差）。 - 残差图像的单位现已更改为Jy/beam，而非Jy/pixel，且将恢复波束信息写入文件头。 - 当在成像中使用「恢复预处理器（restore preconditioner）」选项时，该预处理器对应的残差与psf.image文件也将一并输出。 * 流水线更新： - 新增流水线参数CCALIBRATOR_MINUV，可用于设置带通校准排除低于指定阈值的基线。 - 修复了部分星表规范中的微小错误与不一致问题，其中极化星表已更新至v0.7版本。 - 已将谱线星表纳入流水线的CASDA上传环节，并按照其他数据产品的命名规范，将其重命名以包含图像名称。 - 新增流水线参数SELFCAL_REF_ANTENNA与SELFCAL_REF_GAINS，支持在自校准环节使用参考天线及/或增益解。 - 现已可通过配置文件中的新增参数SELAVY_WEIGHTS_CUTOFF与SELAVY_SPEC_WEIGHTS_CUTOFF，为Selavy指定权重截断阈值（无需再使用linmos的截断值）。 - 新版成像器已更好地集成至流水线中，针对CONT、CONTCUBE及SPECTRAL类型任务新增DO_ALT_IMAGER参数。 - 可通过为CONT、CONTCUBE及SPECTRAL类型任务设置IMAGETYPE_参数，在流水线中直接使用FITS输出功能。请注意该功能目前仍处于开发阶段。 * 各类缺陷修复：详细信息请参阅CHANGES文件。