CHANGELOG
As of November 2023, the CHANGELOG
is a feature of our documentation we’ll use to report and summarize changes to downloads from the ScPCA Portal.
You can find more information about how and when your download was prepared in the following places:
The date your download was packaged (
Generated on: {date}
) is included at the top of the README in your download.The version of the
AlexsLemonade/scpca-nf
pipeline used to process data in your download is included in theworkflow_version
column of thesingle_cell_metadata.tsv
orbulk_metadata.tsv
file in your download. For more information aboutAlexsLemonade/scpca-nf
versions, please see the releases page on GitHub.
2024.10.01
You can now use a
Copy Download Link
button to get download links for projects on the ScPCA Portal. Please see the FAQ for more information.
2024.09.24
Metadata for all samples from all projects on the Portal can now be downloaded in a single tab-separated values file.
For more information on what to expect in the metadata file, see the metadata section of the Downloadable files page.
2024.08.13
A new column,
age_timing
, is now present in the sample metadata tables included with each download.This column indicates if the age specified in the
age
column is the age at diagnosis (diagnosis
), age at collection (collection
), orunknown
.This will also be present in the metadata of the
SingleCellExperiment
andAnnData
objects.
AnnData objects have been updated to improve compatibility with
Scanpy
.PCA and UMAP embeddings are now stored as
X_pca
andX_umap
(previouslyX_PCA
andX_UMAP
).A new column has been added to the
.var
slot,highly_variable
, indicating if the given gene can be found in the list of highly variable genes.Parameters and variance weights associated with the PCA results is now available in
.uns["pca"]
.See Components of an AnnData object for more information.
Downloads now follow a new naming convention:
{identifier}_{modality}_{file format}_{date}.zip
For example, a sample (
SCPCS999990
) downloaded on 2024-08-13 in AnnData format will be named:SCPCP999990_SINGLE-CELL_ANN-DATA_2024-08-13.zip
See the Downloadable files page for more information.
2024.08.01
A table containing sample metadata (e.g., age, sex, diagnosis) is now available in both the QC report (
qc.html
) and the supplemental cell type report (celltype-report.html
) included in all downloads.
2024.06.20
Metadata for all samples in a specified project can now be downloaded as a tab-separated values file.
This allows users to download and view all sample, library, project, and processing-related metadata for all samples in a project without having to download all data in a project.
Metadata is also included with each data download.
For more information on what to expect in the metadata files, see the metadata section of the Downloadable files page.
2024.04.26
AnnData
objects are stored in files that now have the extension.h5ad
instead of.hdf5
.A preprint describing the ScPCA Portal and the pipeline used to process data is now available on bioRxiv (DOI: 10.1101/2024.04.19.590243). Please cite this preprint when citing the ScPCA Portal (see How to Cite for more information).
2024.04.18
When downloading data for an entire project, you have the option to download a single file with a single merged object containing all gene expression and metadata for all samples in that project.
These merged objects are available as either
SingleCellExperiment
(.rds
files) orAnnData
(.hdf5
files) objects.This option is available for most projects. If the project you are interested in does not have this option, see our FAQ on which projects can be downloaded as merged objects.
Merged project downloads will contain a brief summary report about the merged object as well as the individual QC and cell type annotation reports for all libraries in the merged object.
See our documentation on how merged objects were created and our FAQ about merged objects for more information.
2024.04.11
Cell type annotations are now included in each download. Cells were annotated using both
SingleR
andCellAssign
.You can find more information about how cell types were annotated in the cell type annotation procedures section on the Processing Information page. For more information on locating cell type annotations and any associated processing information in the downloaded objects see the Single-cell gene expression file contents page.
Downloads also contain a separate cell type report providing more information about cell type annotations, including comparisons between different cell type annotations and diagnostic assessments of cell type annotation reliability.
Sample metadata now includes two additional pieces of information which can be used to filter datasets: Whether the given sample is a patient-derived xenograft, and whether the sample is derived from a cell line.
Processed
SingleCellExperiment
objects no longer include the fullmiQC
result object in their metadata, but themiQC
object is still available in the filteredSingleCellExperiment
objects.Download files with
SingleCellExperiment
objects now usebz2
compression. This means the file sizes will be much smaller, but you may notice slower read times when loading them into R.This release additionally includes community-contributed projects. Community-contributed projects are 10x Genomics single-cell or single-nuclei datasets that have been processed with the ScPCA pipeline. Please refer to the contributions page for more information about community contributions.
2024.03.08
Downloads for most projects are now available in
AnnData
format as HDF5 files. Multiplexed samples are not yet supported.The sample metadata found in
single_cell_metadata.tsv
has been updated to include ontology term ids for age, sex, organism, ethnicity, diagnosis, and tissue location, when available. See the section describing Metadata on the Downloadable Files page.All samples now have an assigned
participant_id
, which can be found insingle_cell_metadata.tsv
. Previously, aparticipant_id
was only assigned when multiple samples mapped to the same participant for most projects.All data files now include both the gene expression data and metadata for each sample (e.g., age, sex, organism, ethnicity, diagnosis, and tissue location). For more information on the contents of the data files, see the Single-cell gene expression file contents page.
Data files will include cell type annotations provided by submitters when applicable.
2023.11.10
The README included in your download now contains the following:
More information about how to cite the ScPCA Portal (see also: How to Cite).
The date your download was packaged (
Generated on: {date}
) at the top of the file.
The root directory of your download will contain the date you accessed and downloaded data from the ScPCA Portal when uncompressed.