Next Article in Journal
The Management of Aortic Coarctation Associated with Hypoplastic Arches and Particular Arch Anatomies: A Literature Review
Previous Article in Journal
Perfusion in Pedicled Skin Flaps: Initial Insights from Smartphone-Based Thermal Imaging Protocol
Previous Article in Special Issue
Data Model for the Comprehensive Management of Biobanks and Its Contribution to Personalized Medicine
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Biobanks as an Indispensable Tool in the “Era” of Precision Medicine: Key Role in the Management of Complex Diseases, Such as Melanoma

1
Radiology and Diagnostic Imaging Unit, Department of Clinical and Dermatological Research, San Gallicano Dermatological Institute IRCCS, 00144 Rome, Italy
2
SAFU, Department of Research, Advanced Diagnostics, and Technological Innovation, IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
3
UOC Oncological Translational Research, IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
4
UOC Pathology Unit, Biobank IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
5
Department of Clinical and Molecular Medicine, Università La Sapienza di Roma, 00185 Rome, Italy
6
Division of Medical Oncology, IRCCS-Regina Elena National Cancer Institute, 00144 Rome, Italy
*
Author to whom correspondence should be addressed.
These authors equally contributed to the manuscript.
J. Pers. Med. 2024, 14(7), 731; https://doi.org/10.3390/jpm14070731
Submission received: 8 June 2024 / Revised: 2 July 2024 / Accepted: 3 July 2024 / Published: 6 July 2024
(This article belongs to the Special Issue Biobank and Biorepository in Personalized Medicine)

Abstract

:
In recent years, medicine has undergone profound changes, strongly entering a new phase defined as the “era of precision medicine”. In this context, patient clinical management involves various scientific approaches that allow for a comprehensive pathology evaluation: from preventive processes (where applicable) to genetic and diagnostic studies. In this scenario, biobanks play an important role and, over the years, have gained increasing prestige, moving from small deposits to large collections of samples of various natures. Disease-oriented biobanks are rapidly developing as they provide useful information for the management of complex diseases, such as melanoma. Indeed, melanoma, given its highly heterogeneous characteristics, is one of the oncologic diseases with the greatest clinical and therapeutic management complexity. So, the possibility of extrapolating tissue, genetic and imaging data from dedicated biobanks could result in more selective study approaches. In this review, we specifically analyze the several biobank types to evaluate their role in technology development, patient monitoring and research of new biomarkers, especially in the melanoma context.

1. Introduction

Since the initial institution, biobanks have been given many definitions that could well delineate their functions. Probably, the Pan-European Biobank and Biomolecular Resources Research Infrastructure (BBMRI) gave the best definition of biobanks as repositories of biological samples and associated information needed for biotechnological advancement, public health and research [1]. Nowadays, the primary aim of personalized medicine is not to find a universal cure but rather the optimal one for each unique patient. This suggests that a deep knowledge of the disease in its various aspects and the ability to stratify patients as much as possible according to common characteristics are essential processes. Biobanks allow for a massive quantity of biological and non-biological materials obtained from great patient populations to be catalogued in a homogeneous and structured manner. This allows for a 360-degree view of pathology by exploring its genetic, phenotypic and molecular aspects [2,3]. In recent decades, biobanks are in an age of high development, since the significant expansion of translational studies requires an increasingly impressive number of biological materials, imaging and related information [4,5]. Unlike what happened in the past, biobanks do not only play the main role of collecting patient samples and/or data but also implement their operations according to standardized procedures and rigid protocols necessary for obtaining reliable and reproducible samples everywhere [6]. The evolution of personalized medicine and the development of omics sciences have resulted in the production of massive quantities of data (big data) associated with the individual disease and, more importantly, the individual patient. Within a broad vision, the cataloging of these data by classical and digital biobanks is, therefore, crucial. Indeed, high quality and orderly accessible samples will allow for the development of more targeted lines of research for the improvement of patient treatments [7,8]. In 2018, an interesting study conducted in China found that hospitals with big biobanks exhibited a scientific and technological output and academic impact of 48.35%, 55.16% and 58.65% higher, respectively, than hospitals with the same characteristics but small biobanks [9]. This result appears extremely important and significant because it highlights the fundamental role of biobanks and their organization in the various stages of scientific processing. The integration of genomic, tissue and imaging data, stored and managed in dedicated biobanks, could be a key breakthrough in the management of complex diseases. Melanoma could benefit by this approach, as it represents a heterogeneous disease with multiple genetic and molecular variants that influence its progression and treatment response. The integration of different data would allow for the development of the large-scale studies necessary for the understanding of still unclear aspects related to melanoma progression, metastases and refractory treatments [10,11].

2. Biobanks: General Aspects

Biobanks represent collections of biological and computational materials and digital images of large patient populations and are responsible for storing, cataloging and preserving personal information, such as medical records, family histories and genetic information, for research aims [3]. Depending on the nature of the material collected, preservation techniques and scope of research, biobanks are a highly heterogeneous reality. To date, a first classification involves “population-based” and “disease-oriented” biobanks. The first ones link molecular data and genetic predispositions of a general population to the development of specific diseases; the second ones, on the other hand, focus their activities on collecting disease-specific samples [8,12]. Additional approaches for classifying biobanks are based on the type of research they intend to support and the types of samples collected, such as tissue, DNA/RNA, blood, etc. [13,14]. Lastly, another category is virtual biobanks, which are electronic archives of biological samples and other related data that are independent and separate from the places where samples are really and physically stored [12,15].
In addition to their primary archival purpose, biobanks (beyond their nature) also arise to standardize procedures for the collection, storage and quality control of banked samples. Integrity in the preservation and quality of samples (combined with their associated biological and digital data), in an era of precision medicine, appears necessary for the development of more complex and large-scale research. For this purpose, in recent years, multi-institutional projects aimed at standardizing biobank procedures have proliferated to ensure that unequivocal and comparable materials can be used by anyone anywhere [3]. In the future, biobanks will need continuous updates to maintain high levels of standardization. The use of new technologies for the management and maintenance of biological and nonbiological data will need to be implemented, and genetic and clinical information will need to be constantly checked and renewed.

2.1. Ethical and Legal Regulation

The use of biological samples and the massive sharing of databases containing genotypic/phenotypic data have generated important ethical questions about the use and disclosure of information closely related to the individual. In this regard, precise and astringent regulations have been developed to protect the privacy and intent of the individual patient/donor. In 1964, the Helsinki Declaration established the basis for regulating human medical research by moving toward more controlled studies. In this sense, that declaration stipulated that any new study on humans should be examined by an independent committee and based on objective results obtained with laboratory animals [16]. Over the years, even following the development of more advanced and sensitive technologies, it has been necessary to implement the regulation related to biomedical research that, to date, must have an informed consent (IC) by the patient. Although there is no international consensus, the purpose of the IC is to enable an individual to decide whether to participate in a research program. All biobanks have delineated a “broad-spectrum” IC to include within it all research purposes related to the biobanking of materials or information. Generally, the ICs of biobanks are highly detailed, but there are common points such as the following [17]:
Description of the materials to be biobanked;
Principles of data sharing with other institutions;
Principles for ‘researchers’ access to data;
Privacy regulations;
Possibility of withdrawal from the study;
Dispositions in case of death;
Principles of non-profit.

2.2. Privacy Policy

A finely regulated aspect of biobank management is the respect of the privacy of all participants. Essentially, personal data are considered private information because they could be personally harmful and a source of discrimination (e.g., information related to HIV or other diseases). Biological or non-biological samples present at all biobanks can be of four types, characterized by a different privacy level. Anonymous samples benefit from the maximum privacy level, as they are not associated with any identity. They are generally collected during screening activities. Anonymized samples, on the other hand, are obtained from identified subjects but suffer a process of anonymization before being used for any purpose. In some circumstances, samples originate from known individuals whose associated data are made available and used through coded information; in this case, the samples are defined as identifiable. Lastly, samples obtained from known individuals whose data are exposed are termed identified [18].

3. Biobank Types

Early biobank types essentially started for the controlled storage of biological materials destined for research or therapeutic purposes. However, with the advancement of new technologies and precision medicine, it naturally became necessary to expand the biobank concept to very varied types of samples. Obviously, different workflows can be differentiated in the various types of biobanks, all of which, however, flow toward the correct and standardized storage of pertinent materials.

3.1. Tissue Biobank

Tissue biobanks are dedicated to the collection of all tissues, especially resulting from surgical retrievals, which allow for the best analysis of a specific pathology. Although paraffin-preserved tissues still dominate, frozen tissue turns out to be the perfect biological sample for the most advanced analytical methods that need nucleic acids and proteins of better quality and yield [19]. Although the collection of frozen samples still appears to be for almost exclusive use by research programs, they will soon be “bread and butter” for biobanks. Indeed, in recent years, increasingly reliable and accurate sequencing methods are entering the clinical scenario in a strong manner, thus prompting the management of an increasing number of frozen samples [4]. Particularly in oncology, where an extensive study of the tumor is necessary for the clinical management of the patient, tissues are processed to obtain cell lines, organoids, DNA and RNA. All of this information, indeed, will allow for a deeper analysis of each individual tumor and will point toward precision medicine. Both frozen and formalin-fixed and paraffin-embedded tissues present benefits and limitations [20,21]. Paraffin-embedded tissues, albeit easier to manage because they are stored at room temperature in nonspecific storage facilities, do not always allow for the acquisition of materials of adequate quality, especially for more advanced sequencing techniques [21]. Samples stored at ultra-low temperatures can potentially be archived for decades, preserving a high quality of DNA and RNA and even protein enzyme activity. However, not all biobanks have the necessary personnel or infrastructure to store frozen biological samples. In addition, the preservation of these samples also needs very high-quality standards because several pathogens are able to survive at low temperatures [4] (Figure 1).

3.2. Cell and Organoid Biobank

A large part of scientific research, in particular oncology research, involves the use of cell systems needed for initial drug-screening and/or molecular profiling analyses. Frequently, the cell lines used in various laboratories may not match or may be incorrectly identified. Therefore, it has been necessary to establish cell biobanks to provide users with standardized and reliable information on the origin of each line, correct expansion procedures and maintain cultures (Figure 1). Not surprisingly, the scientific community requires the acceptance of scientific work and periodic authentication of the cell lines used by certified institutions, such as the American Type Culture Collection (https://www.atcc.org, accessed on 1 July 2024), Leibniz Institute DSMZ-German Collection of Microorganisms (https://www.dsmz.de, accessed on 1 July 2024), European Collection of Authenticated Cell Cultures (https://www.culturecollections.org.uk/about-us/ecacc, accessed on 1 July 2024) and others. In addition, the establishment of tissue biobanks at hospitals and research institutes has implemented the possibility of producing new cell lines directly from patients’ surgical pieces [22]. Also, in this case, the standardization of isolation processes and appropriate biobanking are necessary for obtaining valid and reproducible scientific results.
Cell lines, although isolated from patients, are a very simplified model that cannot reflect the entire characteristics and components of the original tissue. Thus, while optimal for early study phases, they need the support of other, more complex approaches. In recent years, scientific research has been focusing on complex three-dimensional, multicellular structures, defined as “organoids”, that recapitulate the original tissue after insertion into a 3D matrix [23] (Figure 1). Particularly in oncology, this new approach is revolutionary because it permits an organized structure that retains most of the components of the tissue to be reproduced on the plate. Clearly, this results in a more complete view of the tumor and the possibility of more personalized analysis and screening. Of course, the use of organoids is not only limited to cancer research, but they can be implicated for regenerative medicine, such as that focused on organ development, and new drug testing [24,25]. In view of this great scientific potential, a number of organoid biobanks are being implemented [26,27,28,29,30]. In parallel with the great potential, unlike other biobanks, those of organoids have important limitations. These are essentially related to a still poor standardization of both isolation and preservation processes connected with the high heterogeneity of the origin tissues. In addition, it is still very complex to maintain all tumor heterogeneity in the organoid because part of the immune system is lost early on [31].

3.3. Liquid Biobank

Blood represents an inestimable source of information, and the study of its components and their variations is commonly used in basic and translational scientific research. Especially in oncology, blood (but also other fluids, such as urine, saliva and cerebrospinal fluid) is emerging as a valuable and alternative approach to understanding the tumor. In blood, indeed, circulating tumor cells and their genetic material, released as a result of their death or cell division, are present [32]. So, their study and monitoring over time can provide precious information to clinicians for disease clinical management and are fertile ground for the research of new tumor biomarkers [32]. For this reason, in recent years, tissue biobanks have been supported by liquid biobanks, constituting an invaluable source of scientific information (Figure 2).
Depending on the needs and tests to be performed, blood may be collected in its entirety or divided into plasma and serum. Conservatives and additives in the tubes used for blood collection may vary according to the specific application [33,34]. Serum is necessary in some biochemical tests, while tests based on DNA and/or RNA analysis require coagulated blood (including plasma, buffy coat and red blood cells). For whole-blood samples, 6 mL labeled vacutainer tubes with the anti-coagulant Na2-EDTA are used, whereas for blood serum, 6 mL labeled vacutainer tubes containing a thixotropic barrier gel at the bottom of the tube are preferred [35]. All blood components are easily degraded, and therefore, their processing and storage require a short time. The maximum time between sample collection and processing depends on the component to be analyzed [33]. Generally, samples should be maintained at 4 °C, and an interval of 24 h between collection and processing is considered an acceptable time [36] (Figure 2).

3.4. Imaging Biobank

The development of ever more sensitive diagnostic imaging technologies and the onset of artificial intelligence (AI) have allowed for a new study approach: radiomics. This approach, although not yet clinically validated, is powerfully emerging, especially in the study of many cancer forms, because, by extracting tumor-specific quantitative features from biomedical radiological images, it can help in treatment optimization and patient management [10,37]. Specifically, radiomics, in combination with tumor texture analysis, may provide information on new imaging biomarkers to associate with already known molecular biomarkers [37]. Obviously, these methodological approaches require technological training and a massive amount of digital data. For this reason, the creation of imaging biobanks is essential. Imaging biobanks are virtual infrastructures with massive storage capacities and, therefore, require standardization and validation procedures for the elaborated images [38] (Figure 3).
The European Society of Radiology (ESR) defined an imaging biobank as medical and biomarker imaging shared among multiple researchers [38]. An example is represented by the Imaging Data Commons (IDC) that provides open access to oncology imaging collections supported by patient’s clinical data (https://portal.imaging.datacommons.cancer.gov, accessed on 1 July 2024). The IDC follows FAIR (findable, accessible, interoperable, reusable) principles to ensure the interoperability and consistency of the data. All data are harmonized in the DICOM format to promote search standardization and analysis [39]. High-performance standard infrastructures, such as the Minimum Information About Biobank Data Sharing Initiative (MIABIS) (https://www.bbmri-eric.eu/howtomiabis, accessed on 1 July 2024) and Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) (https://www.ohdsi.org/data-standardization, accessed on 1 July 2024) facilitate the exchange and systematic analysis of data, ensuring traceability, accessibility and interoperability following the FAIR principles [40].
Although not yet as developed as the biobanks of biological samples, the imaging ones, in recent years, are known to have a very prosperous era of development, and the evidence lies in the several projects that are being developed [40]. For example, a massive British study, started in 2006, biobanked imaging data on the brains, hearts, abdominal composition, bones, joints and blood vessels of 100,000 participants. This has resulted in a wealth of information that, linked to phenotypic and genetic sources, is an indispensable resource for solving current unanswered clinical questions [41]. In oncology, an Italian project (NAVIGATOR) aims at the development of an imaging biobank aimed at collecting and storing a large amount of standardized multimodal imaging datasets, including computed tomography data, MRI and positron emission tomography, with patient information and omic analysis. Data from patients with prostate, rectal and gastric cancer will be used to create a digital model of the patient, supporting reliable prediction of the disease phenotype and risk stratification [42]. Additional international projects aim to develop artificial intelligence platforms that can integrate data and imaging models to fuel and support precision medicine [43,44]. As described above, image biobanks find fertile ground, especially in the tumor field, because cancer patients often carry out serial controls (with different imaging protocols) [40]. Patients with metastatic melanoma, for example, are subjected to radiological controls periodically during the disease follow-up and for the monitoring of target therapies and immunotherapy response.

3.5. Digital Biobank

The large quantity of biomedical data of a genetic, imaging and diagnostic nature is an invaluable source of information on which scientific research can draw. This is, however, only possible if these data can be easily accessed by all in a standardized and controlled manner. Digital biobanks are created precisely for the purpose of facilitating the sharing of data of various types necessary for the development of a personalized approach and management of individual disease. The digital biobank is a supporting infrastructure in which the integration of various omics data (genomic, proteomic, metabolomic, radiomic) is possible for a disease-comprehensive approach [8]. Although digital biobanks have enormous potential, to date, they are still poorly developed, and approaches on how to implement their use in translational medicine are still lacking. One reason lies in the need for cooperation among the different professionals involved (biologists, pathologists, clinicians, informaticians) and the development of new advanced algorithms and computer-aided techniques.
Examples of digital biobanks are the following:
  • Cancer Genome Atlas (TCGA) is a digital biobank focused on oncological research that provides public access to an extensive catalog of genomic and epigenomic data (https://portal.gdc.cancer.gov, accessed on 1 July 2024) [45];
  • The European Genome and Phenome Archive (EGA) is a digital biobank focused on storing genetic, phenotypic and clinical data from different research projects while maintaining control over access to data at the sender level (https://ega-archive.org, accessed on 1 July 2024) [46];
  • The Global Alliance for Genomics and Health (GA4GH) is an advanced digital biobank that addresses the challenges of the growing production of sequencing data from diverse study populations (https://www.ga4gh.org, accessed on 1 July 2024) [47];
  • U.K. Biobank aims to collect, store and manage information and samples from 5,000,000 participants to enable genetic and nongenetic investigations of diseases of aging. It is among the most efficient digital entities and enables sharing through online platforms and systems (https://www.ukbiobank.ac.uk, accessed on 1 July 2024) [48].

4. Biobank Sustainability

Biobanks (biological and digital) need constant funding for their sustainability. Over the past decades, the exponential increase in biobank data has implemented costs related to management, maintenance and involvement of dedicated staff. Often, due to their non-profit nature, the financial resources of biobanks are linked to public funding for research [3,49]. Obviously, this kind of financial approach cannot be “long-term” but is closely related to the funding period, which, in most cases, fails to cover all costs related to sample collection, sample processing, management and distribution and all expenses related to infrastructure and administration. In more than a few cases, biobanks have had to stop their activities due to a lack of appropriate funding. A striking example was the failure of the Singapore biobank, established in 2002, that was forced to close a few years later due to insufficient government aid in the face of high operating costs [49]. One of the most influential aspects of biobank finance is the cost of materials, energy and space dedicated to the physical storage of biological and digital samples. In this regard, meetings of the International Society for Biological and Environmental Repositories (ISBER) (https://www.isber.org/, accessed on 1 July 2024) and the European Middle Eastern and African Society for Biopreservation and Biobanking (ESBB) (https://esbb.org, accessed on 1 July 2024), focused on cost management related to the energy consumption, waste materials, circular economy and economic sustainability of biobanks, have been held punctually in recent years [50].
Biobank sustainability is closely connected not only with its ability to self-manage available finances but also to raise new funds. This is only possible if the biobank is able to establish external scientific collaborations by contributing with standardized data [51]. Access to quality samples and data and high project completion rates are critical to the success of a biobank. Having a well-structured project allows for biobanks to provide critical resources for global scientific research, ensuring safety, sample quality and the input needed, so that the data do not remain confined to its own biobank but are the subject of collaboration and studies on multiple fronts.

5. Melanoma Precision Medicine: Biobanking Role

Melanoma represents only a small percentage of skin cancers, but of all of them, it is the leading cause of death each year of an estimated number of people. It is a multifactorial disease in that environmental, behavioral and genetic factors contribute to its onset [11]. Genetically, melanoma is fairly well-defined, and although the mutations that fuel it can be many, the major ones (also in terms of percentage of cases) are those affecting the genes necessary for cell proliferation, such as BRAF and NRAS [10,52]. In recent years, it has been one of the cancers that has greatly benefited, in terms of survival, from the advent of target therapies and immunotherapy. Nevertheless, many aspects about its genesis, progression and development of resistance to treatments remain unclear. Moreover, its high biological complexity (also related to the close interconnections it establishes with its microenvironment) makes the study of melanoma still very active and proliferative [11]. Given its highly heterogeneous characteristics, melanoma still emerges as an open challenge in the development of new therapies and the discovery of new biomarkers. Indeed, despite the progress made, still too many patients suffer disease progression or do not respond to treatments in any way [53,54]. An important aspect on which the research is focusing, not only for melanoma but also for other skin cancers, concerns the study of tumor heterogeneity between different patients. Simply, not all melanoma cases with similar characteristics respond in the same manner to treatments, further highlighting the need for personalized medicine structured on a single clinical case [55] (Figure 4).
Therefore, it is clear that biobanking and the integration of data from different sources are invaluable sources to draw on for the understanding of still obscure melanoma aspects. Although not yet as developed as in the case of other pathologies, melanoma biobanks are slowly emerging as new realities. As previously mentioned, compared with other diseases, melanoma-oriented biobanks are still in the embryonic and defining stages. A recent and interesting prospective study, called BioMel, has set the basis for the creation of a melanoma biobank in which biological samples, epidemiological information and medical data of patients with primary and advanced melanoma or equivocal lesions are collected (https://biomel.org, accessed on 1 July 2024). The primary aim of this project is to improve diagnostics, prognostics and therapy outcomes of melanoma patients. BioMel represents an almost unique biobanking reality, as at the time of its establishment, there were no other biobanks in Europe able to collect and catalog tissue and blood samples from melanoma patients in a standardized manner [56]. An important role in melanoma biobanking is played by the Melanoma Institute Australia (MIA) Biospecimen Bank, the largest collection of melanoma tissue samples from 10,000 patients (https://melanoma.org.au, accessed on 1 July 2024). This rapidly developing entity has enabled the development of numerous projects for the analysis and research of new prognostic markers in melanoma [57,58,59]. In addition to these two established entities, other melanoma biobanks are emerging in recent years, indicating the importance of a more extensive and large-scale study for this disease. One example is the Cancer Moonshot Biobank-Melanoma Collection (https://moonshotbiobank.cancer.gov, accessed on 1 July 2024), established in 2016, which collects healthy and tumor samples from melanoma patients. Recently, a study based on the use of these samples highlighted the high genomic and transcriptomic complexity of melanoma and the need for personalized treatment [60].
Melanoma follow-up involves the periodic evaluation of radiological investigations of various types. So, for this pathology, the amount of imaging data available is extremely significant, and several studies have shown that the image analysis makes it possible to obtain important information about prognosis and treatment response [37,61,62,63]. Although it is clear that this approach can help improve the study and comprehension of melanoma, including by identifying new imaging biomarkers, dedicated biobanks for this pathology are not yet available. This appears to be a great limitation because the imaging could be integrated with the biological data already available, creating study platforms with high scientific relevance.

6. Future Perspective and Conclusions

The last few decades revolutionized the concept of medicine and therapy, no more seen in their generality but associated with the individual. The ability to draw from endless sources of biological and imaging data is linked to sensitive biobanking processes. Although the way is promising, much still needs to be implemented in order to achieve 100% functional biobanks. The starting point will be to reorganize less-structured biobanks, such as imaging biobanks, by implementing them with genomic and clinical data, exploiting, where possible, AI and machine learning to identify new biomarkers and, thus, actively contribute to precision medicine. One of the weaknesses, indeed, is the lack of interconnection and communication between the various players involved in biobanking. A major effort will be the development of secure, open-access platforms for accessing biobanked data, so that the information can be accessed by more researchers either from within or outside the target institution but in complete privacy and security. In an increasingly digital era, the safeguarding of individual data, indeed, must remain a solid point in the governance of biobanks through defined legislation.
The economic aspect will be no less important in the future. The management of billions of data is expensive and constantly requires economic sources to draw on. Biobanks have undefined costs that can evolve over time. Indeed, even depending on their objective, they are expensive in terms of personnel, equipment, consumables, etc. [64]. To date, biobanks are not able to fully meet their costs but must rely on funding linked to research projects or donations. Support from local public authorities would also be desirable for the future. The implementation of business plan systems, the creation of public–private collaborations and, especially, long-term funding policies would ensure greater input into scientific research. In addition, introducing AI into biobank management could optimize workflows and reduce operational costs.

Author Contributions

Conceptualization, A.V. and I.F.; formal analysis, F.V.; investigation, writing—original draft preparation, A.V. and I.F.; writing—review and editing, M.R., L.M., M.T.M. and M.C.; visualization, S.D.M., E.R., F.D. and F.V.; supervision, A.G.; funding acquisition, A.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Italian Ministry of Health (Ricerca Corrente 2024).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Asslaber, M.; Zatloukal, K. Biobanks: Transnational, European and global networks. Brief. Funct. Genom. Proteomic 2007, 6, 193–201. [Google Scholar] [CrossRef] [PubMed]
  2. Cambon-Thomsen, A. The social and ethical issues of post-genomic human biobanks. Nat. Rev. Genet. 2004, 5, 866–873. [Google Scholar] [CrossRef] [PubMed]
  3. Annaratone, L.; De Palma, G.; Bonizzi, G.; Sapino, A.; Botti, G.; Berrino, E.; Mannelli, C.; Arcella, P.; Di Martino, S.; Steffan, A.; et al. Basic principles of biobanking: From biological samples to precision medicine for patients. Virchows Arch. 2021, 479, 233–246. [Google Scholar] [CrossRef] [PubMed]
  4. Shabihkhani, M.; Lucey, G.M.; Wei, B.; Mareninov, S.; Lou, J.J.; Vinters, H.V.; Singer, E.J.; Cloughesy, T.F.; Yong, W.H. The procurement, storage, and quality assurance of frozen blood and tissue biospecimens in pathology, biorepository, and biobank settings. Clin. Biochem. 2014, 47, 258–266. [Google Scholar] [CrossRef] [PubMed]
  5. Krishnamurthy, S. Biospecimen repositories and cytopathology. Cancer Cytopathol. 2015, 123, 152–161. [Google Scholar] [CrossRef] [PubMed]
  6. Vaught, J.; Lockhart, N.C. The evolution of biobanking best practices. Clin. Chim. Acta 2012, 413, 1569–1575. [Google Scholar] [CrossRef]
  7. Carey, D.J.; Fetterolf, S.N.; Davis, F.D.; Faucett, W.A.; Kirchner, H.L.; Mirshahi, U.; Murray, M.F.; Smelser, D.T.; Gerhard, G.S.; Ledbetter, D.H. The Geisinger MyCode community health initiative: An electronic health record-linked biobank for precision medicine research. Genet. Med. 2016, 18, 906–913. [Google Scholar] [CrossRef] [PubMed]
  8. Coppola, L.; Cianflone, A.; Grimaldi, A.M.; Incoronato, M.; Bevilacqua, P.; Messina, F.; Baselice, S.; Soricelli, A.; Mirabelli, P.; Salvatore, M. Biobanking in health care: Evolution and future directions. J. Transl. Med. 2019, 17, 172. [Google Scholar] [CrossRef]
  9. Zhang, Y.; Bian, Z.; Chen, Y.; Jiang, E.; Chen, T.; Wang, C. Positive association between research competitiveness of Chinese academic hospitals and the scale of their biobanks: A national survey. Clin. Transl. Sci. 2022, 15, 2909–2917. [Google Scholar] [CrossRef]
  10. Valenti, F.; Falcone, I.; Ungania, S.; Desiderio, F.; Giacomini, P.; Bazzichetto, C.; Conciatori, F.; Gallo, E.; Cognetti, F.; Ciliberto, G.; et al. Precision Medicine and Melanoma: Multi-Omics Approaches to Monitoring the Immunotherapy Response. Int. J. Mol. Sci. 2021, 22, 3837. [Google Scholar] [CrossRef]
  11. Falcone, I.; Conciatori, F.; Bazzichetto, C.; Ferretti, G.; Cognetti, F.; Ciuffreda, L.; Milella, M. Tumor Microenvironment: Implications in Melanoma Resistance to Targeted Therapy and Immunotherapy. Cancers 2020, 12, 2870. [Google Scholar] [CrossRef]
  12. Harati, M.D.; Williams, R.R.; Movassaghi, M.; Hojat, A.; Lucey, G.M.; Yong, W.H. An Introduction to Starting a Biobank. Methods Mol. Biol. 2019, 1897, 7–16. [Google Scholar] [CrossRef] [PubMed]
  13. Watson, P.H.; Barnes, R.O. A proposed schema for classifying human research biobanks. Biopreserv. Biobank. 2011, 9, 327–333. [Google Scholar] [CrossRef] [PubMed]
  14. Mendy, M.; Caboux, E.; Lawlor, R.T.; Wright, J.; Wild, C.P. Common Minimum Technical Standards and Protocols for Biobanks Dedicated to Cancer Research; International Agency for Research on Cancer: Lyon, France, 2017. [Google Scholar]
  15. De Souza, Y.G.; Greenspan, J.S. Biobanking past, present and future: Responsibilities and benefits. AIDS 2013, 27, 303–312. [Google Scholar] [CrossRef] [PubMed]
  16. World Medical, A. World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA 2013, 310, 2191–2194. [Google Scholar] [CrossRef]
  17. Hansson, M.G. Ethics and biobanks. Br. J. Cancer 2009, 100, 8–12. [Google Scholar] [CrossRef] [PubMed]
  18. Xiang, D.; Cai, W. Privacy Protection and Secondary Use of Health Data: Strategies and Methods. Biomed. Res. Int. 2021, 2021, 6967166. [Google Scholar] [CrossRef] [PubMed]
  19. Tang, W.; Hu, Z.; Muallem, H.; Gulley, M.L. Quality assurance of RNA expression profiling in clinical laboratories. J. Mol. Diagn. 2012, 14, 1–11. [Google Scholar] [CrossRef] [PubMed]
  20. Naber, S.P. Continuing role of a frozen-tissue bank in molecular pathology. Diagn. Mol. Pathol. 1996, 5, 253–259. [Google Scholar] [CrossRef]
  21. Shi, S.R.; Liu, C.; Pootrakul, L.; Tang, L.; Young, A.; Chen, R.; Cote, R.J.; Taylor, C.R. Evaluation of the value of frozen tissue section used as “gold standard” for immunohistochemistry. Am. J. Clin. Pathol. 2008, 129, 358–366. [Google Scholar] [CrossRef]
  22. Bruschini, S.; di Martino, S.; Pisanu, M.E.; Fattore, L.; De Vitis, C.; Laquintana, V.; Buglioni, S.; Tabbi, E.; Cerri, A.; Visca, P.; et al. CytoMatrix for a reliable and simple characterization of lung cancer stem cells from malignant pleural effusions. J. Cell Physiol. 2020, 235, 1877–1887. [Google Scholar] [CrossRef] [PubMed]
  23. Clevers, H. Modeling Development and Disease with Organoids. Cell 2016, 165, 1586–1597. [Google Scholar] [CrossRef] [PubMed]
  24. Willyard, C. The boom in mini stomachs, brains, breasts, kidneys and more. Nature 2015, 523, 520–522. [Google Scholar] [CrossRef] [PubMed]
  25. Dekkers, J.F.; van der Ent, C.K.; Beekman, J.M. Novel opportunities for CFTR-targeting drug development using organoids. Rare Dis. 2013, 1, e27112. [Google Scholar] [CrossRef] [PubMed]
  26. Yu, Y.Y.; Zhu, Y.J.; Xiao, Z.Z.; Chen, Y.D.; Chang, X.S.; Liu, Y.H.; Tang, Q.; Zhang, H.B. The pivotal application of patient-derived organoid biobanks for personalized treatment of gastrointestinal cancers. Biomark. Res. 2022, 10, 73. [Google Scholar] [CrossRef] [PubMed]
  27. van de Wetering, M.; Francies, H.E.; Francis, J.M.; Bounova, G.; Iorio, F.; Pronk, A.; van Houdt, W.; van Gorp, J.; Taylor-Weiner, A.; Kester, L.; et al. Prospective derivation of a living organoid biobank of colorectal cancer patients. Cell 2015, 161, 933–945. [Google Scholar] [CrossRef] [PubMed]
  28. Mazzucchelli, S.; Piccotti, F.; Allevi, R.; Truffi, M.; Sorrentino, L.; Russo, L.; Agozzino, M.; Signati, L.; Bonizzi, A.; Villani, L.; et al. Establishment and Morphological Characterization of Patient-Derived Organoids from Breast Cancer. Biol. Proced. Online 2019, 21, 12. [Google Scholar] [CrossRef] [PubMed]
  29. Beshiri, M.L.; Tice, C.M.; Tran, C.; Nguyen, H.M.; Sowalsky, A.G.; Agarwal, S.; Jansson, K.H.; Yang, Q.; McGowen, K.M.; Yin, J.; et al. A PDX/Organoid Biobank of Advanced Prostate Cancers Captures Genomic and Phenotypic Heterogeneity for Disease Modeling and Therapeutic Screening. Clin. Cancer Res. 2018, 24, 4332–4345. [Google Scholar] [CrossRef] [PubMed]
  30. Jacob, F.; Salinas, R.D.; Zhang, D.Y.; Nguyen, P.T.T.; Schnoll, J.G.; Wong, S.Z.H.; Thokala, R.; Sheikh, S.; Saxena, D.; Prokop, S.; et al. A Patient-Derived Glioblastoma Organoid Model and Biobank Recapitulates Inter- and Intra-tumoral Heterogeneity. Cell 2020, 180, 188–204.e122. [Google Scholar] [CrossRef]
  31. Gilazieva, Z.; Ponomarev, A.; Rutland, C.; Rizvanov, A.; Solovyeva, V. Promising Applications of Tumor Spheroids and Organoids for Personalized Medicine. Cancers 2020, 12, 2727. [Google Scholar] [CrossRef]
  32. Ricciardi, E.; Giordani, E.; Ziccheddu, G.; Falcone, I.; Giacomini, P.; Fanciulli, M.; Russillo, M.; Cerro, M.; Ciliberto, G.; Morrone, A.; et al. Metastatic Melanoma: Liquid Biopsy as a New Precision Medicine Approach. Int. J. Mol. Sci. 2023, 24, 4014. [Google Scholar] [CrossRef] [PubMed]
  33. Holland, N.T.; Smith, M.T.; Eskenazi, B.; Bastaki, M. Biological sample collection and processing for molecular epidemiological studies. Mutat. Res. 2003, 543, 217–234. [Google Scholar] [CrossRef] [PubMed]
  34. Gillio-Meina, C.; Cepinskas, G.; Cecchini, E.L.; Fraser, D.D. Translational research in pediatrics II: Blood collection, processing, shipping, and storage. Pediatrics 2013, 131, 754–766. [Google Scholar] [CrossRef] [PubMed]
  35. Bonizzi, G.; Zattoni, L.; Capra, M.; Cassi, C.; Taliento, G.; Ivanova, M.; Guerini-Rocco, E.; Fumagalli, M.; Monturano, M.; Albini, A.; et al. Standard operating procedures for biobank in oncology. Front. Mol. Biosci. 2022, 9, 967310. [Google Scholar] [CrossRef] [PubMed]
  36. Halsall, A.; Ravetto, P.; Reyes, Y.; Thelwell, N.; Davidson, A.; Gaut, R.; Little, S. The quality of DNA extracted from liquid or dried blood is not adversely affected by storage at 4 degrees C for up to 24 h. Int. J. Epidemiol. 2008, 37 (Suppl. 1), i7–i10. [Google Scholar] [CrossRef] [PubMed]
  37. Guerrisi, A.; Russillo, M.; Loi, E.; Ganeshan, B.; Ungania, S.; Desiderio, F.; Bruzzaniti, V.; Falcone, I.; Renna, D.; Ferraresi, V.; et al. Exploring CT Texture Parameters as Predictive and Response Imaging Biomarkers of Survival in Patients With Metastatic Melanoma Treated With PD-1 Inhibitor Nivolumab: A Pilot Study Using a Delta-Radiomics Approach. Front. Oncol. 2021, 11, 704607. [Google Scholar] [CrossRef] [PubMed]
  38. European Society of Radiology (ESR). ESR Position Paper on Imaging Biobanks. Insights Imaging 2015, 6, 403–410. [Google Scholar] [CrossRef] [PubMed]
  39. Fedorov, A.; Longabaugh, W.J.R.; Pot, D.; Clunie, D.A.; Pieper, S.D.; Gibbs, D.L.; Bridge, C.; Herrmann, M.D.; Homeyer, A.; Lewis, R.; et al. National Cancer Institute Imaging Data Commons: Toward Transparency, Reproducibility, and Scalability in Imaging Artificial Intelligence. Radiographics 2023, 43, e230180. [Google Scholar] [CrossRef]
  40. Gabelloni, M.; Faggioni, L.; Borgheresi, R.; Restante, G.; Shortrede, J.; Tumminello, L.; Scapicchio, C.; Coppola, F.; Cioni, D.; Gomez-Rico, I.; et al. Bridging gaps between images and data: A systematic update on imaging biobanks. Eur. Radiol. 2022, 32, 3173–3186. [Google Scholar] [CrossRef]
  41. Littlejohns, T.J.; Holliday, J.; Gibson, L.M.; Garratt, S.; Oesingmann, N.; Alfaro-Almagro, F.; Bell, J.D.; Boultwood, C.; Collins, R.; Conroy, M.C.; et al. The UK Biobank imaging enhancement of 100,000 participants: Rationale, data collection, management and future directions. Nat. Commun. 2020, 11, 2624. [Google Scholar] [CrossRef]
  42. Borgheresi, R.; Barucci, A.; Colantonio, S.; Aghakhanyan, G.; Assante, M.; Bertelli, E.; Carlini, E.; Carpi, R.; Caudai, C.; Cavallero, D.; et al. NAVIGATOR: An Italian regional imaging biobank to promote precision medicine for oncologic patients. Eur. Radiol. Exp. 2022, 6, 53. [Google Scholar] [CrossRef] [PubMed]
  43. Marti-Bonmati, L.; Alberich-Bayarri, A.; Ladenstein, R.; Blanquer, I.; Segrelles, J.D.; Cerda-Alberich, L.; Gkontra, P.; Hero, B.; Garcia-Aznar, J.M.; Keim, D.; et al. PRIMAGE project: Predictive in silico multiscale analytics to support childhood cancer personalised evaluation empowered by imaging biomarkers. Eur. Radiol. Exp. 2020, 4, 22. [Google Scholar] [CrossRef]
  44. Kondylakis, H.; Kalokyri, V.; Sfakianakis, S.; Marias, K.; Tsiknakis, M.; Jimenez-Pastor, A.; Camacho-Ramos, E.; Blanquer, I.; Segrelles, J.D.; Lopez-Huguet, S.; et al. Data infrastructures for AI in medical imaging: A report on the experiences of five EU projects. Eur. Radiol. Exp. 2023, 7, 20. [Google Scholar] [CrossRef]
  45. Gao, G.F.; Parker, J.S.; Reynolds, S.M.; Silva, T.C.; Wang, L.B.; Zhou, W.; Akbani, R.; Bailey, M.; Balu, S.; Berman, B.P.; et al. Before and After: Comparison of Legacy and Harmonized TCGA Genomic Data Commons’ Data. Cell Syst. 2019, 9, 24–34.e10. [Google Scholar] [CrossRef] [PubMed]
  46. Freeberg, M.A.; Fromont, L.A.; D‘Altri, T.; Romero, A.F.; Ciges, J.I.; Jene, A.; Kerry, G.; Moldes, M.; Ariosa, R.; Bahena, S.; et al. The European Genome-phenome Archive in 2021. Nucleic Acids Res. 2022, 50, D980–D987. [Google Scholar] [CrossRef] [PubMed]
  47. Rehm, H.L.; Page, A.J.H.; Smith, L.; Adams, J.B.; Alterovitz, G.; Babb, L.J.; Barkley, M.P.; Baudis, M.; Beauvais, M.J.S.; Beck, T.; et al. GA4GH: International policies and standards for data sharing across genomic research and healthcare. Cell Genom. 2021, 1, 100029. [Google Scholar] [CrossRef] [PubMed]
  48. Sudlow, C.; Gallacher, J.; Allen, N.; Beral, V.; Burton, P.; Danesh, J.; Downey, P.; Elliott, P.; Green, J.; Landray, M.; et al. UK biobank: An open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 2015, 12, e1001779. [Google Scholar] [CrossRef] [PubMed]
  49. Abdaljaleel, M.; Singer, E.J.; Yong, W.H. Sustainability in Biobanking. Methods Mol. Biol. 2019, 1897, 1–6. [Google Scholar] [CrossRef] [PubMed]
  50. Rao, A.; Vaught, J.; Tulskie, B.; Olson, D.; Odeh, H.; McLean, J.; Moore, H.M. Critical Financial Challenges for Biobanking: Report of a National Cancer Institute Study. Biopreserv. Biobank. 2019, 17, 129–138. [Google Scholar] [CrossRef]
  51. Rush, A.; Catchpoole, D.R.; Ling, R.; Searles, A.; Watson, P.H.; Byrne, J.A. Improving Academic Biobank Value and Sustainability Through an Outputs Focus. Value Health 2020, 23, 1072–1078. [Google Scholar] [CrossRef]
  52. Ostrowski, S.M.; Fisher, D.E. Biology of Melanoma. Hematol. Oncol. Clin. North Am. 2021, 35, 29–56. [Google Scholar] [CrossRef] [PubMed]
  53. Lim, S.Y.; Shklovskaya, E.; Lee, J.H.; Pedersen, B.; Stewart, A.; Ming, Z.; Irvine, M.; Shivalingam, B.; Saw, R.P.M.; Menzies, A.M.; et al. The molecular and functional landscape of resistance to immune checkpoint blockade in melanoma. Nat. Commun. 2023, 14, 1516. [Google Scholar] [CrossRef] [PubMed]
  54. Tangella, L.P.; Clark, M.E.; Gray, E.S. Resistance mechanisms to targeted therapy in BRAF-mutant melanoma—A mini review. Biochim. Biophys. Acta Gen. Subj. 2021, 1865, 129736. [Google Scholar] [CrossRef] [PubMed]
  55. Shannan, B.; Perego, M.; Somasundaram, R.; Herlyn, M. Heterogeneity in Melanoma. Cancer Treat. Res. 2016, 167, 1–15. [Google Scholar] [CrossRef] [PubMed]
  56. Helkkula, T.; Christensen, G.; Ingvar, C.; Isaksson, K.; Harbst, K.; Persson, B.; Ingvar, A.; Hafstrom, A.; Carneiro, A.; Gaspar, V.; et al. BioMEL: A translational research biobank of melanocytic lesions and melanoma. BMJ Open 2024, 14, e069694. [Google Scholar] [CrossRef]
  57. Seviiri, M.; Scolyer, R.A.; Bishop, D.T.; Newton-Bishop, J.A.; Iles, M.M.; Lo, S.N.; Stretch, J.R.; Saw, R.P.M.; Nieweg, O.E.; Shannon, K.F.; et al. Higher polygenic risk for melanoma is associated with improved survival in a high ultraviolet radiation setting. J. Transl. Med. 2022, 20, 403. [Google Scholar] [CrossRef] [PubMed]
  58. Stark, M.S.; Klein, K.; Weide, B.; Haydu, L.E.; Pflugfelder, A.; Tang, Y.H.; Palmer, J.M.; Whiteman, D.C.; Scolyer, R.A.; Mann, G.J.; et al. The Prognostic and Predictive Value of Melanoma-related MicroRNAs Using Tissue and Serum: A MicroRNA Expression Analysis. EBioMedicine 2015, 2, 671–680. [Google Scholar] [CrossRef] [PubMed]
  59. Versluis, J.M.; Blankenstein, S.A.; Dimitriadis, P.; Wilmott, J.S.; Elens, R.; Blokx, W.A.M.; van Houdt, W.; Menzies, A.M.; Schrage, Y.M.; Wouters, M.; et al. Interferon-gamma signature as prognostic and predictive marker in macroscopic stage III melanoma. J. Immunother. Cancer 2024, 12, 8125. [Google Scholar] [CrossRef] [PubMed]
  60. Marcell Szasz, A.; Malm, J.; Rezeli, M.; Sugihara, Y.; Betancourt, L.H.; Rivas, D.; Gyorffy, B.; Marko-Varga, G. Challenging the heterogeneity of disease presentation in malignant melanoma-impact on patient treatment. Cell Biol. Toxicol. 2019, 35, 1–14. [Google Scholar] [CrossRef]
  61. Prendergast, C.M.; Capaccione, K.M.; Lopci, E.; Das, J.P.; Shoushtari, A.N.; Yeh, R.; Amin, D.; Dercle, L.; De Jong, D. More than Just Skin-Deep: A Review of Imaging’s Role in Guiding CAR T-Cell Therapy for Advanced Melanoma. Diagnostics 2023, 13, 992. [Google Scholar] [CrossRef]
  62. Durot, C.; Mule, S.; Soyer, P.; Marchal, A.; Grange, F.; Hoeffel, C. Metastatic melanoma: Pretreatment contrast-enhanced CT texture parameters as predictive biomarkers of survival in patients treated with pembrolizumab. Eur. Radiol. 2019, 29, 3183–3191. [Google Scholar] [CrossRef] [PubMed]
  63. Peisen, F.; Gerken, A.; Dahm, I.; Nikolaou, K.; Eigentler, T.; Amaral, T.; Moltz, J.H.; Othman, A.E.; Gatidis, S. Pre-treatment 18F-FDG-PET/CT parameters as biomarkers for progression free survival, best overall response and overall survival in metastatic melanoma patients undergoing first-line immunotherapy. PLoS ONE 2024, 19, e0296253. [Google Scholar] [CrossRef] [PubMed]
  64. Henderson, M.K.; Goldring, K.; Simeon-Dubach, D. Advancing Professionalization of Biobank Business Operations: A Worldwide Survey. Biopreserv. Biobank. 2019, 17, 71–75. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic workflow in a tissue biobank.
Figure 1. Schematic workflow in a tissue biobank.
Jpm 14 00731 g001
Figure 2. Schematic workflow of a liquid biobank.
Figure 2. Schematic workflow of a liquid biobank.
Jpm 14 00731 g002
Figure 3. Process analysis of image samples.
Figure 3. Process analysis of image samples.
Jpm 14 00731 g003
Figure 4. Schematic representation of melanoma patient diagnostic/clinical trial.
Figure 4. Schematic representation of melanoma patient diagnostic/clinical trial.
Jpm 14 00731 g004
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Valenti, A.; Falcone, I.; Valenti, F.; Ricciardi, E.; Di Martino, S.; Maccallini, M.T.; Cerro, M.; Desiderio, F.; Miseo, L.; Russillo, M.; et al. Biobanks as an Indispensable Tool in the “Era” of Precision Medicine: Key Role in the Management of Complex Diseases, Such as Melanoma. J. Pers. Med. 2024, 14, 731. https://doi.org/10.3390/jpm14070731

AMA Style

Valenti A, Falcone I, Valenti F, Ricciardi E, Di Martino S, Maccallini MT, Cerro M, Desiderio F, Miseo L, Russillo M, et al. Biobanks as an Indispensable Tool in the “Era” of Precision Medicine: Key Role in the Management of Complex Diseases, Such as Melanoma. Journal of Personalized Medicine. 2024; 14(7):731. https://doi.org/10.3390/jpm14070731

Chicago/Turabian Style

Valenti, Alessandro, Italia Falcone, Fabio Valenti, Elena Ricciardi, Simona Di Martino, Maria Teresa Maccallini, Marianna Cerro, Flora Desiderio, Ludovica Miseo, Michelangelo Russillo, and et al. 2024. "Biobanks as an Indispensable Tool in the “Era” of Precision Medicine: Key Role in the Management of Complex Diseases, Such as Melanoma" Journal of Personalized Medicine 14, no. 7: 731. https://doi.org/10.3390/jpm14070731

APA Style

Valenti, A., Falcone, I., Valenti, F., Ricciardi, E., Di Martino, S., Maccallini, M. T., Cerro, M., Desiderio, F., Miseo, L., Russillo, M., & Guerrisi, A. (2024). Biobanks as an Indispensable Tool in the “Era” of Precision Medicine: Key Role in the Management of Complex Diseases, Such as Melanoma. Journal of Personalized Medicine, 14(7), 731. https://doi.org/10.3390/jpm14070731

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop