The LOTUS Initiative for Open Knowledge Management in Natural Products Research

This manuscript (permalink) was automatically generated from lotusnprod/lotus-manuscript@d33aec9 on March 16, 2022.

Authors

✉ — technical correspondence preferred via GitHub Issues. Otherwise, address correspondence to , and .

Abstract

Contemporary bioinformatic and chemoinformatic capabilities hold promise to reshape knowledge management, analysis and interpretation of data in natural products research. Currently, reliance on a disparate set of non-standardized, insular, and specialized databases presents a series of challenges for data access, both within the discipline and for integration and interoperability between related fields. The fundamental elements of exchange are referenced structure-organism pairs that establish relationships between distinct molecular structures and the living organisms from which they were identified. Consolidating and sharing such information via an open platform has strong transformative potential for natural products research and beyond. This is the ultimate goal of the newly established LOTUS initiative, which has now completed the first steps toward the harmonization, curation, validation and open dissemination of 750,000+ referenced structure-organism pairs. LOTUS data is hosted on Wikidata and regularly mirrored on https://lotus.naturalproducts.net. Data sharing within the Wikidata framework broadens data access and interoperability, opening new possibilities for community curation and evolving publication models. Furthermore, embedding LOTUS data into the vast Wikidata knowledge graph will facilitate new biological and chemical insights. The LOTUS initiative represents an important advancement in the design and deployment of a comprehensive and collaborative natural products knowledge base.

Introduction

Evolution of Electronic Natural Products Resources

Natural Products (NP) research is a transdisciplinary field with wide-ranging interests: from fundamental structural aspects of naturally-occurring molecular entities to their effects on living organisms and extending to the study of chemically-mediated interactions within entire ecosystems. Defining the “natural” qualifier is a complex task [1,2]. We thus adopt here a broad definition of a NP as any chemical entity found in a living organism, hereafter refered to as a structure-organism pair. An additional and fundamental element of a structure-organism pair is a reference to the experimental evidence that establishes the linkages between the chemical structure and the biological organism. A future-oriented electronic NP resource should contain fully-referenced structure-organism pairs.

Reliance on data from the NP literature presents many challenges. The assembly and integration of NP occurrences into an inter-operative platform relies primarily on access to a heterogeneous set of databases (DB) whose content and maintenance status are critical factors in this dependency [3]. A tertiary inter-operative NP platform is thus dependent on a secondary set of data that has been selectively annotated into a DB from primary literature sources. The experimental data itself reflects a complex process involving collection or sourcing of natural material (and establishment of its identity), a series of material transformation and separation steps and ultimately the chemical or spectral elucidation of isolates. The specter of human error and the potential for the introduction of biases are present at every phase of this journey. These include publication biases [4], such as emphasis on novel and/or bioactive structures in the review process, or, in DB assembly stages, with selective focus on a specific compound class or a given taxonomic range, or disregard for annotation of other relevant evidence that may have been presented in primary sources. Temporal biases also exist: a technological “state-of-the-art” when published can eventually be recast as anachronistic.

The advancement of NP research has always relied on the development of new technologies. In the past century alone, the rate at which unambiguous identification of new NP entities from biological matrices can be achieved has been reduced from years to days and in the past few decades, the scale at which new NP discoveries are being reported has increased exponentially. Without a means to access and process these disparate NP data points, information is fragmented and scientific progress is impaired [5]. To this extent, contemporary bioinformatic tools enable the (re-)interpretation and (re-)annotation of (existing) datasets documenting molecular aspects of biodiversity [6,7].

While large, well-structured and freely accessible DB exist, they are often concerned primarily with chemical structures (e.g. PubChem [8], with over 100M entries) or biological organisms (e.g. GBIF [9], with over 1,900M entries), but scarce interlinkages limit their application for documentation of NP occurrence(s). Currently, no open, cross-kingdom, comprehensive and computer-interpretable electronic NP resource links NP and their containing organisms, along with referral to the underlying experimental work. This shortcoming breaks the crucial evidentiary link required for tracing information back to the original data and assessing its quality. Even valuable commercially available efforts for compiling NP data, such as the Dictionary of Natural Products (DNP), can lack proper documentation of these critical links.

Pioneering efforts to address such challenges led to the establishment of KNApSAck [10], which is likely the first public, curated electronic NP resource of referenced structure-organism pairs. KNApSAck currently contains 50,000+ structures and 100,000+ structure-organism pairs. However, the organism field is not standardized and access to the data is not straightforward. Another early-established electronic NP resources is the NAPRALERT dataset [11], which was compiled over five decades from the NP literature, gathering and annotating data derived from over 200,000 primary literature sources. This dataset contains 200,000+ distinct compound names and structural elements, along with 500,000+ records of distinct, fully-cited structure-organism pairs. In total, NAPRALERT contains over 900,000 such records, due to equivalent structure-organism pairs reported in different citations. However, NAPRALERT is not an open platform and employs an access model that provides only limited free searches of the dataset. Finally, the NPAtlas [12,13] is a more recent project complying with the FAIR (Findability, Accessibility, Interoperability and Reuse) guidelines for digital assets [14] and offering convenient web access. While the NPAtlas allows retrieval and encourages submission of compounds with their biological source, it focuses on microbial NP and ignores a wide range of biosynthetically active organisms found in the Plantae kingdom.

The LOTUS initiative seeks to address the aforementioned shortcomings. Building on the experience gained through the establishment of the recently published COlleCtion of Open NatUral producTs (COCONUT) [15] regarding the aggregation and curation of NP structural databases, this savoir-faire was expanded to accommodate biological organisms and scientific references in the equation. After extensive data curation and harmonization of over 40 electronic ressources, pairs characterizing a NP occurrence were standardized at the chemical, biological and reference levels. At its current stage of development, LOTUS disseminates 750,000+ referenced structure-organism pairs. These efforts and experiences represent an intensive preliminary curatorial phase and the first major step towards providing a high quality, computer-interpretable knowledge base capable of transforming NP research data management from a classical (siloed) database approach to an optimally-shared resource.

Accommodating Principles of FAIRness and TRUSTworthiness for Natural Products Knowledge Management

In awareness of the multi-faceted pitfalls associated with implementing, using and maintaining classical scientific DBs [16], and to enhance current and future sharing options, the LOTUS initiative selected the Wikidata platform for disseminating its resources. The idea of using wikis to disseminate databases is not new, with multiple underlying advantages [17]. Since its creation, Wikidata has focused on cross-disciplinary and multilingual support. Wikidata is curated and governed collaboratively by a global community of volunteers, about 20,000 of which are contributing monthly. Wikidata currently contains more than 1 billion statements in the form of subject-predicate-object triples. Triples are machine-interpretable and can be enriched with qualifiers and references. Within Wikidata, data triples correspond to approximately 100 million entries, which can be grouped into classes as diverse as countries, songs, disasters, or chemical compounds. The statements are closely integrated with Wikipedia and serve as the source for many of its infoboxes. Various workflows have been established for reporting such classes, particularly those of interest to life sciences, such as genes, proteins, diseases, drugs, or biological taxa [18].

Building on the principles and experiences described above, the present report introduces the development and implementation of the LOTUS workflow for NP occurrence curation and dissemination, which applies both FAIR and TRUST (Transparency, Responsibility, User focus, Sustainability and Technology) principles [19]. LOTUS data upload and retrieval procedures ensure optimal accessibility by the research community, allowing any researcher to contribute, edit and reuse the data with a clear and open CC0 license (Creative Commons 0).

Despite many advantages, Wikidata hosting has some notable, yet manageable drawbacks. While its SPARQL query language offers a powerful way to query available data, it can also appear intimidating to the less experienced user. Furthermore, some typical queries of molecular electronic NP resources such as structural or spectral searches are not yet available in Wikidata. To address these shortcomings, LOTUS is hosted in parallel at https://lotus.naturalproducts.net (LNPN) within the naturalproducts.net ecosystem. The Natural Products Online website is a portal for open-source and open-data resources for NP research. In addition to the generalistic COCONUT and LNPN databases, the portal will enable hosting of arbitrary and skinned collections, themed in particular by species or taxonomic clade, by geographic location or by institution, together with a range of cheminformatics tools for NP research. LNPN is periodically updated with the latest LOTUS data. This dual hosting provides an integrated, community-curated and vast knowledge base (via Wikidata), as well as a NP community-oriented product with tailored search modes (via LNPN). The multiple data interaction options should establish the basis for the transparent and sustainable access, sharing and creation of knowledge on NP occurrence.

The LOTUS initiative was initially launched to answer our need to access the most comprehensive compilation of biological occurrences of NP. Indeed, we recently highlighted the interest of considering the taxonomic dimension when annotating metabolites [20]. This being said, many other concrete applications can result from an access by the scientific community to the LOTUS initiative data. For example, such a resource will facilitate the exploration of eco-evolutionary mechanisms at the molecular level [21]. In terms of drug discovery, this resource is extremely valuable to orient and guide researchers interested in a structure of interest. On the same theme, LOTUS is expected to be the perfect place to encounter “molecular arguments” for biodiversity conservation [22]. Researchers interested in the history of science will be able, through this kind of resource, to gain a preliminary view of the temporal evolution of disciplines such as pharmacognosy. More generally, the objective of the LOTUS initiative is to prepare the ground for an electronic and globally accessible resource that would be the counterpart, at the metabolite level, of established databases linking proteins to biological organisms (eg. Uniprot) and genes to biological organisms (Genbank). Once such an objective is reached, it will be possible to interconnect the three central objects of the living, i.e. metabolites, proteins and genes, through the common entity of these resources, the biological organism. Such an interconnection, fostering cross-fertilization of the fields of chemistry, biology and associated disciplines is desirable and necessary to advance towards a better understanding of Life.

Results & Discussion

This section is structured as follows: first, we present an overview of the LOTUS initiative at its current stage of development. The central curation and dissemination elements of the LOTUS initiative are then explained in detail. The third section addresses the interaction modes between end-users and LOTUS, including data retrieval, addition and editing. Some examples on how LOTUS data can be used to answer research questions or develop hypothesis are given. The final section is dedicated to the interpretation of LOTUS data and illustrates the dimensions and qualities of the current LOTUS dataset from chemical and biological perspectives.

Blueprint of the LOTUS Initiative

Building on the standards established by the related WikiProjects on Wikidata (Chemistry, Taxonomy and Source Metadata), a NP chemistry-oriented subproject was created (Chemistry/Natural products). Its central data consists of three minimal sufficient objects:

As data formats are largely inhomogeneous among existing electronic NP resources, fields related to chemical structure, biological organism and references are variable and essentially not standardized. Therefore, LOTUS implements multiple stages of harmonization, processing and validation (Figure 1, stages 1 to 3). LOTUS employs a Single Source of Truth (SSOT, Single_source_of_truth) to ensure data reliability and continuous availability of the latest curated version of LOTUS data in both Wikidata and LNPN (Figure 1, stage 4). The SSOT approach consists of a PostgreSQL DB that structures links and data schemes such that every data element has a single place. The LOTUS processing pipeline is tailored to efficiently include and diffuse novel or curated data directly from new sources or at the Wikidata level. This iterative workflow relies both on data addition and retrieval actions as described in the Data Interaction section. The overall process leading to referenced and curated structure-organisms pairs is illustrated in Figure 1 and detailed below.


Figure 1: Blueprint of the LOTUS initiative. Data undergo a four-stage process: (1) Harmonization, (2) Processing, (3) Validation and (4) Dissemination. The process was designed to incorporate future contributions (5), either by the addition of new data from within Wikidata (a) or new sources (b) or via curation of existing data (c). The figure is available under the CC0 license at https://commons.wikimedia.org/wiki/File:Lotus_initiative_1_blueprint.svg.

By design, this iterative process fosters community participation, essential to efficiently document NP occurrences. All stages of the workflow are described on the git sites of the LOTUS initiative at https://github.com/lotusnprod and in the methods. At the time of writing, 750,000+ LOTUS entries contained a curated chemical structure, biological organism and reference and were available on both Wikidata and LNPN. As the LOTUS data volume is expected to increase over time, a frozen (as of 2021-12-20), tabular version of this dataset with its associated metadata is made available at https://doi.org/10.5281/zenodo.5794106 [25].

Data Harmonization

Multiple data sources were processed as described hereafter. All publicly accessible electronic NP resources included in COCONUT that contain referenced structure-organism pairs were considered as initial input. The data were complemented with COCONUT’s own referenced structure-organism pairs [26], as well as the following additional electronic NP resources: Dr. Duke [27], Cyanometdb [28], Datawarrior [29], a subset of NAPRALERT, Wakankensaku [30] and DiaNat-DB [31].

The contacts of the electronic NP resources not explicitly licensed as open were individually reached for permission to access and reuse data. A detailed list of data sources and related information is available as Appendix 1. All necessary scripts for data gathering and harmonization can be found in the lotus-processor repository in the src/1_gathering directory and processed is detailed in the corresponding methods section gathering section. All subsequent iterations including new data sources, either updated information from the same data sources or new data, will involve a comparison with the previously gathered data at the SSOT level to ensure that the data is only curated once.

Data Processing & Validation

As shown in Figure 1, data curation consisted of three stages: harmonization, processing and validation. Thereby, after the harmonization stage, each of the three central objects - chemical compounds, biological organisms and reference - were processed, as described in related methods section. Given the data size (2.5M+ initial entries), manual validation was unfeasible. Curating the references was a particularly challenging part of the process. Whereas organisms are typically reported by at least their vernacular or scientific denomination and chemical structures via their SMILES, InChI, InChIKey or image (not covered in this work), references suffer from largely insufficient reporting standards. Despite poor standardization of the initial reference field, proper referencing remains an indispensable way to establish the validity of structure-organism pairs. Better reporting practices, supported by tools such as Scholia [32,33] and relying on Wikidata, Fatcat, or Semantic Scholar should improve reference-related information retrieval in the future.

In addition to curating the entries during data processing, 420 referenced structure-organism pairs were selected for manual validation. An entry was considered as valid if: i) the structure (in the form of any structural descriptor that could be linked to the final sanitized InChIKey) was described in the reference ii) the containing organism (as any organism descriptor that could be linked to the accepted canonical name) was described in the reference and iii) the reference was describing the occurrence of the chemical structure in the biological organism. More details are available in the related methods section. This process allowed us to establish rules for automatic filtering and validation of the entries. The parameters of the automatic filtering are available as a function (filter_dirty.R) and are further described in the related methods section. The automatic filtering was then applied to all entries. To confirm the efficacy of the filtering process, a new subset of 100 diverse, automatically curated and automatically validated entries was manually checked, yielding a rate of 97% of true positives. The detailed results of the two manual validation steps are reported in Supporting Information Appendix 2. The resulting data is also available in the dataset shared at https://doi.org/10.5281/zenodo.5794106 [25]. Table 1 shows an example of a referenced structure-organism pair before and after curation. This process resolved the structure to an InChIKey, the organism to a valid taxonomic name and the reference to a DOI, thereby completing the establishment of the essential referenced structure-organism pair.


Table 1: Example of a referenced structure-organism pair before and after curation
Structure Organism Reference
Before curation Cyathocaline Stem bark of Cyathocalyx zeylanica CHAMP. ex HOOK. f. & THOMS. (Annonaceae) Wijeratne E. M. K., de Silva L. B., Kikuchi T., Tezuka Y., Gunatilaka A. A. L., Kingston D. G. I., J. Nat. Prod., 58, 459-462 (1995).
After curation VFIIVOHWCNHINZ-UHFFFAOYSA-N Cyathocalyx zeylanicus 10.1021/NP50117A020

Challenging examples encountered during the development of the curation process were compiled in an edge cases table (tests/tests.tsv) to allow for automated unit testing. These tests allow a continuous revalidation of any change made to the code, ensuring that corrected errors will not reappear. The alluvial plot in Figure 2 illustrates the individual contribution of each source and original subcategory that led to the processed categories: structure, organism and reference.


Figure 2: Alluvial plot of the data transformation flow within LOTUS during the automated curation and validation processes. The figure also reflects the relative proportions of the data stream in terms of the contributions from the various sources (“source” block, left), the composition of the harmonized subcategories (“original subcategory” block, middle) and the validated data after curation (“processed category” block, right). Automatically validated entries are represented in green, rejected entries in blue. The figure is available under the CC0 license at https://commons.wikimedia.org/wiki/File:Lotus_initiative_1_alluvial_plot.svg.

The figure highlights, for example, the essential contribution of the reference DOI category to the final validated entries. A similar pattern can be seen concerning structures, where the validation rate of structural identifiers is higher than chemical names. The combination of the results of the automated curation pipeline and the manually curated entries led to the establishment of four categories (manually validated, manually rejected, automatically validated and automatically rejected) of the referenced structure-organism pairs that formed the processed part of the SSOT. Out of a total of 2.5M+ initial pairs, the manual and automatic validation retained 750,000+ pairs (approximately 30%), which were then selected for dissemination on Wikidata. Among validated entries, multiple ones were redundant among the source databases, thus also explaining the decrease of entries between the initial pairs and validated ones. Moreover, because data quality was favored over quantity, the number of rejected entries is high. Among them, multiple correct entries were certainly falsely rejected, but still not disseminated. All rejected entries were kept aside for later manual inspection and validation. These are publicly available at https://doi.org/10.5281/zenodo.5794597 [34]. In the end, the disseminated data contained 290,000+ unique chemical structures, 40,000+ distinct organisms and 75,000+ references.

Data Dissemination

Research worldwide can benefit the most when all results of published scientific studies are fully accessible immediately upon publication [35]. This concept is considered the foundation of scientific investigation and a prerequisite for the effective direction of new research efforts based on prior information. To achieve this, research results have to be made publicly available and reusable. As computers are now the main investigation tool for a growing number of scientists, all research data including those in publications should be disseminated in computer-readable format, following the FAIR principles. LOTUS uses Wikidata as a repository for referenced structure-organism pairs, as this allows documented research data to be integrated with a large, pre-existing and extensible body of chemical and biological knowledge. The dynamic nature of Wikidata encourages the continuous curation of deposited data through the user community. Independence from individual and institutional funding represents another major advantage of Wikidata. The Wikidata knowledge base and the option to use elaborate SPARQL queries allow the exploration of the dataset from a sheer unlimited number of angles. The openness of Wikidata also offers unprecedented opportunities for community curation, which will support, if not guarantee, a dynamic and evolving data repository. At the same time, certain limitations of this approach can be anticipated. Despite (or possibly due to) their power, SPARQL queries can be complex and potentially require an in-depth understanding of the models and data structure. This involves a steep learning curve which can discourage some end-users. Furthermore, traditional ways to query electronic NP resources such as structural or spectral searches are currently not within the scope of Wikidata and, are thus addressed in LNPN. Using the pre-existing COCONUT template, LNPN hosting allows the user to perform structural searches by directly drawing a molecule, thereby addressing the current lack of such structural search possibilities in Wikidata. Since metabolite profiling by Liquid Chromatography (LC) - Mass Spectrometry (MS) is now routinely used for the chemical composition assessment of natural extracts, future versions of LOTUS and COCONUT are envisioned to be augmented by predicted MS spectra and hosted at https://naturalproducts.net to allow mass and spectral-based queries. Note that such spectral database is already available at https://doi.org/10.5281/zenodo.5607264 [36]. To facilitate queries focused on specific taxa (e.g., “return all molecules found in the Asteraceae family”), a unified taxonomy is paramount. As the taxonomy of living organisms is a complex and constantly evolving field, all the taxon identifiers from all accepted taxonomic DB for a given taxon name were kept. Initiatives such as the Open Tree of Life (OTL) [37] will help to gradually reduce these discrepancies, and the Wikidata platform can and does support such developments. OTL also benefits from regular expert curation and new data. As the taxonomic identifier property for this resource did not exist in Wikidata, its creation was requested and obtained. The property is now available as “Open Tree of Life ID” (P9157).

Following the previously described curation process, all validated entries have been made available through Wikidata and LNPN. LNPN will be regularly mirroring Wikidata LOTUS through the SSOT as described in Figure 1.


User Interaction with LOTUS Data

The possibilities to interact with the LOTUS data are numerous. The following gives examples of how to retrieve, add and edit LOTUS data.

Data Retrieval

LOTUS data can be queried and retrieved either directly in Wikidata or on LNPN, both of which have distinct advantages. While Wikidata offers flexible and powerful queries capacities at the cost of potential complexity, LNPN has a graphical user interface with capabilities of drawing chemical structures, simplified structural or biological filtering and advanced chemical descriptors, albeit with a more rigid structure. For bulk download, a frozen version of LOTUS data (timestamp of 2021-12-20) is also available at https://doi.org/10.5281/zenodo.5794106 [25]. More refined approaches to the direct interrogation of the up-to-date LOTUS data both in Wikidata and LNPN are detailed hereafter.

Wikidata

The easiest way to search for NP occurrence information in Wikidata is by typing the name of a chemical structure directly into the “Search Wikidata” field, which (for left-to-right languages) can be found in the upper right corner of the Wikidata homepage or any other Wikidata page. For example, by typing “erysodine”, the user will land on the page of this compound (Q27265641). Scrolling down to the “found in taxon” statement will allow the user to view the biological organisms reported to contain this NP (Figure 3). Clicking the reference link under each taxon name links to the publication(s) documenting the occurrence.

Figure 3: Illustration of the “found in taxon” statement section on the Wikidata page of erysodine Q27265641 showing a selection of erysodine-containing taxa and the references documenting these occurrences.

The typical approach to more elaborated querying involves writing SPARQL queries using the Wikidata Query Service or another direct connection to a SPARQL endpoint. Below are some examples from simple to more elaborated queries, demonstrating what can be done using this approach. The full-text queries with explanations are included in Appendix 3.

Table 2: Potential questions about structure-organism relationships and corresponding Wikidata queries.
Question Wikidata SPARQL query
What are the compounds present in Mouse-ear cress (Arabidopsis thaliana) or its child taxa? https://w.wiki/4Vcv
Which organisms are known to contain β-sitosterol? https://w.wiki/4VFn
Which organisms are known to contain stereoisomers of β-sitosterol? https://w.wiki/4VFq
Which pigments are found in which taxa, according to which reference? https://w.wiki/4VFx
What are examples of organisms where compounds were found in an organism sharing the same parent taxon, but not in the organism itself? https://w.wiki/4Wt3
Which Zephyranthes species lack compounds known from at least two species in the genus? https://w.wiki/4VG3
How many compounds are structurally similar to compounds labeled as antibiotics? (grouped by the parent taxon of the containing organism) https://w.wiki/4VG4
Which organisms contain indolic scaffolds? Count occurrences, group and order the results by the parent taxon. https://w.wiki/4VG9
Which compounds with known bioactivities were isolated from Actinobacteria, between 2014 and 2019, with related organisms and references? https://w.wiki/4VGC
Which compounds labeled as terpenoids were found in Aspergillus species, between 2010 and 2020, with related references? https://w.wiki/4VGD
Which are the available referenced structure-organism pairs on wikidata? (example limited to 1000 results) https://w.wiki/4VFh

The queries presented in Table 2 are only selected examples, and many other ways of interrogating LOTUS can be formulated. Generic queries can be used, for example, for hypothesis generation when starting a research project. For instance, a generic SPARQL query - listed in Table 2 as “Which are the available referenced structure-organism pairs on wikidata?” - retrieves all structures, identified by their InChIKey (P235), which contain “found in taxon” (P703) statements that are stated in (P248) a bibliographic reference: https://w.wiki/4VFh. Data can then be exported in various formats, such as classical tabular formats, json, or html tables (see Download tab on the lower right of the query frame). At the time of writing (2021-12-20), this query (without the LIMIT 1000) returned 951,800 entries; a frozen query result is available at https://doi.org/10.5281/zenodo.5668854 [38].

Targeted queries allowing to interrogate LOTUS data from the perspective of one of the three objects forming the referenced structure-organism pairs can also be built. Users can, for example, retrieve a list of all structures reported from a given organism, such as all structures reported from Arabidopsis thaliana (Q158695) or its child taxa (https://w.wiki/4Vcv). Alternatively, all organisms containing a given chemical can be queried via its structure, such as in the search for all organisms where β-sitosterol (Q121802) was found in (https://w.wiki/4VFn). For programmatic access, the lotus-wikidata-exporter repository also allows data retrieval in RDF format and as TSV tables.

To further showcase the possibilities, two additional queries were established (https://w.wiki/4VGC and https://w.wiki/4VGD). Both queries were inspired by recent literature review works [39,40]. The first work describes compounds found in Actinobacteria, with a biological focus on compounds with reported bioactivity. The second one describes compounds found in Aspergillus spp., with a chemical focus on terpenoids. In both cases, in seconds, the queries allow retrieving a table similar to the ones in the mentioned literature reviews. While these queries are not a direct substitute for manual literature review, they do allow researchers to quickly begin such a review process with a very strong body of relevant references.

For a convenient expansion or limitation of the results, certain types of queries such as structure or similarity searches usually exist in molecular electronic resources. As these queries are not natively integrated by SPARQL, they are not readily available for Wikidata exploration. To address such limitation, Galgonek et al. developed an in-house SPARQL engine that allows utilization of Sachem, a high-performance chemical DB cartridge for PostgreSQL for fingerprint-guided substructure and similarity search [41]. The engine is used by the Integrated Database of Small Molecules (IDSM) that operates, among other things, several dedicated endpoints allowing structural search in selected small-molecule datasets via SPARQL [42]. To allow substructure and similarity searches via SPARQL also on compounds from Wikidata, a dedicated IDSM/Sachem endpoint was created for the LOTUS project. The endpoint indexes isomeric (P2017) and canonical (P233) SMILES code available in Wikidata. To ensure that data is kept up-to-date, SMILES codes are automatically downloaded from Wikidata daily. The endpoint allows users to run federated queries and, thereby, proceed to structure-oriented searches on the LOTUS data hosted at Wikidata. For example, the SPARQL query https://w.wiki/4VG9 returns a list of all organisms that produce NP with an indolic scaffold. The output is aggregated at the parent taxa level of the containing organisms and ranked by the number of scaffold occurrences.

Regarding the versioning aspects, some challenges are implied by the dynamic nature of the Wikidata environment. However, tracking of the data evolution can be achieved in multiple ways and at different levels: at the full Wikidata level, dumps are regularly created (https://dumps.wikimedia.org/wikidatawiki/entities) while at the individual entry level the full history of modification can be consulted (see following link for the full edit history of erythromycin for example (https://www.wikidata.org/w/index.php?title=Q213511&action=history)).

We propose to the users a simple approach to document, version and share the output of queries on the LOTUS data at a defined time point. For this, in addition to sharing the short url of a the SPARQL query (which will return results evolving over time), a simple archiving of the returned table to Zenodo or similar platform can be done. In order to gather results of SPARQL queries we established the LOTUS Initiative Community repository. The following link allows to directly contribute to the community repository https://zenodo.org/deposit/new?c=the-lotus-initiative. For example the output of this Wikidata SPARQL query https://w.wiki/4N8G realized on the 2021-11-10T16:56 can be easily archived and shared in a publication via its DOI 10.5281/zenodo.5668380.

Lotus.NaturalProducts.Net (LNPN)

In the search field of the LNPN interface (https://lotus.naturalproducts.net), simple queries can be achieved by typing the molecule name (e.g., ibogaine) or pasting a SMILES, InChI, InChIKey string, or a Wikidata identifier. All compounds reported from a given organism can be found by entering the organism name at the species or any higher taxa level (e.g. Tabernanthe iboga). Compound search by chemical class is also possible.

Alternatively, a structure can be directly drawn in the structure search interface (https://lotus.naturalproducts.net/search/structure), where the user can also decide on the nature of the structure search (exact, similarity, substructure search). Refined search mode combining multiple search criteria, in particular physicochemical properties, is available in the advanced search interface (https://lotus.naturalproducts.net/search/advanced).

Within LNPN, LOTUS bulk data can be retrieved as SDF or SMILES files, or as a complete MongoDB dump via https://lotus.naturalproducts.net/download. Extensive documentation describing the search possibilities and data entries is available at https://lotus.naturalproducts.net/documentation. LNPN can also be queried via the application programming interface (API) as described in the documentation.

Data Addition and Evolution

One major advantage of the LOTUS architecture is that every user has the option to contribute to the NP occurrences documentation effort by adding new or editing existing data. As all LOTUS data applies the SSOT mechanism, reprocessing of previously treated elements is avoided. However, at the moment, the SSOT channels are not open to the public for direct write access to maintain data coherence and evolution of the SSOT scheme. For now, the users can employ the following approaches to add or modify data in LOTUS.

Sources

LOTUS data management involves regular re-importing of both current and new data sources. New and edited information from these electronic NP resources will be checked against the SSOT. If absent or different, data will be passed through the curation pipeline and subsequently stored in the SSOT. Accordingly, by contributing to external electronic NP resources, any researcher has a means of providing new data for LOTUS, keeping in mind the inevitable delay between data addition and subsequent inclusion into LOTUS.

Wikidata

The currently favored approach to add new data to LOTUS is to create or edit Wikidata entries directly. Newly created or edited data will then be imported into the SSOT. There are several ways to interact with Wikidata which depend on the technical skills of the user and the volume of data to be uploaded/modified.

Pre-requisites

While direct Wikidata upload is possible, contributors are encouraged to use the LOTUS curation pipeline as a preliminary step to strengthen the initial data quality. For this, a specific mode of the LOTUS processor can be called (see Custom mode). The added data will therefore benefit from the curation and validation stages implemented in the LOTUS processing pipeline.

Manual Upload

Any researcher interested in reporting NP occurrences can manually add the data directly in Wikidata, without any particular technical knowledge requirement. For this the creation of a Wikidata account and following the general object editing guidelines is advised. Regarding the addition of NP-centered objects (i.e., referenced structure-organisms pairs), users shall refer to the WikiProject Chemistry/Natural products group page.

A tutorial for the manual creation and upload of a referenced structure-organism pair to Wikidata is available in Appendix 4.

Batch and Automated Upload

Through the initial curation process described previously, 750,000+ referenced structure-organism pairs were validated for Wikidata upload. To automate this process, a set of programs were written to automatically process the curated outputs, group references, organisms and compounds, check if they are already present in Wikidata (using SPARQL and direct Wikidata querying) and insert or update the entities as needed (i.e., upserting). These scripts can be used for future batch upload of properly curated and referenced structure-organism pairs to Wikidata. Programs for data addition to Wikidata can be found in the repository lotus-wikidata-interact. The following Xtools page offers an overview of the latest activity performed by our NPimporterBot, using those programs.

Data Editing

Even if correct at a given time point, scientific advances can invalidate or update previously uploaded data. Thus, the possibility to continuously edit the data is desirable and guarantees data quality and sustainability. Community-maintained knowledge bases such as Wikidata encourage such a process. Wikidata presents the advantage of allowing both manual and automated correction. Field-specific robots such as SuccuBot, KrBot, Pi_bot and ProteinBoxBot or our NPimporterBot went through an approval process. The robots are capable of performing thousands of edits without the need for human input. This automation helps reduce the amount of incorrect data that would otherwise require manual editing. However, manual curation by human experts remains irreplaceable as a standard. Users who value this approach and are interested in contributing are invited to follow the manual curation tutorial in Appendix 4.

The Scholia platform provides a visual interface to display the links among Wikidata objects such as researchers, topics, species or chemicals. It now provides an interesting way to view the chemical compounds found in a given biological organism (see here for the metabolome view of Eurycoma longifolia). If Scholia currently does not offer a direct editing interface for scientific references, it still allows users to proceed to convenient batch editing via Quick Statements. The adaptation of such a framework to edit the referenced structure-pairs in the LOTUS initiative could thus facilitate the capture of future expert curation, especially manual efforts that cannot be replaced by automated scripts.

Data Interpretation

To illustrate the nature and dimensions of the LOTUS dataset, some selected examples of data interpretation are shown. First, the distribution of chemical structures among four important NP reservoirs: plants, fungi, animals and bacteria (Table 3). Then, the distribution of biological organisms according to the number of related chemical structures and likewise the distribution of chemical structures across biological organisms are illustrated (Figure 4). Furthermore, the individual electronic NP resources participation in LOTUS data is resumed using the UpSet plot depiction, which allows the visualization of intersections in data sets (Figure 5). Across these figures we take again the two previous examples, i.e, β-sitosterol as chemical structure and Arabidopsis thaliana as biological organism because of their well-documented statuses. Finally, a biologically-interpreted chemical tree and a chemically-interpreted biological tree are presented (Figure 6 and Figure 7). The examples illustrate the overall chemical and biological coverage of LOTUS by linking family-specific classes of chemical structures to their taxonomic position. Table 3, Figures 4, 6 and 7 were generated using the frozen data (2021-12-20 timestamp), which is available for download at https://doi.org/10.5281/zenodo.5794106 [25]. Figure 5 required a dataset containing information from closed resources and the complete data used for its generation is therefore not available for public distribution. All scripts used for the generation of the figures are available in the lotus-processor repository in the src/4_visualizing directory for reproducibility.

Distribution of Chemical Structures across reported Biological Organisms in LOTUS

Table 3 summarizes the distribution of chemical structures and their chemical classes (according to NPClassifier [43]) across the biological organisms reported in LOTUS. For this, biological organisms were grouped into four artificial taxonomic levels (plants, fungi, animals and bacteria). These were built by combining the two highest taxonomic levels in the OTL taxonomy, namely Domain and Kingdom levels. “Plants” corresponded to “Eukaryota_Archaeplastida”, “Fungi” to “Eukaryota_Fungi”, “Animals” to “Eukaryota_Metazoa” and “Bacteria” to “Bacteria_NA”. The category corresponding to “Eukaryota_NA” mainly contained Algae, but also other organisms such as Amoebozoa and was therefore excluded. This represented less than 1% of all entries. The details of this process are available under src/3_analyzing/structure_taxon_distribution.R. When the chemical structure/class was reported only in one taxonomic grouping, it was counted as “specific”.

Table 3: Distribution and specificity of chemical structures across four important NP reservoirs: plants, fungi, animals and bacteria. When the chemical structure/class appeared only in one group and not the three others, they were counted as “specific”. Chemical classes were attributed with NPClassifier.
Group Organisms 2D Structure-Organism Pairs 2D Chemical Structures Specific Chemical Structures Chemical Classes Specific Chemical Classes
Plantae 28,439 342,891 95,191 90,672 (95%) 545 59 (11%)
Fungi 4,003 36,950 22,594 20,194 (89%) 417 19 (5%)
Animalia 2,716 24,114 15,242 11,822 (78%) 455 14 (3%)
Bacteria 1,555 23,198 15,895 14,130 (89%) 385 43 (11%)

Distributions of Organisms per Structure and Structures per Organism

Readily achievable outcomes from LOTUS show that the depth of exploration of the world of NP is rather limited: as depicted in Figure 4, on average, three organisms are reported per chemical structure and eleven structures per organism. Notably, half of all structures have been reported from a single organism and half of all studied organisms are reported to contain five or fewer structures. Metabolomics studies suggest that these numbers are heavily underrated [44,45] and indicate that a better reporting of the metabolites detected in the course of NP chemistry investigations should greatly improve coverage.

This incomplete coverage may be partially explained by the habit in classical NP journals to accept only new and/or bioactive chemical structures for publication. Another possible explanation is the fact that specific chemical classes have been under heavier scrutiny by the natural products community than others. For example, alkaloids have three specific characteristics which favor their reporting in the literature. First, they are often endowed with potent biological activities making them a target in the frame of pharmacognosy research. Second, their chemical nature makes them readily accessible from complex biological matrices through acido-basic extraction. Third, they ionize greatly in positive MS mode, which makes their detection even at a very low concentration possible, where other compounds present in much higher concentrations are not detected. It is thus a complex task to answer the following question: “Is the currently observed repartition of alkaloids across the tree of life a reflection of their true biological occurrence or is this repartition biased by the aforementioned characteristics of this chemical class ?” While the LOTUS initiative does not allow yet disentangling the bias from the true occurrence, it should offer sound and strong foundations for such challenging research problematic.

Another obvious explanation for the limited coverage is the fact that most of the chemical structures in LOTUS have been physically isolated and described. This is an extremely time-consuming effort that can obviously not be carried on all metabolites of all biological organisms. Here, the sensitivity of mass spectrometry and the ever-increasing efficiency of computational metabolite annotation solutions could offer a strong take. The documentation of metabolite annotation results obtained on large collections of biological matrices and the associated metadata within knowledge graphs offers exciting perspectives regarding the possibilities to expand both the chemical and biological coverage of the LOTUS data in a feasible manner.

Figure 4: Distribution of “structures per organism” and “organisms per structure”. The number of organisms linked to the planar structure of β-sitosterol (KZJWDPNRJALLNS) and the number of chemical structures in Arabidopsis thaliana are two exemplary highlights. A. thaliana contains 687 different short InChIKeys (i.e 2D structures) and KZJWDPNRJALLNS is reported in 3979 distinct organisms. Less than 10 percent of the species contain more than 80 percent of the structural diversity present within LOTUS. In parallel, 80 percent of the species present in LOTUS are linked to less than 10 percent of the structures. The figure is available under the CC0 license at https://commons.wikimedia.org/wiki/File:Lotus_initiative_1_structure_organism_distribution.svg.

Contribution of Individual Electronic NP Resources to LOTUS

The added value of the LOTUS initiative to assemble multiple electronic NP resources is illustrated in Figure 5 : Panel A shows the contributions of the individual electronic NP resources to the ensemble of chemical structures found in one of the most studied vascular plants, Arabidopsis thaliana (“Mouse-ear cress”; Q147096). Panel B shows the ensemble of taxa reported to contain the planar structure of the widely occurring triterpenoid β-sitosterol (Q121802).

Figure 5: UpSet plots of the individual contribution of electronic NP resources to the planar structures found in Arabidopsis thaliana (A) and to organisms reported to contain the planar structure of β-sitosterol (KZJWDPNRJALLNS) (B). UpSet plots are evolved Venn diagrams, allowing to represent intersections between multiple sets. The horizontal bars on the lower left represent the number of corresponding entries per electronic NP resource. The dots and their connecting line represent the intersection between source and consolidate sets. The vertical bars indicate the number of entries at the intersection. For example, 479 organisms containing the planar structure of β-sitosterol are present in both UNPD and NAPRALERT, whereas each of them respectively reports 1,349 and 2,330 organisms containing the planar structure of β-sitosterol. The figure is available under the CC0 license at https://commons.wikimedia.org/wiki/File:Lotus_initiative_1_upset_plot.svg.

Figure 5 A. also shows that according to NPClassifier, the “chemical pathway” category distribution across electronic NP resources is not conserved. Note that NPClassifier and ClassyFire [46] chemical classification results are both available as metadata in the frozen LOTUS export and LNPN. Both classification tools return a chemical taxonomy for individual structures, thus allowing their grouping at higher hierarchical levels, in the same way as it is done for biological taxonomies. The UpSet plot in Figure 5 indicates the poor overlap of preexisting electronic NP resources and the added value of an aggregated dataset. This is particularly well illustrated in Figure 5 B., where the number of organisms for which the planar structure of β-sitosterol (KZJWDPNRJALLNS) has been reported is shown for each intersection. NAPRALERT has by far the highest number of entries (2,330 in total), while other electronic NP resources complement this well: e.g., UNPD has 573 reported organisms with β-sitosterol that do not overlap with any other resource. Of note, β-sitosterol is documented in only 13 organisms in the DNP, highlighting the importance of a better systematic reporting of ubiquitous metabolites and the interest of multiple data sources agglomeration.

A Biologically-interpreted Chemical Tree

The chemical diversity captured in LOTUS is here displayed using TMAP (Figure 6), a visualization library allowing the structural organization of large chemical datasets as a minimum spanning tree [47]. Using Faerun, an interactive HTML file is generated to display metadata and molecule structures by embedding the SmilesDrawer library [48,49]. Planar structures were used for all compounds to generate the TMAP (chemical space tree-map) using MAP4 encoding [50]. As the tree organizes structures according to their molecular fingerprint, an anticipated coherence between the clustering of compounds and the mapped NPClassifier chemical class is observed (Figure 6 A.). For clarity, some of the most represented chemical classes of LOTUS plus quassinoids and stigmastane steroids are mapped, with examples of a quassinoid (NXZXPYYKGQCDRO) (light green star) and a stigmastane steroid (KZJWDPNRJALLNS) (dark green diamond) and their corresponding location in the TMAP.

Figure 6: TMAP visualizations of the chemical diversity present in LOTUS. Each dot corresponds to a chemical structure. A highly specific quassinoid (NXZXPYYKGQCDRO) (light green star) and an ubiquitous stigmastane steroid (KZJWDPNRJALLNS) (dark green diamond) are mapped as examples in all visualizations. In panel A., compounds (dots) are colored according to the NPClassifier chemical class they belong to. In panel B., compounds that are mostly reported in the Simaroubaceae family are highlighted in blue. Finally, in panel C., the compounds are colored according to the specificity score of chemical classes found in biological organisms. This biological specificity score at a given taxonomic level for a given chemical class is calculated as a Jensen-Shannon divergence. A score of 1 suggests that compounds are highly specific, 0 that they are ubiquitous. Zooms on a group of compounds of high biological specificity score (in pink) and on compounds of low specificity (blue) are depicted. An interactive HTML visualization of the LOTUS TMAP is available at https://lotus.nprod.net/post/lotus-tmap/ and archived at https://doi.org/10.5281/zenodo.5801807 [51]. The figure is available under the CC0 license at https://commons.wikimedia.org/wiki/File:Lotus_initiative_1_biologically_interpreted_chemical_tree.svg.





To explore relationships between chemistry and biology, it is possible to map taxonomical information such as the most reported biological family per chemical compound (Figure 6 B.) or the biological specificity of chemical classes (Figure 6 C.) on the TMAP. The biological specificity score at a given taxonomic level for a given chemical class is calculated as a Jensen-Shannon divergence. A score of 1 suggests that compounds are highly specific, 0 that they are ubiquitous. For more details, see 3_analyzing/jensen_shannon_divergence.R. This visualization allows to highlight chemical classes specific to a given taxon, such as the quassinoids in the Simaroubaceae family. In this case it is striking to see how well the compounds of a given chemical class (quassinoids) (Figure 6 A.) and the most reported plant family per compound (Simaroubaceae) (Figure 6 B.) overlap. This is also evidenced on Figure 6 C. with a Jensen-Shannon divergence of 0.99 at the biological family level for quassinoids. In this plot, it is also possible to identify chemical classes that are widely spread among living organisms, such as the stigmastane steroids, which exhibit a Jensen-Shannon divergence of 0.73 at the biological family level. This means that repartition of stigmastane steroids among families is not specific. Figure 7-figure supplement 1 further supports this statement.

A Chemically-interpreted Biological Tree

An alternative view of the biological and chemical diversity covered by LOTUS is illustrated in Figure 7. Here, chemical compounds are not organized but biological organisms are placed in their taxonomy. To limit bias due to under-reporting in the literature and keep a reasonable display size, only families with at least 50 reported compounds were included. Organisms were classified according to the OTL taxonomy and structures according to NPClassifier. The tips were labeled according to the biological family and colored according to their biological kingdom. The bars represent structure specificity of the most characteristic chemical class of the given biological family (the higher the more specific). This specificity score was a Jaccard index between the chemical class and the biological family. For more details, see 4_visualizing/plot_magicTree.R.

Figure 7: LOTUS provides new means of exploring and representing chemical and biological diversity. The tree generated from current LOTUS data builds on biological taxonomy and employs the kingdom as tips label color (only families containing 50+ chemical structures were considered). The outer bars correspond to the most specific chemical class found in the biological family. The height of the bar is proportional to a specificity score corresponding to a Jaccard index between the chemical class and the biological family. The bar color corresponds to the chemical pathway of the most specific chemical class in the NPClassifier classification system. The size of the leaf nodes corresponds to the number of genera reported in the family. The figure is vectorized and zoomable for detailed inspection and is available under the CC0 license at https://commons.wikimedia.org/wiki/File:Lotus_initiative_1_chemically_interpreted_biological_tree.svg.
Figure 7-figure supplement 1: Distribution of β-sitosterol and related chemical parents among families with at least 50 reported compounds present in LOTUS. Script used for the generation of each tree in the figure is the same (src/4_visualizing/plot_magicTree.R) as for Figure 7 as both figures are related. The figure is available under CC0 license at https://commons.wikimedia.org/wiki/File:Lotus_initiative_1_chemically_interpreted_biological_tree_supplement.svg.

Figure 7 makes it possible to spot highly specific compound classes such as trinervitane terpenoids in the Termitidae, the rhizoxin macrolides in the Rhizopodaceae, or the quassinoids and limonoids typical, respectively, of Simaroubaceae and Meliaceae. Similarly, tendencies of more generic occurrence of NP can be observed. For example, within the fungal kingdom, Basidiomycotina appear to have a higher biosynthetic specificity toward terpenoids than other fungi, which mostly focus on polyketides production. As explained previously, Figure 7 is highly dependent of the data reported in literature. As also illustrated in Figure 4, some compounds can be over-studied among several organisms, and many organisms studied for specific compounds only. This is a direct consequence of the way the NP community reports its data actually. Having this in mind, when observed at a finer scale, down to the structure level, such chemotaxonomic representation can give valuable insights. For example, among all chemical structures, only two were found in all biological kingdoms, namely heptadecanoic acid (KEMQGTRYUADPNZ-UHFFFAOYSA-N) and β-carotene (OENHQHLEOONYIE-JLTXGRSLSA-N). Looking at the distribution of β-sitosterol (KZJWDPNRJALLNS-VJSFXXLFSA-N) within the overall biological tree, Figure 7-figure supplement 1 plots its presence/absence versus those of its superior chemical classifications, namely the stigmastane, steroid and terpenoid derivatives, over the same tree used in Figure 7. The comparison of these five chemically-interpreted biological trees clearly highlights the increasing speciation of the β-sitosterol biosynthetic pathway in the Archaeplastida kingdom, while the superior classes are distributed across all kingdoms. Figure 7 is zoomable and vectorized for detailed inspection.

As illustrated, the possibility of data interrogation at multiple precision levels, from fully defined chemical structures to broader chemical classes, is of great interest, e.g., for taxonomic and evolution studies. This makes LOTUS a unique resource for the advancement of chemotaxonomy, a discipline pioneered by Augustin Pyramus de Candolle and pursued by other notable researchers (Robert Hegnauer, Otto R. Gottlieb) [52,53,54]. Six decades after Hegnauer’s publication of “Die Chemotaxonomie der Pflanzen” [55] much remains to be done for the advancement of this field of study and the LOTUS initiative aims to provide a solid basis for researchers willing to pursue these exciting explorations at the interface of chemistry, biology and evolution.

As shown recently in the context of spectral annotation [56], lowering the precision level of the annotation allows a broader coverage along with greater confidence. Genetic studies investigating the pathways involved and the organisms carrying the responsible biosynthetic genes would be of interest to confirm the previous observations. These forms of data interpretation exemplify the importance of reporting not only new structures, but also novel occurrences of known structures in organisms as comprehensive chemotaxonomic studies are pivotal for a better understanding of the metabolomes of living organisms.

The integration of multiple knowledge sources, e.g. genetics for NP producing gene clusters [57] combined to taxonomies and occurrences DB, also opens new opportunities to understand if an organism is responsible for the biosynthesis of a NP or merely contains it. This understanding is of utmost importance for the chemotaxonomic field and will help to understand to which extent microorganisms (endosymbionts) play a role in host development and its NP expression potential [58].

Conclusion & Perspectives

Advancing Natural Products Knowledge

At its current development stage, data harmonized and curated throughout the LOTUS initiative remains imperfect and, by the very nature of research, at least partially biased (see Introduction). In the context of bioactive NP research, and due to global editorial practices, it should not be ignored that many publications tend to emphasize new compounds and/or those for which interesting bioactivity has been measured. Near-ubiquitous (primarily plant-based) compounds, if broadly bioactive, tend to be overrepresented in the NP literature, yet the implication of their wide distribution in nature and associated patterns of non-specific activity are often underappreciated [59]. Ideally, all characterized compounds independent of structural novelty and/or bioactivity profile should be documented, and the sharing of verified structure-organism pairs is fundamental to the advancement of NP research.

The LOTUS initiative provides a framework for rigorous review and incorporation of new records and already presents a valuable overview of the distribution of NP occurrences studied to date. While current data presents a reasonable approximation of the chemistries of a few well-studied organisms such as Arabidopsis thaliana, it remains patchy for many other organisms represented in the dataset. Community participation is the most efficient means of achieving a better documentation of NP occurrences, and the comprehensive editing opportunities provided within LOTUS and through the associated Wikidata distribution platform open new opportunities for such collaborative engagement. In addition to facilitating the introduction of new data, it also provides a forum for critical review of existing data (see an example of a Wikidata Talk page here), as well as harmonization and verification of existing NP datasets as they come online.

Fostering FAIRness and TRUSTworthiness

The LOTUS harmonized data and dissemination of referenced structure-organism pairs through Wikidata, enables novel forms of queries and transformational perspectives in NP research. As LOTUS follows the guidelines of FAIRness and TRUSTworthiness, all researchers across disciplines can benefit from this opportunity, whether the interest is in ecology and evolution, chemical ecology, drug discovery, biosynthesis pathway elucidation, chemotaxonomy, or other research fields connected with NP.

Researchers worldwide uniformly acknowledge the limitations caused by the intrinsic unavailability of essential (raw) data [60]. In addition to being FAIR, LOTUS data is also open with a clear license, while closed data is still a major impediment to advancement of science [61]. The lack of progress in such direction is partly due to elements in the dissemination channels of the classical print and static PDF publication formats that complicate or sometimes even discourage data sharing, e.g., due to page limitations and economically motivated mechanisms, including those involved in the focus on and calculation of journal impact factors. In particular raw data such as experimental readings, spectroscopic data, instrumental measurements, statistical, and other calculations are valued by all, but disseminated by only very few. The immense value of raw data and the desire to advance the public dissemination has recently been documented in detail for nuclear magnetic resonance (NMR) spectroscopic data by a large consortium of NP researchers [62]. However, to generate the vital flow of contributed data, the effort associated with preparing and submitting content to open repositories as well as data reuse should be better acknowledged in academia, government, regulatory, and industrial environments [63,64,65]. The introduction of LOTUS provides here a new opportunity to advance the FAIR guiding principles for scientific data management and stewardship [14].

Opening New Perspectives for Spectral Data

The possibilities for expansion and future applications of the Wikidata-based LOTUS initiative are significant. For example, properly formatted spectral data (e.g. obtained by MS or NMR) can be linked to the Wikidata entries of the originating chemical compounds. MassBank [66] and SPLASH [67] identifiers are already reported in Wikidata, and this existing information can be used to report MassBank or SPLASH records for example for Arabidopsis thaliana compounds (https://w.wiki/3PJD). Such possibilities will help to bridge experimental data results obtained during the early stages of NP research with data that has been reported and formatted in different contexts. This opens exciting perspectives for structural dereplication, NP annotation, and metabolomic analysis. The authors have previously demonstrated that taxonomically-informed metabolite annotation is critical for the improvement of the NP annotation process [20]. Alternative approaches linking structural annotation to biological organisms have also shown substantial improvements [68]. In this context, the LOTUS initiative offers new opportunities for linking chemical objects to both their biological occurrences and spectral information and should significantly facilitate such applications.

Integrating Chemodiversity, Biodiversity, and Human Health

As shown in Figure 7-figure supplement 1, observing the chemical and biological diversity at various granularities offers new insights. Regarding the chemical objects involved, it will be important to document the taxonomies of chemical annotations for the Wikidata entries. However, this is a rather complex task, for which stability and coverage issues will have to be addressed first. Existing chemical taxonomies such as ChEBI, ClassyFire, or NPClassifier are evolving steadily, and it will be important to constantly update the tools used to make further annotations. Promising efforts have been undertaken to automate the inclusion of Wikidata structures into a chemical ontology. Such approach exploits the SMILES and SMARTS associated properties to infer a chemical classification for the structure. See for example the entry related to emericellolide B. Repositioning NP within their greater biosynthetic context is another major challenge - and active field of research. The fact that the LOTUS initiative disseminates its data through Wikidata will help facilitate further integration with biological pathway knowledge bases such as WikiPathways and contribute to this complex task [69,70].

In the field of ecology, molecular traits are gaining increased attention [71,72,73]. The LOTUS architecture can help to associate classical plant traits (e.g., leaf surface area, photosynthetic capacities, etc.) with Wikidata biological organisms entries, and, thus, allow their integration and comparison with chemicals that are associated with the organisms. Likewise, the association of biogeography data documented in repositories such as GBIF could be further exploited in Wikidata to pursue the exciting but understudied topic of “chemodiversity hotspots” [21].

Other NP-related information of great interest remains poorly formatted. One example of such a shortcoming relates to traditional medicine (and the field studying it: ethnomedicine and ethnobotany), which is the historical and empiric approach of mankind to discover and use bioactive products from Nature, primarily plants. The amount of knowledge generated in human history on the use of medicinal substances represents a fascinating yet underutilized amount of information. Notably, the body of literature on the pharmacology and toxicology of NP is compound-centric, increases steadily, and relatively scattered, but still highly relevant for exploring the role and potential utility of NP for human health. To this end, the LOTUS initiative represents a potential framework for new concepts by which such information could be valued and conserved in the digital era [74,75,76]. This underscores the transformative value of the LOTUS initiative for the advancement of traditional medicine and its interest for drug discovery in health systems worldwide.

Shortcomings & Challenges

Despite these strong advantages, the establishment and functioning of the LOTUS curation pipeline is not devoid of defaults and we list hereafter some of the observed shortcomings and associated challenges.

First, the LOTUS processing pipeline is heavy. It includes many dependencies and is convoluted. We tried to simplify the process and associated programs as much as possible but they remain consequent. This is the consequence of the heterogeneous nature of the source information and the number of successive operations required to process the data.

Second, while the overall objective of the LOTUS processing pipeline is to increase data quality, the pipeline also transforms data during the process, and, in some cases, data quality can be degraded or errors can be propagated. For example, regarding the chemical objects, the processing pipeline performs a systematic sanitization step that includes salt removal, uncharging of molecules and dimers resolving. We decided to apply this step systematically after observing a high ratio of artifacts within salts, charged or dimeric molecules. This thus implies that correct salts, charged or dimeric molecules in the input data will suffer an unwanted “sanitization” step. Also, the LOTUS processing step uses external libraries and tools for the automated “name to structure” and “structure to name” translations. These remain challenging as they rely on sets of predefined rules which do not cover all cases and can commonly lead to incorrect translations.

On the biological organisms curation side, we are aware of shortcomings, whether inherent to specific inputs or regarding limitations of the general process. Regarding inputs, some cases are clearly not resolvable except through human curation. For example, the word Lotus can refer both to the genus of a plant of the Fabaceae family (https://www.wikidata.org/wiki/Q3645698) or to the vernacular name of Nelumbo nucifera (https://www.wikidata.org/wiki/Q16528))). In fact, the name of the LOTUS Initiative comes, in part, from this taxonomic curiosity - and the challenge for its automated curation. To give another striking illustration, Ficus variegata corresponds both to a plant (https://www.wikidata.org/wiki/Q5446649) and to a mollusc (https://www.wikidata.org/wiki/Q502030). For specific names coming from traditional Chinese medicine or other sources using vernacular names, translation was dependent on hand curated dictionaries, which are clearly not exhaustive. Additionally, it is noteworthy to remind that the validation of the processed entries relies in part on partly imperfect rules, thus leading to erroneous entries in the output data. However, we also deliberately kept those rules restrictive in order to overall favor quality over quantity (see Figure 2).

Thus, despite our efforts, there is no doubt that incorrect structure-organism pairs have been uploaded on Wikidata (and some correct ones have not). We however expect that the editing facilities offered by this platform and community efforts will, over time, improve data quality.

Summary & Outlook

Despite these challenges, the various facets discussed above connect with ongoing and future developments that the tandem of the LOTUS initiative and its Wikidata integration can accommodate through a broader knowledge base. The information of the LOTUS initiative is already readily accessible by third party projects build on top of Wikidata such as the SLING project (https://github.com/ringgaard/sling, see entry for gliotoxin) or the Plant Humanities Lab project (https://lab.plant-humanities.org, see entry for Ilex guayusa in the “From Related Items” section). LOTUS data has also been integrated to PubChem (https://pubchem.ncbi.nlm.nih.gov/source/25132) to complement the natural products related metadata of this major chemical DB. For an example, see Gentiana lutea.

Behind the scenes, all underlying resources represent data in a multidimensional space and can be extracted as individual graphs, which can then be interconnected. The craft of appropriate federated queries allows users to navigate these graphs and fully exploit their potential [18,41]. The development of interfaces such as RDFFrames [77] will also facilitate the use of the wide arsenal of existing machine learning approaches to automate reasoning on these knowledge graphs.

Overall, the LOTUS initiative aims to make more and better data available. While we did our best to ensure high data quality, the current processing pipeline still removes a lot of correct entries and misses or induces some incorrect ones. Aware of those imperfections, our project hopefully paves the way for the establishment of an open, durable and expandable electronic NP resource. The design and efforts of the LOTUS initiative reflect our conviction that the integration of NP research results is long-needed and requires a truly open and FAIR approach to information dissemination, with high quality data directly flowing from its source to public knowledge bases. We believe that the LOTUS initiative has the potential to fuel a virtuous cycle of research habits and, as a result, contribute to a better understanding of Life and its chemistry.

Methods

Key Resources

Table 4: Key resources
Reagent type (species) or resource Designation Source or reference Identifiers Additional information
Software, algorithm Lotus-processor code This work (https://github.com/lotusnprod/lotus-processor) Archived at https://doi.org/10.5281/zenodo.5802107
Software, algorithm Lotus-web code This work (https://github.com/lotusnprod/lotus-web) Archived at https://doi.org/10.5281/zenodo.5802119
Software, algorithm Lotus-wikidata-interact code This work (https://github.com/lotusnprod/lotus-wikidata-interact) Archived at https://doi.org/10.5281/zenodo.5802113
Software, algorithm Global Names Architeture https://globalnames.org QID:Q65691453 See Additional executable files
Software, algorithm Java https://www.java.com QID:Q251
Software, algorithm Kotlin https://kotlinlang.org QID:Q3816639 See Kotlin packages
Software, algorithm Manubot https://manubot.org QID:Q96473455 RRID:SCR_018553 Repository available at https://github.com/lotusnprod/lotus-manuscript
Software, algorithm NPClassifier https://npclassifier.ucsd.edu See https://doi.org/10.1021/acs.jnatprod.1c00399
Software, algorithm OPSIN https://github.com/dan2097/opsin QID:Q26481302 See Additional executable files
Software, algorithm Python Programming Language https://www.python.org QID:Q28865 RRID:SCR_008394 See Python packages
Software, algorithm R Project for Statistical Computing https://www.r-project.org QID:Q206904 RRID:SCR_001905 See R packages
Software, algorithm Molconvert https://docs.chemaxon.com/display/docs/molconvert.md QID:Q55377678 See Chemical structures
Software, algorithm Wikidata https://www.wikidata.org QID:Q2013 RRID:SCR_018492 Project page https://www.wikidata.org/wiki/Wikidata:WikiProject_Chemistry/Natural_products
Other Lotus custom dictionaries This work Archived at https://doi.org/10.5281/zenodo.5801798
Other Chemical identifier resolver https://cactus.nci.nih.gov/chemical/structure See Chemical structures
Other CrossRef https://www.crossref.org QID:Q5188229 RRID:SCR_003217 See References
Other PubChem https://pubchem.ncbi.nlm.nih.gov QID:Q278487 RRID:SCR_004284 LOTUS data https://pubchem.ncbi.nlm.nih.gov/source/25132
Other PubMed https://pubmed.ncbi.nlm.nih.gov QID:Q180686 RRID:SCR_004846 See References
Other Taxonomic data sources https://resolver.globalnames.org/data_sources See Translation
Other Natural Products data sources See Appendix 1

Data Gathering

Before their inclusion, the overall quality of the source was manually assessed to estimate, both, the quality of referenced structure-organism pairs and the lack of ambiguities in the links between data and references. This led to the identification of thirty-six electronic NP resources as valuable LOTUS input. Data from the proprietary Dictionary of Natural Products (DNP v 29.2) was also used for comparison purposes only and is not publicly disseminated. FooDB was also curated but not publicly disseminated since its license proscribed sharing in Wikidata. Appendix 1 gives all necessary details regarding electronic NP resources access and characteristics.

Manual inspection of each electronic NP resource revealed that the structure, organism, and reference fields were widely variable in format and contents, thus requiring standardization to be comparable. The initial stage consisted of writing tailored scripts that are capable of harmonizing and categorizing knowledge from each source (Figure 1). This transformative process led to three categories: fields relevant to the chemical structure described, to the producing biological organism, and the reference describing the occurrence of the chemical structure in the producing biological organism. This process resulted in categorized columns for each source, providing an initial harmonized format for each table.

For all thirty-eight sources, if a single file or multiple files were accessible via a download option including FTP, data was gathered that way. For some sources, data was scraped (cf. Appendix 1). All scraping scripts can be found in the lotus-processor repository in the src/1_gathering directory (under each respective subdirectory). Data extraction scripts for the DNP are available and should allow users with a DNP license only to further exploit the data (src/1_gathering/db/dnp). The chemical structure fields, organism fields, and reference fields were manually categorized into three, two, and ten subcategories, respectively. For chemical structures, “InChI”, “SMILES”, and “chemical name” (not necessarily IUPAC). For organisms, “clean” and “dirty”, meaning lot text not referred to the canonical name was present or the organism was not described by its canonical name (e.g. “Compound isolated from the fresh leaves of Citrus spp.”). For the references, the original reference was kept in the “original” field. When the format allowed it, references were divided into: “authors”, “doi”, “external”, “isbn”, “journal”, “original”, “publishing details”, “pubmed”, “title”, “split”. The generic “external” field was used for all external cross-references to other websites or electronic NP resources (e.g. “also in knapsack”). The last subcategory, “split”, corresponds to a still non-atomic field after the removal of parts of the original reference. Other field titles are self-explanatory. The producing organism field was kept as a single field.

Data Harmonization

To perform the harmonization of all previously gathered sources, sixteen columns were chosen as described above. Upon electronic NP resources harmonization, resulting subcategories were divided and subject to further processing. The “chemical structure” fields were divided into files according to their subcategories (“InChI”, “names” and “SMILES”). A file containing all initial structures from all three subcategories was also generated. The same procedure was followed for organisms and references.

Data Processing

To obtain an unambiguously referenced structure-organism pair for Wikidata dissemination, the initial sixteen columns were translated and processed into three fields: the reported structure, the organism canonical name, and the reference. The structure was reported as InChI, together with its SMILES and InChIKey translation. The biological organism field was reported as three minimal necessary and sufficient fields, namely its canonical name and the taxonID and taxonomic DB corresponding to the latter. The reference was reported as four minimal fields, namely reference title, DOI, PMCID, and PMID, one being sufficient. For the forthcoming translation processes, automated solutions were used when available. However, for specific cases (common or vernacular names of the biological organisms, Traditional Chinese Medicine (TCM) names, and conversion between digital reference identifiers), no solution existed, thus requiring the use of tailored dictionaries. Their construction is detailed in the Dictionaries section. The initial entries (containing one or multiple producing organisms per structure, with one or multiple accepted names per organism) were processed into 2M+ referenced structure-organism pairs.

Chemical Structures

To retrieve as much information as possible from the original structure field(s) of each of the sources, the following procedure was followed. Allowed structural fields for the sources were divided into two types: structural (InChI, SMILES) or nominal (chemical name, not necessarily IUPAC). If multiple fields were present, structural identifiers were preferred over structure names. Among structural identifiers, when both identifiers were present, SMILES was preferred over InChI. InChI were translated to SMILES using the RDKit (2021.09.2) implementation in Python 3.8 (src/2_curating/2_editing/structure/1_translating/inchi.py). They were first converted to ROMol objects which were then converted to SMILES. When no structural identifier was available, the nominal identifier was translated to InChI first thanks to OPSIN [78], a fast Java-based translation open-source solution. If no translation was obtained, chemical names were then submitted to the PUG-REST, the interface for programmatic access to PubChem [79,80]. If again no translation was obtained, candidates were then submitted to the Chemical Identifier Resolver. Before the translation process, some typical chemical structure-related greek characters (such as α, ß) were replaced by their textual equivalents (alpha, beta) to obtain better results. All pre-translation steps are included in the preparing_name function and are available in src/r/preparing_name.R.

The chemical sanitization step sought to standardize the representation of chemical structures coming from different sources. It consisted of three main stages (standardizing, fragment removal, and uncharging) achieved via the MolVS package. The initial standardizer function consists of six stages (RDKit Sanitization, RDKit Hs removal, Metals Disconnection, Normalization, Acids Reionization, and Stereochemistry recalculation) detailed in the molvs documentation. In a second step, the FragmentRemover functionality was applied using a list of SMARTS to detect and remove common counterions and crystallization reagents sometimes occurring in the input DB. Finally, the Uncharger function was employed to neutralize molecules when appropriate.

Molconvert function of the MarvinSuite was used for traditional and IUPAC names translation, Marvin 20.19, ChemAxon. When stereochemistry was not fully defined, (+) and (-) symbols were removed from names. All details are available in the following script: src/2_curating/2_editing/structure/4_enriching/naming.R. Chemical classification of all resulting structures was done using classyfireR [46] and NPClassifier API.

After manual evaluation, structures remaining as dimers were discarded (all structures containing a “.” in their SMILES were removed).

From the 283,267 initial InChI, 242,068 (85%) sanitized structures were obtained, of which 185,929 (77%) had complete stereochemistry defined. 203,718 (72%) were uploaded to Wikidata. From the 248,185 initial SMILES, 207,658 (84%) sanitized structures were obtained, of which 98,685 (48%) had complete stereochemistry defined. 174,091 (70%) were uploaded to Wikidata. From the 49,675 initial chemical names, 27,932 (56%) sanitized structures were obtained, of which 17,460 (63%) had complete stereochemistry defined. 23,036 (46%) were uploaded to Wikidata. In total, 163,800 structures with fully defined stereochemistry were uploaded as “chemical compounds” (Q11173), and 106,669 structures without fully defined stereochemistry were uploaded as “group of stereoisomers” (Q59199015).

Biological Organisms

The processing at the biological organism’s level had three objectives: convert the original organism string to (a) taxon name(s), atomize fields containing multiple taxon names, and deduplicate synonyms. The original organism strings were treated with Global Names Finder (GNF) and Global Names Verifier (GNV), both tools coming from the Global Names Architecture (GNA) a system of web services that helps people to register, find, index, check and organize biological scientific names and interconnect on-line information about species. GNF allows scientific name recognition within raw text blocks and searches for found scientific names among public taxonomic DB. GNV takes names or lists of names and verifies them against various biodiversity data sources. Canonical names, their taxonID, and the taxonomic DB they were found in were retrieved. When a single entry led to multiple canonical names (accepted synonyms), all of them were kept. Because both GNF and GNV recognize scientific names and not common ones, common names were translated before a second resubmission.

Dictionaries

To perform the translations from common biological organism name to latin scientific name, specialized dictionaries included in DrDuke, FooDB, PhenolExplorer were aggregated together with the translation dictionary of GBIF Backbone Taxonomy. The script used for this was src/1_gathering/translation/common.R. When the canonical translation of a common name contained a specific epithet that was not initially present, the translation pair was discarded (for example, “Aloe” translated in “Aloe vera” was discarded). Common names corresponding to a generic name were also discarded (for example “Kiwi” corresponding to the synonym of an Apteryx spp. (https://www.gbif.org/species/4849989)). When multiple translations were given for a single common name, the following procedure was followed: the canonical name was split into species name, genus name, and possible subnames. For each common name, genus names and species names were counted. If both the species and genus names were consistent at more than 50%, they were considered consistent overall and, therefore, kept (for example, “Aberrant Bush Warbler” had “Horornis flavolivaceus” and “Horornis flavolivaceus intricatus” as translation; as both the generic (“Horornis”) and the specific (“flavolivaceus”) epithets were consistent at 100%, both (“Horornis flavolivaceus”) were kept). When only the generic epithet had more than 50% consistency, it was kept (for example, “Angelshark” had “Squatina australis” and “Squatina squatina” as translation, so only “Squatina” was kept). Some unspecific common names were removed (see https://doi.org/10.5281/zenodo.5801816 [81]) and only common names with more than three characters were kept. This resulted in 181,891 translation pairs further used for the conversion from common names to scientific names. For TCM names, translation dictionaries from TCMID, TMMC, and coming from the Chinese Medicine Board of Australia were aggregated. The script used for this was src/1_gathering/translation/tcm.R. Some unspecific common names were removed (see https://doi.org/10.5281/zenodo.5801816 [81]). Careful attention was given to the Latin genitive translations and custom dictionaries were written (see https://doi.org/10.5281/zenodo.5801816 [81]). Organ names of the producing organism were removed to avoid wrong translation (see https://doi.org/10.5281/zenodo.5801816 [81]). This resulted in 7,070 translation pairs. Both common and TCM translation pairs were then ordered by decreasing string length, first translating the longer names to avoid part of them being translated incorrectly.

Translation

To ensure compatibility between obtained taxonID with Wikidata, the taxonomic DB 3 (ITIS), 4 (NCBI), 5 (Index Fungorum), 6 (GRIN Taxonomy for Plants), 8 (The Interim Register of Marine and Nonmarine Genera), 9 (World Register of Marine Species), 11 (GBIF Backbone Taxonomy), 12 (Encyclopedia of Life), 118 (AmphibiaWeb), 128 (ARKive), 132 (ZooBank), 147 (Database of Vascular Plants of Canada (VASCAN)), 148 (Phasmida Species File), 150 (USDA NRCS PLANTS Database), 155 (FishBase), 158 (EUNIS), 163 (IUCN Red List of Threatened Species), 164 (BioLib.cz), 165 (Tropicos - Missouri Botanical Garden), 167 (The International Plant Names Index), 169 (uBio NameBank), 174 (The Mammal Species of The World), 175 (BirdLife International), 179 (Open Tree of Life), 180 (iNaturalist) and 187 (The eBird/Clements Checklist of Birds of the World) were chosen. All other available taxonomic DB are listed at http://index.globalnames.org/datasource. To retrieve as much information as possible from the original organism field of each of the sources, the following procedure was followed: First, a scientific name recognition step, allowing us to retrieve canonical names was carried (src/2_curating/2_editing/organisms/subscripts/1_processingOriginal.R). Then, a subtraction step of the obtained canonical names from the original field was applied, to avoid unwanted translation of parts of canonical names. For example, Bromus mango contains “mango” as a specific epithet, which is also the common name for Mangifera indica. After this subtraction step, the remaining names were translated from vernacular (common) and TCM names to scientific names, with help of the dictionaries. For performance reasons, this processing step was written in Kotlin and used coroutines to allow efficient parallelization of that process (src/2_curating/2_editing/organisms/2_translating_organism_kotlin/). They were subsequently submitted again to scientific name recognition (src/2_curating/2_editing/organisms/3_processingTranslated.R).

After full resolution of canonical names, all obtained names were submitted to rotl [82] to obtain a unified taxonomy. From the 88,395 initial “clean” organism fields, 43,936 (50%) canonical names were obtained, of which 32,285 (37%) were uploaded to Wikidata. From the 300 initial “dirty” organism fields, 250 (83%) canonical names were obtained, of which 208 (69%) were uploaded to Wikidata.

References

The Rcrossref package [83] interfacing with the Crossref API was used to translate references from their original subcategory (“original”, “publishingDetails”, “split”, “title”) to a DOI, the title of its corresponding article, the journal it was published in, its date of publication and the name of the first author. The first twenty candidates were kept and ranked according to the score returned by Crossref, which is a tf-idf score. For DOI and PMID, only a single candidate was kept. All DOIs were also translated with this method, to eventually discard any DOI not leading to an object. PMIDs were translated, thanks to the entrez_summary function of the rentrez package [84]. Scripts used for all subcategories of references are available in the directory src/2_curating/2_editing/reference/1_translating/. Once all translations were made, results coming from each subcategory were integrated, (src/2_curating/2_editing/reference/2_integrating.R) and the producing organism related to the reference was added for further treatment. Because the crossref score was not informative enough, at least one other metric was chosen to complement it. The first metric was related to the presence of the producing organism’s generic name in the title of the returned article. If the title contained the generic name of the organism, a score of 1 was given, else 0. Regarding the subcategories “doi”, “pubmed” and “title”, for which the same subcategory was retrieved via crossref or rentrez, distances between the input’s string and the candidates’ one were calculated. Optimal string alignment (restricted Damerau-Levenshtein distance) was used as a method. Among “publishing details”, “original” and “split” categories, three additional metrics were used: If the journal name was present in the original field, a score of 1 was given, else 0. If the name of the first author was present in the original field, a score of 1 was given, else 0. Those three scores were then summed together. All candidates were first ordered according to their crossref score, then by the complement score for related subcategories, then again according to their title-producing organism score, and finally according to their translation distance score. After this re-ranking step, only the first candidate was kept. Finally, the Pubmed PMCID dictionary (PMC-ids.csv.gz) was used to perform the translations between DOI, PMID, and PMCID (src/2_curating/2_editing/reference/3_processing.R).

From the 36,710 initial “original” references, 21,970 (60%) references with sufficient quality were obtained, of which 15,588 (71%) had the organism name in their title. 14,710 (40%) were uploaded to Wikidata. From the 21,953 initial “pubmed” references, 9,452 (43%) references with sufficient quality were obtained, of which 6,098 (65%) had the organism name in their title. 5,553 (25%) were uploaded to Wikidata. From the 37,371 initial “doi” references, 20,139 (54%) references with sufficient quality were obtained, of which 15,727 (78%) had the organism name in their title. 15,351 (41%) were uploaded to Wikidata. From the 29,600 initial “title” references, 17,417 (59%) references with sufficient quality were obtained, of which 12,675 (73%) had the organism name in their title. 10,725 (36%) were uploaded to Wikidata. From the 11,325 initial “split” references, 5,856 (52%) references with sufficient quality were obtained, of which 3,206 (55%) had the organism name in their title. 2,854 (25%) were uploaded to Wikidata. From the 3,314 initial “publishingDetails” references, 119 (4%) references with sufficient quality were obtained, of which 59 (50%) had the organism name in their title. 58 (2%) were uploaded to Wikidata.

Data Realignment

In order to fetch back the referenced structure-organism pairs links in the original data, the processed structures, processed organisms, and processed references were re-aligned with the initial entries. This resulted in 6.2M+ referenced structure-organism pairs. Those pairs were not unique, with redundancies among electronic NP resources and different original categories leading to the same final pair (for example, entry reporting InChI=1/C21H20O12/c22-6-13-15(27)17(29)18(30)21(32-13)33-20-16(28)14-11(26)4-8(23)5-12(14)31-19(20)7-1-2-9(24)10(25)3-7/h1-5,13,15,17-18,21-27,29-30H,6H2/t13-,15+,17+,18-,21+/m1/s1 in Crataegus oxyacantha or InChI=1S/C21H20O12/c22-6-13-15(27)17(29)18(30)21(32-13)33-20-16(28)14-11(26)4-8(23)5-12(14)31-19(20)7-1-2-9(24)10(25)3-7/h1-5,13,15,17-18,21-27,29-30H,6H2/t13-,15+,17+,18-,21+/m1/s1 in Crataegus stevenii both led to OVSQVDMCBVZWGM-DTGCRPNFSA-N in Crataegus monogyna). After deduplication, 2M+ unique structure-organism pairs were obtained.

After the curation of all three objects, all of them were put together again. Therefore, the original aligned table containing the original pairs was joined with each curation result. Only entries containing a structure, an organism, and a reference after curation were kept. Each curated object was divided into minimal data (for Wikidata upload) and metadata. A dictionary containing original and curated object translations was written for each object to avoid those translations being made again during the next curation step (src/2_curating/3_integrating.R).

Data Validation

The pairs obtained after curation were of different quality. Globally, structure and organism translation was satisfactory whereas reference translation was not. Therefore, to assess the validity of the obtained results, a randomized set of 420 referenced structure-organism pairs was sampled in each reference subcategory and validated or rejected manually. Entries were sampled with at least 55 of each reference subcategory present (to get a representative idea of each subcategory) (src/3_analyzing/1_sampling.R). An entry was only validated if: i) the structure (as any structural descriptor that could be linked to the final sanitized InChIKey) was described in the reference ii) the producing organism (as any organism descriptor that could be linked to the accepted canonical name) was described in the reference and iii) the reference was describing the occurrence of the chemical structure in the biological organism. Results obtained on the manually analyzed set were categorized according to the initial reference subcategory and are detailed in Appendix 2. To improve these results, further processing of the references was needed. This was done by accepting entries whose reference was coming from a DOI, a PMID, or from a title which restricted Damerau-Levenshtein distance between original and translated was lower than ten or if it was coming from one of the three main journals where NP occurrences are commonly expected to be published (i.e., Journal of Natural Products, Phytochemistry, or Journal of Agricultural and Food Chemistry). For “split”, “publishingDetails” and “original” subcategories, the year of publication of the obtained reference, its journal, and the name of the first author were searched in the original entry and if at least two of them were present, the entry was kept. Entries were then further filtered to keep the ones where the reference title contained the first element of the detected canonical name. Except for COCONUT, exceptions to this filter were made for all DOI-based references. The function resulting from those rules is (filter_dirty.R). To validate those filtering criteria, an additional set of 100 structure-organism pairs were manually analyzed. F0.5 score was used as a metric. F0.5 score is a modified F1 score where precision has twice more weight than recall. The F-score was calculated with ß = 0.5, as in Equation 1:

\({F_{\beta}\ =\ \left(1+\beta^2\right)\cdot\frac{precision\cdot recall}{\left(\beta^2\ \cdot\ precision\right)\ +\ recall}}\)(1)

Based on this first manually validated dataset, filtering criteria (src/r/filter_dirty.R) were established to maximize precision and recall. Another 100 entries were sampled, this time respecting the whole set ratios. After manual validation, 97% of true positives were reached on the second set. A summary of the validation results is given in Appendix 2. Once validated, the filtering criteria were established to the whole curated set to filter entries chosen for dissemination (src/3_analyzing/2_validating.R).

Unit Testing

To provide robustness of the whole process and code, unit tests and partial data full-tests were written. They can run on the developer machine but also on the CI/CD system (GitHub) upon each commit to the codebase.

Those tests assess that the functions are providing results coherent with what is expected especially for edge cases detected during the development. The Kotlin code has tests based on JUnit and code quality control checks based on Ktlint, Detekt and Ben Mane’s version plugin.

Data Dissemination

Wikidata

All the data produced for this work has been made available on Wikidata under a Creative Commons 0 license according to Wikidata:Licensing. This is a “No-rights-reserved” license that places no restrictions on reuse.

Lotus.NaturalProducts.Net (LNPN)

The web interface is implemented following the same protocol as described in the COCONUT publication [15] i.e. the data are stored in a MongoDB repository, the backend runs with Kotlin and Java, using the Spring framework, and the frontend is written in React.js, and completely Dockerized. In addition to the diverse search functions available through this web interface, an API is also implemented, allowing programmatic LNPN querying. The complete API usage is described on the “Documentation” page of the website. LNPN is part of the NaturalProducts.net portal, an initiative aimed at gathering diverse open NP resources in one place.

Data Interaction

Data Retrieval

Bulk retrieval of a frozen (2021-12-20) version of LOTUS data is also available at https://doi.org/10.5281/zenodo.5794106 [25].

The download lotus part of lotus-wikidata-interact allows the download of all chemical compounds with a “found in taxon” property. That way, it does not only get the data produced by this work, but any that would have existed beforehand or that would have been added directly on Wikidata by our users. It makes a copy of all the entities (compounds, taxa, references) into a local triplestore that can be queried with SPARQL as is or converted to a TSV file for inclusion in other projects. It is currently adapted to export directly into the SSOT thus allowing direct reuse by the processing/curation pipeline.

Data Addition

Wikidata

Data is loaded by the Kotlin importer available in the upload lotus part of lotus-wikidata-interact repository under a GPL V3 license and imported into Wikidata. The importer processes the curated outputs grouping references, organisms, and compounds together. It then checks if they already exist in Wikidata (using SPARQL or a direct connection to Wikidata depending on the kind of data). It then uses update or insert, also called upsert, the entities as needed. The script currently takes the tabular file of the referenced structure-organism pairs resulting from the LOTUS curation process as input. Before upload, a filtering step is performed in order to avoid re-uploading entries we already uploaded. This way, if modifications occur in Wikidata, it will not be erased by the next iteration of the importer. The importer is currently being adapted to use directly the SSOT and avoid an unnecessary conversion step. To import references, it first double checks for the presence of duplicated DOIs and utilizes the Crossref REST API to retrieve metadata associated with the DOI, the support for other citation sources such as Europe PMC is in progress. The structure-related fields are only subject to limited processing: basic formatting of the molecular formula by subscripting of the numbers. Due to limitations in Wikidata, the molecule names are dropped if they are longer than 250 characters and likewise the InChI strings cannot be stored if they are longer than 1500 characters.

Uploaded taxonomical DB identifiers are currently restricted to ITIS, GBIF, NCBI Taxon, Index Fungorum, IRMNG, WORMS, VASCAN, and iNaturalist, and newly OTL. The taxa levels are currently limited to family, subfamily, tribe, subtribe, genus, species, variety. The importer checks for the existence of each item based on their InChIKey and upserts the compound with the found in taxon statement and the associated organisms and references.

LNPN

From the onset, LNPN has been importing data directly from the frozen tabular data of the LOTUS dataset (https://doi.org/10.5281/zenodo.5794106 [25]). In future versions, LNPN will directly feed on the SSOT.

Data Edition

The bot framework lotus-wikidata-interact was adapted such that, in addition to batch upload capabilities, it can also edit erroneously created entries on Wikidata. As massive edits have a large potential to disrupt otherwise good data, progressive deployment of this script is used, starting by editing progressively 1, 10, then 100 entries that are manually checked. Upon validation of 100 entries, the full script is run and check its behavior checked at regular intervals. An example of a corrected entry is as follows: https://www.wikidata.org/w/index.php?title=Q105349871&type=revision&diff=1365519277&oldid=1356145998

Curation interface

A web-based (Kotlin, Spring Boot for the back-end, and TypeScript with Vue for the front-end) curation interface is currently in construction. It will allow mass-editing of entries and navigate quick navigation in the SSOT for the curation of new and existing entries. This new interface is intended to become open to the public to foster the curation of entries by further means, driven by the users. In line with the overall LOTUS approach, any modification made in this curation interface will be mirrored after validation on Wikidata and LNPN.

Code Availability

General Repository

All programs written for this work can be found in the following group: https://github.com/lotusnprod.

Processing

The source data curation system is available at https://github.com/lotusnprod/lotus-processor. This program takes the source data as input and outputs curated data, ready for dissemination. The first step involves checking if the source data has already been processed. If not, all three elements (biological organism, chemical structures, and references) are submitted to various steps of translation and curation, before validation for dissemination.

Wikidata

The programs to interact with Wikidata are available at https://github.com/lotusnprod/lotus-wikidata-interact. On the upload side, the program takes the processed data resulting from the lotusProcessor subprocess as input and uploads it to Wikidata. It performs a SPARQL query to check which objects already exist. If needed, it creates the missing objects. It then updates the content of each object. Finally, it updates the chemical compound page with a “found in taxon” statement complemented with a “stated in” reference. A publication importer creating an article page from a DOI is also available.

On the download side, the program takes the structured data in Wikidata corresponding to chemical compounds found in taxa with a reference associated as input and exports it in both RDF and tabular formats for further use. Two subsequent options are (a) that the end-user can directly use the exported data.; or (b) that the exported data, which can be new or modified since the last iteration, is used as new source data in lotusProcessor.

LNPN

The LNPN website and processing system is available at https://github.com/lotusnprod/lotus-web. This system takes the processed data resulting from the lotusProcessor as input and uploads it on https://lotus.naturalproducts.net. The repository is not part of the main GitHub group as it benefits from already established pipelines developed by CS and MS. The website allows searches from different points of view, complemented with taxonomies for both the chemical and biological sides. Many chemical molecular properties and molecular descriptors that otherwise are unavailable in Wikidata are also provided.

Code Freezing

All repository hyperlinks in the manuscript point to the main branches by default. The links contain all programs and code and will eventually be updated to a publication branch using modifications resulting from the peer-reviewing process. As the code evolves, readers are invited to refer to the main branch of each repository for the most up-to-date code. A frozen version (2021-12-23) of all programs and code is also available in the LOTUS Zenodo community (5802107 [85], 5802113 [86], and 5802120 [87]).

Programs and packages

R

The R versions used for the project were 4.0.2 up to 4.1.2, and R-packages used were, in alphabetical order: ChemmineR (3.42.1) [88], chorddiag (0.1.3) [89], ClassyfireR (0.3.6) [46], data.table (1.14.2) [90], DBI (1.1.1) [91], gdata (2.18.0) [92], ggalluvial (0.12.3) [93], ggfittext (0.9.1) [94], ggnewscale (0.4.5) [95], ggraph (2.0.5) [96], ggstar (1.0.2) [97], ggtree (3.2.0) [98], ggtreeExtra (1.4.0) [99], jsonlite (1.7.2) [100], pbmcapply (1.5.0) [101], plotly (4.10.0) [102], rcrossref(1.1.0.99) [83], readxl (1.3.1) [103], rentrez (1.2.3) [84], rotl (3.0.11) [82], rvest (1.0.2) [104], splitstackshape (1.4.8) [105], RSQLite (2.2.8) [106], stringdist (0.9.8) [107], stringi (1.7.6) [108], tidyverse (1.3.1) [109], treeio (1.18.0) [45], UpSetR (1.4.0) [110], webchem (1.1.1) [111], XML (3.99-0.8) [112], xml2 (1.3.3) [113]

Python

The Python version used was 3.7.12 up to 3.9.7, and the Python packages utilized were, in alphabetical order: cmcrameri (1.4) [114,115], faerun (0.3.20) [48], map4 (1.0) [50], matplotlib (3.5.0) [116], Molvs (0.1.1), pandas (1.3.4) [117], rdkit (2021.09.2) [118], scipy (1.7.3) [119], tmap (1.0.4) [47].

Kotlin

Kotlin packages used were as follows: Common: Kotlin 1.4.21 up to 1.6.0, Univocity 2.9.1, OpenJDK 15, Kotlin serialization 1.3.1, konnector 0.1.34, Log4J 2.14.1 Wikidata Importer Bot:, wdkt 0.12.1, CDK 2.5 [120], RDF4J 3.7.4, Ktor 1.6.5, KotlinXCli 0.3.3, Wikidata data processing: Shadow 5.0.0 Quality control and testing: Ktlint 10.2.0, Kotlinter 3.3.0, Detekt 1.15.0, Ben Mane’s version plugin 0.36.0, Junit 5.8.1

Additional executable files

GNFinder v.0.16.3, GNVerifier v.0.6.1, OPSIN v.2.5.0 [78]

Data Availability

A snapshot of the obtained data at the time of re-submission (2021-12-20) is available at the following Zenodo community: https://zenodo.org/communities/the-lotus-initiative (and related records, for data: 5793224 [121], 5794107 [122], 5794597 [121], 5794597 [81]. The https://lotus.nprod.net website is intended to gather news and features related to the LOTUS initiative in the future.

Acknowledgments

AR, JLW and PMA are thankful to the Swiss National Science Foundation for supporting part of this project through the SNF Sinergia grant CRSII5_189921. JB and AR are really thankful to JetBrains for the Free educational license of IntelliJ and the excellent support received on Youtrack. JB, JGG, and GFP gratefully acknowledge the support of this work by grant U41 AT008706 and supplemental funding to P50 AT000155 from NCCIH and ODS of the NIH. MS and CS are supported by the German Research Foundation within the framework ChemBioSys (Project-ID 239748522, SFB 1127). EW and DM acknowledge the Scholia grant from the Alfred P. Sloan Foundation under grant number G-2019-11458. The work on the Wikidata IDSM/Sachem endpoint was supported by an ELIXIR CZ research infrastructure project grant (MEYS Grant No: LM2018131) including access to computing and storage facilities. The authors would like to thank Dmitry Mozzherin for his work done for the Global Names Architecture and related improvements. They would like to acknowledge help from the PubChem team in integrating LOTUS, especially Dr. Tiejun Cheng and Dr. Evan Bolton. The authors would also like to thank Layla Michán for starting to add pigment information on Wikidata. The authors would also like to thank the team behind Manubot [123], used to write this manuscript. The authors would also like to thank contributors of all electronic NP resources used in this work and the NP community at large.

Competing interests

The authors declare no competing interest.

Appendices

Appendix 1 Data Sources List

Table 5: Data Sources List
database type initial retrieved unique entries cleaned referenced structure-organism pairs pairs validated for wikidata export actual validated pairs on wikidata website article retrieval license status contact dump status
afrotryp open 313 93 55 54 - article [124] download license_copyright Fidele Ntie-Kang or Ngozi Justina Nwodo YES unmaintained
alkamid open 4416 2639 2309 2160 website article [125] script license_copyright Bart De Spiegeleer NO maintained
antibase commercial 46956 45221 - - - - - - - NO unmaintained
antimarin commercial 73017 67559 - - - - - - - NO unmaintained
biofacquim open 531 519 519 511 website (old version) article_old article_new [126] download license_CCBY_4.0 José Medina-Franco YES maintained
biophytmol open 543 558 322 308 website article [127] script license_CCBY Anshu Bhardwaj NO unmaintained
carotenoiddb open 2922 639 530 485 website article [128] script license_copyright yzjunko@gmail.com NO maintained
coconut open 5757872 5723691 153981 140877 website article [129] download license_CCBY_4.0 Maria Sorokina YES maintained
cyanometdb open 1905 1631 1621 1605 - article [28] download license_CCBY_4.0 elisabeth.janssen@eawag.ch YES maintained
datawarrior open 589 541 71 60 website article [29] download no_license thomas.sander@idorsia.com YES retired
dianatdb open 290 323 115 111 website article [31] download license_CCBY_NC amadariaga@iquimica.unam.mx or kmtzm@unam.mx YES maintained
dnp commercial 205072 254573 - - website - script - support@taylorfrancis.com NO maintained
drduke open 90675 9660 6184 5222 website - download license_CC0 agref@usda.gov YES maintained
foodb restricted 81941 39662 - - website - download license_CCBY_NC jreid3@ualberta.ca (Jennifer) YES unmaintained
inflamnat open 665 632 306 268 - article [130] download license_copyright xiaoweilie@ynu.edu.cn YES unmaintained
knapsack open 132127 139336 59945 55186 website article [10,131] script license_copyright skanaya@gtc.naist.jp NO maintained
metabolights open 38208 37704 6241 5687 website article [132] download license_copyright - YES maintained
mibig open 1310 1139 638 535 website article [57] download license_CCBY_4.0 Tilmann Weber orMarnix Medema YES unmaintained
mitishamba open 1071 534 294 291 website article [133] script license_copyright - NO defunct
nanpdb open 5752 6383 5937 5283 website article [134] script license_copyright ntiekfidele@gmail.com stefan.guenther@pharmazie.uni-freiburg.de NO maintained
napralert commercial 681401 392498 294818 270743 website article [11] - license_copyright napralert@uic.edu NO defunct
npass open 290535 30185 25429 23612 website article [135] download license_CCBY_NC phacyz@nus.edu.sg jiangyy@sz.tsinghua.edu.cn iaochen@163.com YES unmaintained
npatlas open 32539 34726 34548 33087 website article [12,13] download license_CCBY_4.0 rliningt@sfu.ca YES maintained
npcare open 7763 5878 3790 3538 website article [136] download license_CCBY_4.0 choihwanho@gmail.com YES unmaintained
npedia open 82 99 28 28 website article [137] script no_license hisyo@riken.jp npd@riken.jp NO defunct
nubbe open 2189 2340 2340 2119 website article [138] - license_copyright Vanderlan S. Bolzani NO maintained
pamdb open 3046 2820 24 24 website article [139] download license_CCBY_NC awilks@rx.umaryland.edu aoglesby@rx.umaryland.edu mkane@rx.umaryland.edu YES unmaintained
phenolexplorer open 8077 8700 7123 5721 website article [140] download license_copyright scalberta@iarc.fr YES unmaintained
phytohub open 2349 1145 132 94 website article [141] script no_license claudine.manach@inra.fr YES unmaintained
procardb open 6556 6278 60 55 website article [142] script license_CCBY_4.0 Anil Kumar Pinnaka Ashwani Kumar NO unmaintained
respect open 2759 1064 634 547 website article [143] download license_CCBY_NC_2.1_Japan ksaito@psc.riken.jp YES unmaintained
sancdb open 860 925 747 732 website article [144] script license_CCBY_4.0 Özlem Tastan Bishop NO unmaintained
streptomedb open 71638 33217 20715 18395 website article [145] download license_copyright stefan.guenther@pharmazie.uni-freiburg.de YES maintained
swmd open 1075 1751 1597 1479 website article [146] script license_CCBY_4.0 Dicky.John@gmail.com NO unmaintained
tmdb open 2116 533 26 24 website article [147] script license_copyright Xiao-Chun Wan Guan-Hu Bao NO unmaintained
tmmc open 15033 7833 5826 4015 website article [148] download license_copyright Jeong-Ju Lee YES unmaintained
tppt open 27182 23872 684 641 website article [149] download license_copyright thomas.bucheli@agroscope.admin.ch YES unmaintained
unpd open 331242 304683 211158 197710 website article [150] - license_CCBY_4.0 lirongc@pku.edu.cn xiaojxu@pku.edu.cn NO defunct
wakankensaku open 367 224 208 202 website - script - - NO defunct
wikidata open 951268 960611 959747 919752 website - download license_CC0 - YES maintained

Appendix 2 Summary of the Validation Statistics

Table 6: Summary of the Validation Statistics
First validation dataset (n =420) Second validation dataset (n = 100)
Reference Type True positive False positive False negative True negative Ratio Precision Recall F0.5 score True positive False negative
Original 80 6 7 11 0.31 0.93 0.92 0.92 38 1
Pubmed 37 1 5 6 0.30 0.97 0.88 0.92 5 1
DOI 115 6 0 6 0.19 0.95 1.00 0.97 43 1
Title 38 2 0 16 0.12 0.95 1.00 0.97 7 0
Split 8 0 15 27 0.08 1.00 0.35 0.52 4 0
Publishing details 1 0 1 32 0.01 1.00 0.50 0.67 0 0
Total 279 15 28 98 1.00 - - - 97 3
Corrected total - - - - - 0.96 0.89 0.91 - -

Appendix 3 Wikidata Queries

Query 1 - Arabidopsis thaliana

This query answers to the following question:

What are the compounds found in Mouse-ear cress Arabidopsis thaliana (Q158695) or children taxa?

Link: https://w.wiki/4Vcv

#title: What are the compounds found in Mouse-ear cress Arabidopsis thaliana (Q158695) or children taxa?
SELECT DISTINCT ?structure ?structureLabel ?structure_inchi WHERE {
  VALUES ?taxon {
    wd:Q158695                           # You can remove the Qxxxxxx and hit Ctrl+space, type the first letters and it should autocomplete
  }
  ?children (wdt:P171*) ?taxon.          # Include children taxa
  ?structure wdt:P234 ?structure_inchi;  # Get the InChI
    (p:P703/ps:P703) ?children.          # Found in given taxon/taxa
  SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
}

Query 2 - β-sitosterol

This query answers to the following question:

Which organisms are known to contain β-sitosterol?

Link: https://w.wiki/4VFn

#title: Which organisms are known to contain Beta-Sitosterol (Q121802)?
SELECT DISTINCT ?taxon ?taxon_name WHERE {
  VALUES ?compound {
    wd:Q121802                       # You can remove the Qxxxxxx and hit Ctrl+space, type the first letters and it should autocomplete
  }
  ?compound (p:P703/ps:P703) ?taxon. # Found in taxon
  ?taxon wdt:P225 ?taxon_name.       # Get scientific name of the taxon
  SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
}

Query 3 - β-sitosterol stereoisomers

This query answers to the following question:

Which organisms are known to contain which stereoisomers of β-sitosterol?

Link: https://w.wiki/4VFq

#title: Which organisms are known to contain stereoisomers of Beta-Sitosterol (Q121802)?
SELECT ?taxon_name ?compound ?InChIKey 
WITH {
  SELECT ?compound ?InChIKey WHERE {
    VALUES ?target {
      wd:Q121802
    }
    ?target wdt:P235 ?queryKey.
    ?compound wdt:P235 ?InChIKey.
    FILTER (REGEX(STR(?InChIKey), CONCAT("^", SUBSTR($queryKey,1,14), "-")))
    FILTER (?InChIKey != ?queryKey)
  }
} AS %compounds
WHERE {
  INCLUDE %compounds
          ?compound (wdt:P703/wdt:P225) ?taxon_name.
  SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
}

Query 4 - Pigments

This query answers to the following question:

Which pigments are found in which taxa, according to which reference?

Link: https://w.wiki/4VFx

#title: Which pigments are found in which taxa, according to which reference?
# special thanks goes to User:Lmichan for updating this information!
SELECT DISTINCT ?compound ?compoundLabel ?taxon ?taxonname ?DOI 
WITH {
  SELECT ?compound WHERE {
    ?compound (wdt:P31*/wdt:P279*) wd:Q161179.  # get pigments
  }
} AS %compounds
WITH {
  SELECT ?compound ?P703statement WHERE {
    INCLUDE %compounds
            ?compound p:P703 ?P703statement.    # check for "found in taxon" statements
  }
} AS %P703statement
WITH {
  SELECT ?compound ?taxon ?DOI WHERE {
    INCLUDE %P703statement
            ?P703statement ps:P703 ?taxon ;     # get the respective taxa
            prov:wasDerivedFrom / pr:P248 [     # get the reference supporting that statement
              wdt:P356 ?DOI                     # get the DOI for the reference
            ] .
  }
} AS %taxa
WHERE {
  {
    INCLUDE %taxa

            ?taxon wdt:P225 ?taxonname .        # get the taxon name
  }
  ?compound rdfs:label ?compoundLabel .         # get compound labels
  FILTER (LANG(?compoundLabel) = "en") .        # filter for English
}
ORDER BY ASC(?compoundLabel)
LIMIT 10000

Query 5 - Sister taxon compounds

This query answers to the following question:

What are examples of organisms where compounds were found in an organism sharing the same parent taxon, but not in the organism itself?

Link: https://w.wiki/4Wt3

#title: What are examples of organisms where compounds were found in an organism sharing the same parent taxon, but not the organism itself?
SELECT DISTINCT ?compound ?compoundLabel ?taxonname_with_compound ?taxonname_without_compound ?parent_taxon WITH{ 
  SELECT DISTINCT ?compound ?taxon_with_compound ?parent_taxon 
  WHERE {
    ?compound wdt:P235 ?inchikey.
    SERVICE bd:sample { ?compound wdt:P703 ?taxon_with_compound. bd:serviceParam bd:sample.limit 1000 }   
    ?taxon_with_compound wdt:P171 ?parent_taxon.
  }
} AS %taxon_with_compound 
WITH
{ 
  SELECT DISTINCT ?taxon_without_compound ?parent_taxon ?compound 
  WHERE {
    INCLUDE %taxon_with_compound
    ?taxon_without_compound wdt:P171 ?parent_taxon.
    FILTER (?taxon_with_compound != ?taxon_without_compound)
  }
} AS %taxon2 
WHERE {
  INCLUDE %taxon_with_compound
  INCLUDE %taxon2
  FILTER NOT EXISTS {?compound wdt:P703 ?taxon_without_compound.}
  ?taxon_with_compound wdt:P225 ?taxonname_with_compound.
  ?taxon_without_compound wdt:P225 ?taxonname_without_compound.
  ?compound rdfs:label ?compoundLabel.
  FILTER(LANG(?compoundLabel) = "en").
}

Query 6 - Zephyranthes sister taxon compounds

This query answers to the following question:

Which Zephyranthes spp. lack compounds known from ≥ 2 other Zephyranthes?

Link: https://w.wiki/4VG3

#title: Which Zephyranthes (Q191364) spp. lack compounds known from at least two species in the genus?
PREFIX target: <http://www.wikidata.org/entity/Q191364> # Zephyranthes
SELECT DISTINCT ?compound ?compoundLabel ?taxon_with_compound ?another_taxon_with_compound ?taxon_without_compound WITH { 
  SELECT DISTINCT ?compound ?taxon_YES_1 ?taxon_YES_2 
  WHERE {
    ?compound wdt:P703 ?taxon_YES_1 .
    ?compound wdt:P703 ?taxon_YES_2 .
    ?taxon_YES_1 wdt:P171 target: .
    ?taxon_YES_2 wdt:P171 target: .
    FILTER (?taxon_YES_2 != ?taxon_YES_1)
  }
} AS %taxa_with_compound 
WITH
{ 
  SELECT DISTINCT ?taxon_NO ?compound 
  WHERE {
    INCLUDE %taxa_with_compound
    ?taxon_NO wdt:P171 target: .
    FILTER (?taxon_YES_1 != ?taxon_NO)
  }
} AS %taxon_without_compond 
WHERE {
  INCLUDE %taxa_with_compound
  INCLUDE %taxon_without_compond
  FILTER NOT EXISTS { ?compound wdt:P703 ?taxon_NO .}
  VALUES ?classes {
    wd:Q11173
    wd:Q59199015
  }
  ?taxon_YES_1 wdt:P225 ?taxon_with_compound .
  ?taxon_YES_2 wdt:P225 ?another_taxon_with_compound .
  ?taxon_NO wdt:P225 ?taxon_without_compound .
  ?compound (wdt:P31*/wdt:P279*) ?classes .
  ?compound rdfs:label ?compoundLabel.
  FILTER(LANG(?compoundLabel) = "en").
}

Query 7 - Antibiotic-like compounds

This query answers to the following question:

How many compounds are structurally similar to compounds labeled as antibiotics? Results are grouped by the parent taxon of the organism they were found in.

Link: https://w.wiki/4VG4

#title: How many compounds are structurally similar to compounds labeled as antibiotics? Results are grouped by the parent taxon of the organism they were found in.
PREFIX sachem: <http://bioinfo.uochb.cas.cz/rdf/v1.0/sachem#> # prefixes needed for structural similarity search
PREFIX idsm: <https://idsm.elixir-czech.cz/sparql/endpoint/>
SELECT ?parent_taxon ?parent_taxon_name (COUNT(DISTINCT ?compound) AS ?count) WHERE {
  SERVICE idsm:wikidata {
    VALUES ?CUTOFF {
      "0.9"^^xsd:double
    }
    SERVICE <https://query.wikidata.org/bigdata/namespace/wdq/sparql> {
      VALUES ?MESH {
        "D000900"
      }
      ?antibiotic ((wdt:P279*)/wdt:P2868/wdt:P486) ?MESH;
        wdt:P233 ?smiles.
    }
    ?compound sachem:similarCompoundSearch _:b40.
    _:b40 sachem:query ?smiles;
      sachem:cutoff ?CUTOFF.
  }
  hint:Prior hint:runFirst "true"^^xsd:boolean.
  ?compound wdt:P703 ?taxon.
  ?taxon wdt:P171 ?parent_taxon.
  OPTIONAL { ?parent_taxon wdt:P225 ?parent_taxon_name. }
  SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
}
GROUP BY ?parent_taxon ?parent_taxon_name
ORDER BY DESC (?count)

Query 8 - Indolic scaffold

This query answers to the following question:

Which organisms contain indolic scaffolds? Count occurrences, group and order the results by the parent taxon.

Link: https://w.wiki/4VG9

#title: Which organisms contain indolic scaffolds? Count occurences, group and order the results by the parent taxon.
PREFIX sachem: <http://bioinfo.uochb.cas.cz/rdf/v1.0/sachem#> # prefixes needed for structural similarity search
PREFIX wd: <http://www.wikidata.org/entity/>
PREFIX p: <http://www.wikidata.org/prop/>
PREFIX idsm: <https://idsm.elixir-czech.cz/sparql/endpoint/>
SELECT ?parent_taxon ?parent_taxon_name (COUNT(DISTINCT ?compound) AS ?count) WHERE {
  SERVICE idsm:wikidata {
    VALUES ?SUBSTRUCTURE {
      "NCCC1=CNC2=C1C=CC=C2" # indolic scaffold
    }
    ?compound sachem:substructureSearch _:b16.
    _:b16 sachem:query ?SUBSTRUCTURE.
  }
  hint:Prior hint:runFirst "true"^^xsd:boolean.
  ?compound p:P703 ?statement;
    wdt:P235 ?inchikey.
  ?statement ps:P703 ?taxon.
  ?taxon wdt:P171 ?parent_taxon.
  ?parent_taxon wdt:P225 ?parent_taxon_name.
  SERVICE wikibase:label { bd:serviceParam wikibase:language "en". }
}
GROUP BY ?parent_taxon ?parent_taxon_name
ORDER BY DESC (?count)

Query 9 - Bioactive compounds in Actinobacteria

This query answers to the following question:

Which compounds with known bioactivities were isolated from Actinobacteria, between 2014 and 2019, with related organisms and references?

Link: https://w.wiki/4VGC

#title: Which compounds with known bioactivities were isolated from Actinobacteria (Q26262282), between 2014 and 2019, with related organisms and references?
SELECT ?organism ?organism_name ?compound ?compound_smiles (GROUP_CONCAT(DISTINCT ?meshLabel; SEPARATOR = "|") AS ?bioactivities) ?isolation_reference ?reference_title WHERE {
  ?organism (wdt:P171*) wd:Q26262282;
    wdt:P225 ?organism_name.
  ?compound wdt:P235 ?compound_id;
    wdt:P233 ?compound_smiles;
    p:P703 ?statement;
    (wdt:P2868/wdt:P486) ?meshId.
  ?mesh wdt:P486 ?meshId;
    rdfs:label ?meshLabel.
  FILTER(LANGMATCHES(LANG(?meshLabel), "EN"))
  ?statement ps:P703 ?organism;
    prov:wasDerivedFrom ?ref.
  ?ref pr:P248 ?isolation_reference.
  ?isolation_reference wdt:P1476 ?reference_title;
    wdt:P356 ?reference_doi;
    wdt:P577 ?reference_date.
  FILTER(((YEAR(?reference_date)) >= 2014 ) && ((YEAR(?reference_date)) <= 2019 ))
}
GROUP BY ?organism ?organism_name ?compound ?compound_smiles ?isolation_reference ?reference_title
LIMIT 100000

Query 10 - Aspergillus spp. terpenoids

This query answers to the following question:

Which compounds labeled as terpenoids were found in Aspergillus spp., between 2010 and 2020, with related references?

Link: https://w.wiki/4VGD

#title: Which compounds labelled as terpenoid (Q426694) were found in Aspergillus (Q335130) spp., between 2010 and 2020, with related references?
SELECT ?compound ?compound_inchi (GROUP_CONCAT(DISTINCT ?isolation_reference; SEPARATOR = "|") AS ?isolation_references) (GROUP_CONCAT(DISTINCT ?reference_title; SEPARATOR = "|") AS ?references_titles) WHERE {
  VALUES ?taxon {
    wd:Q335130
  }
  VALUES ?chemical_class {
    wd:Q426694
  }
  ?organism (wdt:P171*) ?taxon.
  ?compound wdt:P235 ?compound_id;
    wdt:P234 ?compound_inchi;
    ((wdt:P31|wdt:P279)/(wdt:P279*)) ?compound_class;
    p:P703 ?statement.
  ?statement ps:P703 ?organism;
    (prov:wasDerivedFrom/pr:P248) ?isolation_reference.
  ?isolation_reference wdt:P1476 ?reference_title;
    wdt:P356 ?reference_doi;
    wdt:P577 ?reference_date.
  FILTER(((YEAR(?reference_date)) >= 2010 ) && ((YEAR(?reference_date)) <= 2020 ))
  FILTER(?compound_class = ?chemical_class)
}
GROUP BY ?compound ?compound_inchi

Query 11 - Triples

This query answers to the following question:

Which are the available referenced structure-organism pairs on Wikidata? (example limited to 1000 results)

Link: https://w.wiki/4VFh

#title: Which are the available referenced structure-organism pairs on Wikidata? (example limited to 1000 results)
SELECT DISTINCT ?structure ?structure_inchikey ?taxon ?taxon_name ?reference ?reference_doi WHERE {
  ?structure wdt:P235 ?structure_inchikey;       # get the inchikey
    p:P703[                                      # statement found in taxon
     ps:P703 ?taxon;                             # get the taxon
     (prov:wasDerivedFrom/pr:P248) ?reference ]. # get the reference
  ?taxon wdt:P225 ?taxon_name.                   # get the taxon scientific name
  ?reference wdt:P356 ?reference_doi.            # get the reference DOI
}
LIMIT 1000

Appendix 4 Wikidata Entry Creation Tutorial

Manual addition of a referenced structure-organism pair to Wikidata

Select a referenced structure-organism pair

Throughout this demonstration, we are going to use the following example: > trigocherrin A is found in Trigonostemon cherrieri, as stated in Trigocherrin A, the first natural chlorinated daphnane diterpene orthoester from Trigonostemon cherrieri.

Fetch the information for the referenced structure-organism pair
Structure

Search PubChem for your compound, here trigocherrin A. This leads to https://pubchem.ncbi.nlm.nih.gov/compound/101556657.

From there, you can fetch the compound’s name, InChIKey and InChI as well as its Canonical and Isomeric SMILES. Here we keep, respectively:

- trigocherrin A
- QOVGHDRCAGYGEB-FFZYJECLSA-N
- InChI=1S/C38H36Cl2O12/c1-18(2)35(44)27-19(3)37-25-16-24(31(39)40)28(48-32(43)22-12-8-6-9-13-22)36(25,45)33(47-21(5)42)34(17-46-20(4)41)29(49-34)26(37)30(35)51-38(50-27,52-37)23-14-10-7-11-15-23/h6-16,19,26-30,33,44-45H,1,17H2,2-5H3/t19-,26+,27?,28+,29+,30-,33-,34+,35+,36-,37+,38?/m1/s1
- CC1C2C(C3C4C1(C5=CC(=C(Cl)Cl)C(C5(C(C6(C4O6)COC(=O)C)OC(=O)C)O)OC(=O)C7=CC=CC=C7)OC(O2)(O3)C8=CC=CC=C8)(C(=C)C)O
- C[C@@H]1C2[C@]([C@H]3[C@H]4[C@]1(C5=CC(=C(Cl)Cl)[C@@H]([C@]5([C@@H]([C@@]6([C@H]4O6)COC(=O)C)OC(=O)C)O)OC(=O)C7=CC=CC=C7)OC(O3)(O2)C8=CC=CC=C8)(C(=C)C)O
Organism

You can check if your organism name is correctly spelled using the Global Names resolver service: http://gni.globalnames.org/name_strings?search_term=trigonostemon+cherrieri&commit=Search.

Alternatively, you can use gnfinder in your command line interface to check for the spelling of your organism string.

echo "Trigonostemion cherrieri" | gnfinder find -c -l eng
{
  "metadata": {
    "date": "2021-02-27T18:44:41.640982+01:00",
    "gnfinderVersion": "v0.11.1",
    "withBayes": true,
    "tokensAround": 0,
    "language": "eng",
    "detectLanguage": false,
    "totalWords": 2,
    "totalCandidates": 1,
    "totalNames": 1
  },
  "names": [
    {
      "cardinality": 2,
      "verbatim": "Trigonostemion cherrieri",
      "name": "Trigonostemion cherrieri",
      "odds": 77581.46698350731,
      "start": 0,
      "end": 24,
      "annotationNomenType": "NO_ANNOT",
      "annotation": "",
      "verification": {
        "bestResult": {
          "dataSourceId": 1,
          "dataSourceTitle": "Catalogue of Life",
          "taxonId": "1575885",
          "matchedName": "Trigonostemon cherrieri Veillon",
          "matchedCardinality": 2,
          "matchedCanonicalSimple": "Trigonostemon cherrieri",
          "matchedCanonicalFull": "Trigonostemon cherrieri",
          "classificationPath": "Plantae|Tracheophyta|Magnoliopsida|Malpighiales|Euphorbiaceae|Trigonostemon|Trigonostemon cherrieri",
          "classificationRank": "kingdom|phylum|class|order|family|genus|species",
          "classificationIds": "3939764|3942634|3942724|3942777|3942795|4210752|1575885",
          "editDistance": 1,
          "stemEditDistance": 1,
          "matchType": "FuzzyCanonicalMatch"
        },
        "dataSourcesNum": 13,
        "dataSourceQuality": "HasCuratedSources",
        "retries": 1
      }
    }
  ]
}

For misspellings like Trigonstemion cherrieri, gnfinder can help resolve them, in this case to Trigonostemon cherrieri.

Reference

Make sure that you have the correct Digital Object Identifier (DOI) for it. For “Trigocherrin A, the first natural chlorinated daphnane diterpene orthoester from Trigonostemon cherrieri”, this is 10.1021/ol2030907. Note that DOIs are uppercase-normalized in Wikidata.

Check for the presence of your compound in Wikidata

Using the compound’s InChIKey (i.e. QOVGHDRCAGYGEB-FFZYJECLSA-N for trigocherrin A), run a SPARQL query to check if your compound is present in Wikidata or not:

SELECT ?item ?itemLabel WHERE {
  VALUES ?classes {
    wd:Q11173 # chemical compound
    wd:Q59199015 # group of stereoisomers
    wd:Q79529 # chemical substance
    wd:Q17339814 # group of chemical substances
    wd:Q47154513 # structural class of chemical compounds
  }
  ?item wdt:P31 ?classes. # instance of
  ?item wdt:P235 'QOVGHDRCAGYGEB-FFZYJECLSA-N'
  SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE],en". }
}

Try this query. You can adapt it by replacing the InChIKey with the one for your compound.

Alternatively you can use the following Scholia link (replace by your compounds InChIKey) https://scholia.toolforge.org/inchikey/QOVGHDRCAGYGEB-FFZYJECLSA-N

If your compound is already present on Wikidata, you can directly skip to the Add the biological source information section below.

Add your data manually to Wikidata

First, if you do not have a Wikidata account already, it is advisable that you create one via https://www.wikidata.org/wiki/Special:CreateAccount. While an account is not strictly required for manual edits, having one will be useful if you want to contribute more than once, and it helps in getting your contributions recognized. Note that Wikidata accounts are integrated with accounts across the Wikimedia ecosystem, so if you already have an account on, say, any Wikipedia or on Wikispecies, then you can use the same credentials on Wikidata.

If you are unfamiliar with how Wikidata works, you can start by reading the Wikidata introduction page https://www.wikidata.org/wiki/Wikidata:Introduction and have a look at the Wikidata Tours page https://www.wikidata.org/wiki/Wikidata:Tours.

Now that you are all set up, you can go to Wikidata’s page for creating new items, https://www.wikidata.org/wiki/Special:NewItem:

An empty page with a new Wikidata identifier is created

Add the chemical compound information

Create a new statement for is an instance of

and select chemical compound (i.e. Q11173):

Click publish to save your changes and make them public.

Since you created a new item about an instance of a chemical compound, the user interface will automatically propose to you a set of additional statements commonly found on items about chemical compounds.

You can then go on and fill these in.

Here, we start with the InChIKey. Note the little flag which will automatically tell you if you have some problems with the recently created statements.

Here, Wikidata tells us that if we add an InChiKey, we will need to also add an InChI. Logical, but good to have a reminder!

Let’s go ahead and add the InChI string.

Likewise, the addition of an isomeric SMILES string will require us to add a Canonical SMILES.

Note that you might have to copy and paste the SMILES string from PubChem to a plain text editor and then back to Wikidata because of some formatting issues when copy pasting directly from PubChem.

C[C@@H]1C2[C@]([C@H]3[C@H]4[C@]1(C5=CC(=C(Cl)Cl)[C@@H]([C@]5([C@@H]([C@@]6([C@H]4O6)COC(=O)C)OC(=O)C)O)OC(=O)C7=CC=CC=C7)OC(O3)(O2)C8=CC=CC=C8)(C(=C)C)O

CC1C2C(C3C4C1(C5=CC(=C(Cl)Cl)C(C5(C(C6(C4O6)COC(=O)C)OC(=O)C)O)OC(=O)C7=CC=CC=C7)OC(O2)(O3)C8=CC=CC=C8)(C(=C)C)O
Add the biological source information

Now let’s add the found in taxon property (P703).

Just click on Add a new statement and type in the first letters of the property you want to add:

Again, type in the first letters of the taxon, and if the organism is present, it will autocomplete. Here is how this looks like for Trigonostemon cherrieri:

Click publish to save your changes and make them public.

If your target taxon is not yet present on Wikidata and you are sure you have a valid taxon name that is spelled correctly, then you can go to https://www.wikidata.org/wiki/Special:NewItem, as described in the Add your data manually to Wikidata section. For items about taxa, the instance of statement should have a value taxon (i.e. Q16521). As for chemical compounds, the user interface will then suggest to you further statements to add. For taxa, these include taxon name, parent taxon and taxon rank.

Add the reference documenting the structure-organism pair

Finally, since we report referenced structure-organisms pairs, we need to add the reference for this newly created compound found in taxon relationship. This happens on the item about the compound, just below the found in taxon statement. Click on the 0 references link and then on add reference:

Here, we use the stated in property (P248):

Now, type in the first letters or word of the scientific publication documenting the natural product occurrence, autocompletion happens again. Note that multiple publications might have the same title, and that there could be minor differences in punctuation or special characters between the information you and Wikidata have about the same reference. If you are not sure whether your target reference is already in Wikidata, you can use its DOI to check, as outlined in the Check whether your target reference is already on Wikidata section.

Click publish to save your changes and make them public.

Check whether your target reference is already on Wikidata

If you are not sure whether your target reference is already in Wikidata, you can use its DOI to check. For our DOI 10.1021/ol2030907, the URL https://scholia.toolforge.org/doi/10.1021/ol2030907 will lead you to a Scholia page about this publication: https://scholia.toolforge.org/work/Q83059010. Scholia visualizes information from Wikidata, so if it has an entry for your target reference, then so does Wikidata, and both of them will use the same identifier (in this case Q83059010). If you prefer to resolve your DOI to Wikidata directly, you can do so by using the uppercase-normalized DOI in the following URL pattern: https://hub.toolforge.org/P356:10.1021/OL2030907, which will lead you to the respective Wikidata page, in this case Q83059010.

If you think that no Wikidata entry exists for your target reference, you can use the DOI in the URL pattern https://sourcemd.toolforge.org/index_old.php?id=10.1021/ol2030907&doit=Check+source, which will trigger a check with both Crossref and Wikidata, and if no Wikidata entry can be found, the metadata from Crossref will be fetched and presented to you for creating the respective Wikidata item semi-automatically. Using such semi-automated workflows does require and account that is a minimum number of days old and has made a minimum number of edits on Wikidata.

If you are interested in the annotation of articles with topics via Wikidata and Scholia, here is a tutorial: https://laurendupuis.github.io/Scholia_tutorial.

Voilà !

You have added your first referenced structure-organism relationship to Wikidata and made a valuable contribution to the community. You can add further statements, e.g. molecular formula, or SPLASH code for linking to spectral data.

The Wikidata entry https://www.wikidata.org/wiki/Q105674316 has been started using these instructions.

You can run a SPARQL query and check that everything went smoothly by modifying the InChiKey line in the following SPARQL query:

SELECT ?item ?itemLabel ?taxonLabel ?artLabel WHERE {
  VALUES ?classes {
    wd:Q11173 # chemical compound
    wd:Q59199015 # group of stereoisomers
    wd:Q79529 # chemical substance
    wd:Q17339814 # group of chemical substances
    wd:Q47154513 # structural class of chemical compounds
  }
  ?item wdt:P31 ?classes. # instance of
  ?item wdt:P235 'QOVGHDRCAGYGEB-FFZYJECLSA-N' # InChiKey
  {
    ?item p:P1582 ?stmt. # natural product of taxon
    ?stmt ps:P1582 ?taxon. # natural product of taxon
    OPTIONAL {
      ?stmt prov:wasDerivedFrom ?ref.
      ?ref pr:P248 ?art. # stated in
    }
  }
  UNION
  {
    ?item p:P703 ?stmt. # found in taxon
    ?stmt ps:P703 ?taxon. # found in taxon
    OPTIONAL {
      ?stmt prov:wasDerivedFrom ?ref.
      ?ref pr:P248 ?art. # stated in
    }
  }
  SERVICE wikibase:label { bd:serviceParam wikibase:language "[AUTO_LANGUAGE],en". }
}

References

1.
What does ‘nature’ mean?
Frédéric Ducarme, Denis Couvet
Palgrave Communications (2020-01-31) https://doi.org/ghd6kb
2.
All natural
Nature Chemical Biology
Nat Chem Biol (2007-07) https://doi.org/bkfd8h
3.
Advances in computational metabolomics and databases deepen the understanding of metabolisms
Hiroshi Tsugawa
Current Opinion in Biotechnology (2018-12) https://doi.org/gfwm27
4.
Bias in peer review
Carole J Lee, Cassidy R Sugimoto, Guo Zhang, Blaise Cronin
Journal of the American Society for Information Science and Technology (2012-12-10) https://doi.org/f47nt7
5.
On Disciplinary Fragmentation and Scientific Progress
Stefano Balietti, Michael Mäs, Dirk Helbing
PLOS ONE (2015-03-19) https://doi.org/dx9s
6.
Repository scale classification and decomposition of tandem mass spectral data
Mihir Mongia, Hosein Mohimani
Scientific Reports (2021-04-15) https://doi.org/gj2q8p
7.
ReDU: a framework to find and reanalyze public mass spectrometry data
Alan K Jarmusch, Mingxun Wang, Christine M Aceves, Rohit S Advani, Shaden Aguirre, Alexander A Aksenov, Gajender Aleti, Allegra T Aron, Anelize Bauermeister, Sanjana Bolleddu, … Pieter C Dorrestein
Nature Methods (2020-08-17) https://doi.org/gg9prv
8.
PubChem 2019 update: improved access to chemical data
Sunghwan Kim, Jie Chen, Tiejun Cheng, Asta Gindulyte, Jia He, Siqian He, Qingliang Li, Benjamin A Shoemaker, Paul A Thiessen, Bo Yu, … Evan E Bolton
Nucleic Acids Research (2018-10-29) https://doi.org/gfxmsx
DOI: 10.1093/nar/gky1033 · PMID: 30371825 · PMCID: PMC6324075
9.
GBIF.org
GBIF Home Page
(2020) https://www.gbif.org
10.
KNApSAcK: A Comprehensive Species-Metabolite Relationship Database
Y Shinbo, Y Nakamura, M Altaf-Ul-Amin, H Asahi, K Kurokawa, M Arita, K Saito, D Ohta, D Shibata, S Kanaya
Plant Metabolomics https://doi.org/db44mg
11.
The NAPRALERT Database as an Aid for Discovery of Novel Bioactive Compounds
James G Graham, Norman R Farnsworth
Comprehensive Natural Products II (2010) https://doi.org/d8b6k9
12.
The Natural Products Atlas: An Open Access Knowledge Base for Microbial Natural Products Discovery
Jeffrey A van Santen, Grégoire Jacob, Amrit Leen Singh, Victor Aniebok, Marcy J Balunas, Derek Bunsko, Fausto Carnevale Neto, Laia Castaño-Espriu, Chen Chang, Trevor N Clark, … Roger G Linington
ACS Central Science (2019-11-14) https://doi.org/gh5ptm
13.
The Natural Products Atlas 2.0: a database of microbially-derived natural products
Jeffrey A van Santen, Ella F Poynton, Dasha Iskakova, Emily McMann, Tyler A Alsup, Trevor N Clark, Claire H Fergusson, David P Fewer, Alison H Hughes, Caitlin A McCadden, … Roger G Linington
Nucleic Acids Research (2021-10-28) https://doi.org/gnvf3t
DOI: 10.1093/nar/gkab941 · PMID: 34718710 · PMCID: PMC8728154
14.
The FAIR Guiding Principles for scientific data management and stewardship
Mark D Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, Niklas Blomberg, Jan-Willem Boiten, Luiz Bonino da Silva Santos, Philip E Bourne, … Barend Mons
Scientific Data (2016-03-15) https://doi.org/bdd4
DOI: 10.1038/sdata.2016.18 · PMID: 26978244 · PMCID: PMC4792175
15.
COCONUT online: Collection of Open Natural Products database
Maria Sorokina, Peter Merseburger, Kohulan Rajan, Mehmet Aziz Yirik, Christoph Steinbeck
Journal of Cheminformatics (2021-01-10) https://doi.org/ghssx5
16.
Ten Simple Rules for Developing Public Biological Databases
Mohamed Helmy, Alexander Crits-Christoph, Gary D Bader
PLOS Computational Biology (2016-11-10) https://doi.org/gc4h7x
17.
Making your database available through Wikipedia: the pros and cons
RD Finn, PP Gardner, A Bateman
Nucleic Acids Research (2011-12-05) https://doi.org/dzmdt3
DOI: 10.1093/nar/gkr1195 · PMID: 22144683 · PMCID: PMC3245093
18.
Wikidata as a knowledge graph for the life sciences
Andra Waagmeester, Gregory Stupp, Sebastian Burgstaller-Muehlbacher, Benjamin M Good, Malachi Griffith, Obi L Griffith, Kristina Hanspers, Henning Hermjakob, Toby S Hudson, Kevin Hybiske, … Andrew I Su
eLife (2020-03-17) https://doi.org/ggqqc6
DOI: 10.7554/elife.52614 · PMID: 32180547 · PMCID: PMC7077981
19.
The TRUST Principles for digital repositories
Dawei Lin, Jonathan Crabtree, Ingrid Dillo, Robert R Downs, Rorie Edmunds, David Giaretta, Marisa De Giusti, Hervé L’Hours, Wim Hugo, Reyna Jenkyns, … John Westbrook
Scientific Data (2020-05-14) https://doi.org/ggwrtj
20.
Taxonomically Informed Scoring Enhances Confidence in Natural Products Annotation
Adriano Rutz, Miwa Dounoue-Kubo, Simon Ollivier, Jonathan Bisson, Mohsen Bagheri, Tongchai Saesong, Samad Nejad Ebrahimi, Kornkanok Ingkaninan, Jean-Luc Wolfender, Pierre-Marie Allard
Frontiers in Plant Science (2019-10-25) https://doi.org/fm73
21.
Spatial and evolutionary predictability of phytochemical diversity
Emmanuel Defossez, Camille Pitteloud, Patrice Descombes, Gaétan Glauser, Pierre-Marie Allard, Tom WN Walker, Pilar Fernandez-Conradi, Jean-Luc Wolfender, Loïc Pellissier, Sergio Rasmann
Proceedings of the National Academy of Sciences (2021-01-11) https://doi.org/ghssx4
22.
Save those molecules! Molecular biodiversity and life*
Anthony K Campbell
Journal of Applied Ecology (2003-04) https://doi.org/dkg97q
23.
SMILES, a chemical language and information system. 1. Introduction to methodology and encoding rules
David Weininger
Journal of Chemical Information and Modeling (1988-02-01) https://doi.org/fg6q5f
24.
InChI - the worldwide chemical structure identifier standard
Stephen Heller, Alan McNaught, Stephen Stein, Dmitrii Tchekhovskoi, Igor Pletnev
Journal of Cheminformatics (2013-01-24) https://doi.org/6bg
DOI: 10.1186/1758-2946-5-7 · PMID: 23343401 · PMCID: PMC3599061
25.
The LOTUS Initiative for Open Natural Products Research: frozen dataset union wikidata (with metadata)
Adriano Rutz, Jonathan Bisson, Pierre-Marie Allard
Zenodo (2021-12-20) https://doi.org/gntk2q
26.
COCONUT: the COlleCtion of Open NatUral producTs.
Maria Sorokina, Christoph Steinbeck
Zenodo (2020-04-30) https://doi.org/gh6dqw
27.
U.S. Department of Agriculture, Agricultural Research Service. Dr. Duke's Phytochemical and Ethnobotanical Databases.
Home Page
(1992–2016) https://phytochem.nal.usda.gov/
28.
CyanoMetDB, a comprehensive public database of secondary metabolites from cyanobacteria
Martin R Jones, Ernani Pinto, Mariana A Torres, Fabiane Dörr, Hanna Mazur-Marzec, Karolina Szubert, Luciana Tartaglione, Carmela Dell'Aversano, Christopher O Miles, Daniel G Beach, … Elisabeth M-L Janssen
Water Research (2021-05) https://doi.org/gjgdzm
29.
DataWarrior: An Open-Source Program For Chemistry Aware Data Visualization And Analysis
Thomas Sander, Joel Freyss, Modest von Korff, Christian Rufener
Journal of Chemical Information and Modeling (2015-02-02) https://doi.org/f637rz
30.
31.
DiaNat-DB: a molecular database of antidiabetic compounds from medicinal plants
Abraham Madariaga-Mazón, José J Naveja, José L Medina-Franco, Karla O Noriega-Colima, Karina Martinez-Mayorga
RSC Advances (2021) https://doi.org/ghxp29
32.
Scholia And Scientometrics With Wikidata
Finn Årup Nielsen, Daniel Mietchen, Egon Willighagen
Zenodo (2017-09-08) https://doi.org/gj2xz8
33.
Robustifying Scholia: paving the way for knowledge discovery and research assessment through Wikidata
Lane Rasberry, Egon Willighagen, Finn Nielsen, Daniel Mietchen
Research Ideas and Outcomes (2019-05-02) https://doi.org/gf4vf5
34.
The LOTUS Initiative for Open Natural Products Research: waste to recycle
Adriano Rutz, Jonathan Bisson, Pierre-Marie Allard
Zenodo (2021-12-20) https://doi.org/gnvf6z
35.
Taxonomists need better access to published data
Donat Agosti, Norman F Johnson
Nature (2002-05) https://doi.org/d835pf
36.
ISDB: In Silico Spectral Databases of Natural Products
Pierre-Marie Allard, Jonathan Bisson, Adriano Rutz
Zenodo (2021-10-28) https://doi.org/gnvf68
37.
Automated assembly of a reference taxonomy for phylogenetic data synthesis
Jonathan Rees, Karen Cranston
Biodiversity Data Journal (2017-05-22) https://doi.org/ggkjbt
DOI: 10.3897/bdj.5.e12581 · PMID: 28765728 · PMCID: PMC5515096
38.
The LOTUS Initiative for Open Natural Products Research: wikidata query results
Adriano Rutz, Jonathan Bisson, Pierre-Marie Allard, Wikidata Community
Zenodo (2021-12-20) https://doi.org/gntk2p
39.
Actinobacteria in natural products research: Progress and prospects
Polpass Arul Jose, Anjisha Maharshi, Bhavanath Jha
Microbiological Research (2021-05) https://doi.org/gnknc9
40.
Recent studies on terpenoids in Aspergillus fungi: Chemical diversity, biosynthesis, and bioactivity
Wen-Yu Zhao, Jing Yi, Yi-Bo Chang, Cheng-Peng Sun, Xiao-Chi Ma
Phytochemistry (2022-01) https://doi.org/gnmxk9
41.
Sachem: a chemical cartridge for high-performance substructure search
Miroslav Kratochvíl, Jiří Vondrášek, Jakub Galgonek
Journal of Cheminformatics (2018-05-23) https://doi.org/gdn52j
42.
Interoperable chemical structure search service
Miroslav Kratochvíl, Jiří Vondrášek, Jakub Galgonek
Journal of Cheminformatics (2019-06-28) https://doi.org/gf5bv5
43.
NPClassifier: A Deep Neural Network-Based Structural Classification Tool for Natural Products
Hyun Woo Kim, Mingxun Wang, Christopher A Leber, Louis-Félix Nothias, Raphael Reher, Kyo Bin Kang, Justin JJ van der Hooft, Pieter C Dorrestein, William H Gerwick, Garrison W Cottrell
Journal of Natural Products (2021-10-18) https://doi.org/gm62mc
44.
Chemical fingerprinting for the evaluation of unintended secondary metabolic changes in transgenic food crops
Hub PJM Noteborn, Arjen Lommen, Robert C van der Jagt, Joop M Weseman
Journal of Biotechnology (2000-01) https://doi.org/b3z2g7
45.
Treeio: An R Package for Phylogenetic Tree Input and Output with Richly Annotated and Associated Data
Li-Gen Wang, Tommy Tsan-Yuk Lam, Shuangbin Xu, Zehan Dai, Lang Zhou, Tingze Feng, Pingfan Guo, Casey W Dunn, Bradley R Jones, Tyler Bradley, … Guangchuang Yu
Molecular Biology and Evolution (2019-10-24) https://doi.org/ggwr93
DOI: 10.1093/molbev/msz240 · PMID: 31633786 · PMCID: PMC6993851
46.
ClassyFire: automated chemical classification with a comprehensive, computable taxonomy
Yannick Djoumbou Feunang, Roman Eisner, Craig Knox, Leonid Chepelev, Janna Hastings, Gareth Owen, Eoin Fahy, Christoph Steinbeck, Shankar Subramanian, Evan Bolton, … David S Wishart
Journal of Cheminformatics (2016-11-04) https://doi.org/gc5tqv
47.
Visualization of very large high-dimensional data sets as minimum spanning trees
Daniel Probst, Jean-Louis Reymond
Journal of Cheminformatics (2020-02-12) https://doi.org/gjjz4f
48.
FUn: a framework for interactive visualizations of large, high-dimensional datasets on the web
Daniel Probst, Jean-Louis Reymond
Bioinformatics (2017-11-24) https://doi.org/gcmhc5
49.
SmilesDrawer: Parsing and Drawing SMILES-Encoded Molecular Structures Using Client-Side JavaScript
Daniel Probst, Jean-Louis Reymond
Journal of Chemical Information and Modeling (2018-01-11) https://doi.org/gjjz4d
50.
One molecular fingerprint to rule them all: drugs, biomolecules, and the metabolome
Alice Capecchi, Daniel Probst, Jean-Louis Reymond
Journal of Cheminformatics (2020-06-12) https://doi.org/gjjz4c
51.
The LOTUS Initiative for Open Natural Products Research: TMAP
Adriano Rutz, Arnaud Gaudry
Zenodo (2021-12-20) https://doi.org/gnvnjd
52.
Micromolecular Evolution, Systematics and Ecology
Otto Richard Gottlieb
Springer Berlin Heidelberg (1982) https://doi.org/fd4xcj
53.
Phytochemistry and plant taxonomy — an essay on the chemotaxonomy of higher plants
R Hegnauer
Phytochemistry (1986-01) https://doi.org/d592kt
54.
Essai sur les propriétés médicales des plantes, comparées avec leurs formes extérieures et leur classification naturelle
Augustin Pyramus de de Candolle
Chez Crochard, Libraire, (1816) http://www.biodiversitylibrary.org/bibliography/112422
55.
Chemotaxonomie der Pflanzen
R Hegnauer
Birkhäuser Basel (1986) https://doi.org/gj2xv5
56.
Systematic classification of unknown metabolites using high-resolution fragmentation mass spectra
Kai Dührkop, Louis-Félix Nothias, Markus Fleischauer, Raphael Reher, Marcus Ludwig, Martin A Hoffmann, Daniel Petras, William H Gerwick, Juho Rousu, Pieter C Dorrestein, Sebastian Böcker
Nature Biotechnology (2020-11-23) https://doi.org/ghk69v
57.
MIBiG 2.0: a repository for biosynthetic gene clusters of known function
Satria A Kautsar, Kai Blin, Simon Shaw, Jorge C Navarro-Muñoz, Barbara R Terlouw, Justin JJ van der Hooft, Jeffrey A van Santen, Vittorio Tracanna, Hernando G Suarez Duran, Victòria Pascal Andreu, … Marnix H Medema
Nucleic Acids Research (2019-10-15) https://doi.org/ggbk32
DOI: 10.1093/nar/gkz882 · PMID: 31612915 · PMCID: PMC7145714
58.
Evolution of endophyte?plant symbioses
K SAIKKONEN
Trends in Plant Science (2004-06) https://doi.org/cgg57x
59.
Can Invalid Bioactives Undermine Natural Product-Based Drug Discovery?
Jonathan Bisson, James B McAlpine, JBrent Friesen, Shao-Nong Chen, James Graham, Guido F Pauli
Journal of Medicinal Chemistry (2015-10-27) https://doi.org/f8d4d7
60.
Dissemination of original NMR data enhances reproducibility and integrity in chemical research
Jonathan Bisson, Charlotte Simmler, Shao-Nong Chen, JBrent Friesen, David C Lankin, James B McAlpine, Guido F Pauli
Natural Product Reports (2016) https://doi.org/gjqb5h
DOI: 10.1039/c6np00022c · PMID: 27197893 · PMCID: PMC5001890
61.
Open Data in Science
Peter Murray-Rust
Nature Precedings (2008-01-18) https://doi.org/gnkn6x
62.
The value of universally available raw NMR data for transparency, reproducibility, and integrity in natural product research
James B McAlpine, Shao-Nong Chen, Andrei Kutateladze, John B MacMillan, Giovanni Appendino, Andersson Barison, Mehdi A Beniddir, Maique W Biavatti, Stefan Bluml, Asmaa Boufridi, … Guido F Pauli
Natural Product Reports (2019) https://doi.org/gf23mk
DOI: 10.1039/c7np00064b · PMID: 30003207 · PMCID: PMC6350634
63.
Bringing Citations and Usage Metrics Together to Make Data Count
Helena Cousijn, Patricia Feeney, Daniella Lowenberg, Eleonora Presani, Natasha Simons
Data Science Journal (2019) https://doi.org/gh533h
64.
A data citation roadmap for scientific publishers
Helena Cousijn, Amye Kenall, Emma Ganley, Melissa Harrison, David Kernohan, Thomas Lemberger, Fiona Murphy, Patrick Polischuk, Simone Taylor, Maryann Martone, Tim Clark
Scientific Data (2018-11-20) https://doi.org/gfnxpj
65.
Credit data generators for data reuse
Heather H Pierce, Anurupa Dev, Emily Statham, Barbara E Bierer
Nature (2019-06) https://doi.org/gf3j9t
66.
MassBank: a public repository for sharing mass spectral data for life sciences
Hisayuki Horai, Masanori Arita, Shigehiko Kanaya, Yoshito Nihei, Tasuku Ikeda, Kazuhiro Suwa, Yuya Ojima, Kenichi Tanaka, Satoshi Tanaka, Ken Aoshima, … Takaaki Nishioka
Journal of Mass Spectrometry (2010-07-07) https://doi.org/d8pdcr
67.
The Chemical Translation Service--a web-based tool to improve standardization of metabolomic reports
G Wohlgemuth, PK Haldiya, E Willighagen, T Kind, O Fiehn
Bioinformatics (2010-09-09) https://doi.org/drvfdr
68.
Assigning confidence to structural annotations from mass spectra with COSMIC
Martin A Hoffmann, Louis-Félix Nothias, Marcus Ludwig, Markus Fleischauer, Emily C Gentry, Michael Witting, Pieter C Dorrestein, Kai Dührkop, Sebastian Böcker
Cold Spring Harbor Laboratory (2021-03-19) https://doi.org/gjjcd3
69.
WikiPathways: connecting communities
Marvin Martens, Ammar Ammar, Anders Riutta, Andra Waagmeester, Denise N Slenter, Kristina Hanspers, Ryan A. Miller, Daniela Digles, Elisson N Lopes, Friederike Ehrhart, … Martina Kutmon
Nucleic Acids Research (2020-11-19) https://doi.org/gh6dq2
DOI: 10.1093/nar/gkaa1024 · PMID: 33211851 · PMCID: PMC7779061
70.
WikiPathways: a multifaceted pathway database bridging metabolomics to other omics research
Denise N Slenter, Martina Kutmon, Kristina Hanspers, Anders Riutta, Jacob Windsor, Nuno Nunes, Jonathan Mélius, Elisa Cirillo, Susan L Coort, Daniela Digles, … Egon L Willighagen
Nucleic Acids Research (2017-11-10) https://doi.org/gcvjr9
DOI: 10.1093/nar/gkx1064 · PMID: 29136241 · PMCID: PMC5753270
71.
Plant Secondary Metabolite Diversity and Species Interactions
André Kessler, Aino Kalske
Annual Review of Ecology, Evolution, and Systematics (2018-11-02) https://doi.org/gftqcm
72.
Recent breakthroughs in metabolomics promise to reveal the cryptic chemical traits that mediate plant community composition, character evolution and lineage diversification
Brian E Sedio
New Phytologist (2017-01-30) https://doi.org/ghttk6
73.
Predatory impacts of alien decapod Crustacea are predicted by functional responses and explained by differences in metabolic rate
NG Taylor, AM Dunn
Biological Invasions (2018-05-02) https://doi.org/gfcbhz
74.
Pharmacognosy in the digital era: shifting to contextualized metabolomics
Pierre-Marie Allard, Jonathan Bisson, Antonio Azzollini, Guido F Pauli, Geoffrey A Cordell, Jean-Luc Wolfender
Current Opinion in Biotechnology (2018-12) https://doi.org/ggb79p
75.
Cognate and cognitive ecopharmacognosy — in an anthropogenic era
Geoffrey A Cordell
Phytochemistry Letters (2017-06) https://doi.org/gh533j
76.
Sixty Challenges – A 2030 Perspective on Natural Products and Medicines Security
Geoffrey A Cordell
Natural Product Communications (2017-08) https://doi.org/gh5pth
77.
RDFFrames: Knowledge Graph Access for Machine Learning Tools
Aisha Mohamed, Ghadeer Abuoda, Abdurrahman Ghanem, Zoi Kaoudi, Ashraf Aboulnaga
(2020-09-16) https://www.wikidata.org/wiki/Q106204599
78.
Chemical Name to Structure: OPSIN, an Open Source Solution
Daniel M Lowe, Peter T Corbett, Peter Murray-Rust, Robert C Glen
Journal of Chemical Information and Modeling (2011-03-09) https://doi.org/b2zkr9
79.
An update on PUG-REST: RESTful interface for programmatic access to PubChem
Sunghwan Kim, Paul A Thiessen, Tiejun Cheng, Bo Yu, Evan E Bolton
Nucleic Acids Research (2018-04-30) https://doi.org/gf8dhx
DOI: 10.1093/nar/gky294 · PMID: 29718389 · PMCID: PMC6030920
80.
PUG-SOAP and PUG-REST: web services for programmatic access to chemical information in PubChem
Sunghwan Kim, Paul A Thiessen, Evan E Bolton, Stephen H Bryant
Nucleic Acids Research (2015-04-30) https://doi.org/f7nw9n
DOI: 10.1093/nar/gkv396 · PMID: 25934803 · PMCID: PMC4489244
81.
The LOTUS Initiative for Open Natural Products Research: custom dictionaries
Adriano Rutz
Zenodo (2021-12-20) https://doi.org/gnvnjf
82.
rotl: an R package to interact with the Open Tree of Life data
François Michonneau, Joseph W Brown, David J Winter
Methods in Ecology and Evolution (2016-07-11) https://doi.org/f9jgkm
83.
rcrossref: Client for Various 'CrossRef' 'APIs'
Scott Chamberlain, Hao Zhu, Najko Jahn, Carl Boettiger, Karthik Ram
(2020) https://CRAN.R-project.org/package=rcrossref
84.
rentrez: An R package for the NCBI eUtils API
David Winter J.
The R Journal (2017) https://doi.org/gh5ptg
85.
lotusnprod/lotus-processor: v1.0.0
Adriano Rutz, Jonathan Bisson, Pierre-Marie Allard, ArnaudGaudry, WhiteSource Renovate
Zenodo (2021-12-23) https://doi.org/gnvpjw
86.
lotusnprod/lotus-wikidata-interact: v1.0.0
Jonathan Bisson, Adriano Rutz, WhiteSource Renovate, Pierre-Marie Allard
Zenodo (2021-12-23) https://doi.org/gnvpjx
87.
lotusnprod/lotus-web: v1.0.0
Maria Sorokina, Adriano Rutz, WhiteSource Renovate, Egon Willighagen, Imgbot
Zenodo (2021-12-23) https://doi.org/gnvpjz
88.
ChemmineR: a compound mining framework for R
Y Cao, A Charisi, L-C Cheng, T Jiang, T Girke
Bioinformatics (2008-07-02) https://doi.org/b46rs7
89.
chorddiag: Interactive Chord Diagrams
Matthias Flor
(2020) http://github.com/mattflor/chorddiag/
90.
data.table: Extension of `data.frame`
Matt Dowle, Arun Srinivasan
(2020) https://CRAN.R-project.org/package=data.table
91.
DBI: R database interface
R Special Interest Group on Databases (R-SIG-DB), Hadley Wickham, Kirill Müller
(2021) https://CRAN.R-project.org/package=DBI
92.
gdata: Various r programming tools for data manipulation
Gregory R Warnes, Ben Bolker, Gregor Gorjanc, Gabor Grothendieck, Ales Korosec, Thomas Lumley, Don MacQueen, Arni Magnusson, Jim Rogersothers
(2017) https://CRAN.R-project.org/package=gdata
93.
ggalluvial: Layered Grammar for Alluvial Plots
Jason Brunson
Journal of Open Source Software (2020-05-21) https://doi.org/gg4ghf
94.
ggfittext: Fit Text Inside a Box in 'ggplot2'
David Wilkins
(2020) https://CRAN.R-project.org/package=ggfittext
95.
ggnewscale: Multiple fill and colour scales in 'ggplot2'
Elio Campitelli
(2021) https://CRAN.R-project.org/package=ggnewscale
96.
ggraph: An Implementation of Grammar of Graphics for Graphs and Networks
Thomas Lin Pedersen
(2020) https://CRAN.R-project.org/package=ggraph
97.
ggstar: Star Layer for 'ggplot2'
Shuangbin Xu
(2021) https://CRAN.R-project.org/package=ggstar
98.
ggtree : an r package for visualization and annotation of phylogenetic trees with their covariates and other associated data
Guangchuang Yu, David K Smith, Huachen Zhu, Yi Guan, Tommy Tsan‐Yuk Lam
Methods in Ecology and Evolution (2016-09-22) https://doi.org/f9qv8x
99.
ggtreeExtra: Compact Visualization of Richly Annotated Phylogenetic Data
Shuangbin Xu, Zehan Dai, Pingfan Guo, Xiaocong Fu, Shanshan Liu, Lang Zhou, Wenli Tang, Tingze Feng, Meijun Chen, Li Zhan, … Guangchuang Yu
Molecular Biology and Evolution (2021-06-07) https://doi.org/gkgbpf
100.
The jsonlite Package: A Practical and Consistent Mapping Between JSON Data and R Objects
Jeroen Ooms
(2014-03-12) https://www.wikidata.org/wiki/Q106204620
101.
pbmcapply: Tracking the Progress of Mc*pply with Progress Bar
Kevin Kuang, Quyu Kong, Francesco Napolitano
(2019) https://CRAN.R-project.org/package=pbmcapply
102.
Interactive Web-Based Data Visualization with R, plotly, and shiny
Carson Sievert
Chapman and Hall/CRC (2020) https://plotly-r.com
ISBN: 978-1-138-33145-7
103.
readxl: Read Excel Files
Hadley Wickham, Jennifer Bryan
(2019) https://CRAN.R-project.org/package=readxl
104.
rvest: Easily Harvest (Scrape) Web Pages
Hadley Wickham
(2020) https://CRAN.R-project.org/package=rvest
105.
splitstackshape: Stack and Reshape Datasets After Splitting Concatenated Values
Ananda Mahto
(2019) https://CRAN.R-project.org/package=splitstackshape
106.
RSQLite: 'SQLite' interface for r
Kirill Müller, Hadley Wickham, David A James, Seth Falcon
(2021) https://CRAN.R-project.org/package=RSQLite
107.
The stringdist Package for Approximate String Matching
Mark Loo P.J.,van,der
The R Journal (2014) https://doi.org/ghfr9v
108.
R package stringi: Character string processing facilities
Marek Gagolewski
(2020) http://www.gagolewski.com/software/stringi/
109.
Welcome to the Tidyverse
Hadley Wickham, Mara Averick, Jennifer Bryan, Winston Chang, Lucy McGowan, Romain François, Garrett Grolemund, Alex Hayes, Lionel Henry, Jim Hester, … Hiroaki Yutani
Journal of Open Source Software (2019-11-21) https://doi.org/ggddkj
110.
UpSetR: A More Scalable Alternative to Venn and Euler Diagrams for Visualizing Intersecting Sets
Nils Gehlenborg
(2019) https://CRAN.R-project.org/package=UpSetR
111.
webchem: An R Package to Retrieve Chemical Information from the Web
Eduard Szöcs, Tamás Stirling, Eric R Scott, Andreas Scharmüller, Ralf B Schäfer
Journal of Statistical Software (2020) https://doi.org/gh5ptf
112.
XML: Tools for Parsing and Generating XML Within R and S-Plus
Duncan Temple Lang
(2020) https://CRAN.R-project.org/package=XML
113.
xml2: Parse XML
Hadley Wickham, Jim Hester, Jeroen Ooms
(2020) https://CRAN.R-project.org/package=xml2
114.
Scientific colour maps
Fabio Crameri
Zenodo (2021-09-12) https://doi.org/gnm9fm
115.
The misuse of colour in science communication
Fabio Crameri, Grace E Shephard, Philip J Heron
Nature Communications (2020-10-28) https://doi.org/ghg5rd
116.
Matplotlib: A 2D Graphics Environment
John D Hunter
Computing in Science & Engineering (2007) https://doi.org/drbjhg
117.
pandas-dev/pandas: Pandas 1.1.4
Jeff Reback, Wes McKinney, Jbrockmendel, Joris Van Den Bossche, Tom Augspurger, Phillip Cloud, Gfyoung, Sinhrks, Simon Hawkins, Matthew Roeschke, … Marco Gorelli
Zenodo (2020-10-30) https://doi.org/gh6dqz
118.
RDKit: Open-source cheminformatics (2021) http://www.rdkit.org
119.
SciPy 1.0: fundamental algorithms for scientific computing in Python
Pauli Virtanen, Ralf Gommers, Travis E Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, …
Nature Methods (2020-02-03) https://doi.org/ggj45f
120.
The Chemistry Development Kit (CDK) v2.0: atom typing, depiction, molecular formulas, and substructure searching
Egon L Willighagen, John W Mayfield, Jonathan Alvarsson, Arvid Berg, Lars Carlsson, Nina Jeliazkova, Stefan Kuhn, Tomáš Pluskal, Miquel Rojas-Chertó, Ola Spjuth, … Christoph Steinbeck
Journal of Cheminformatics (2017-06-06) https://doi.org/gbppnb
121.
The LOTUS Initiative for Open Natural Products Research: wikidata query results
Adriano Rutz, Jonathan Bisson, Pierre-Marie Allard, Wikidata Community
Zenodo (2021-12-20) https://doi.org/gnvpjt
122.
The LOTUS Initiative for Open Natural Products Research: frozen dataset union wikidata (with metadata)
Adriano Rutz, Jonathan Bisson, Pierre-Marie Allard
Zenodo (2021-12-20) https://doi.org/gnvpjv
123.
Open collaborative writing with Manubot
Daniel S Himmelstein, Vincent Rubinetti, David R Slochower, Dongbo Hu, Venkat S Malladi, Casey S Greene, Anthony Gitter
PLOS Computational Biology (2019-06-24) https://doi.org/c7np
124.
Binding of anti-Trypanosoma natural products from African flora against selected drug targets: a docking study
Akachukwu Ibezim, Biplab Debnath, Fidele Ntie-Kang, Chika John Mbah, Ngozi Justina Nwodo
Medicinal Chemistry Research (2017-01-11) https://doi.org/gh5ptd
125.
Alkamid database: Chemistry, occurrence and functionality of plant N-alkylamides
Jente Boonen, Antoon Bronselaer, Joachim Nielandt, Lieselotte Veryser, Guy De Tré, Bart De Spiegeleer
Journal of Ethnopharmacology (2012-08) https://doi.org/gh5ptc
126.
BIOFACQUIM: A Mexican Compound Database of Natural Products
B Pilón-Jiménez, Fernanda Saldívar-González, Bárbara Díaz-Eufracio, José Medina-Franco
Biomolecules (2019-01-17) https://doi.org/gh5ptb
DOI: 10.3390/biom9010031 · PMID: 30658522 · PMCID: PMC6358837
127.
BioPhytMol: a drug discovery community resource on anti-mycobacterial phytomolecules and plant extracts
Arun Sharma, Prasun Dutta, Maneesh Sharma, Neeraj Kumar Rajput, Bhavna Dodiya, John J Georrge, Trupti Kholia, Anshu Bhardwaj
Journal of Cheminformatics (2014-10-11) https://doi.org/f6ss69
128.
Carotenoids Database: structures, chemical fingerprints and distribution among organisms
Junko Yabuzaki
Database (2017-01-01) https://doi.org/f9x5p2
129.
Review on natural products databases: where to find data in 2020
Maria Sorokina, Christoph Steinbeck
Journal of Cheminformatics (2020-04-03) https://doi.org/ggwwcq
130.
Chemical Space and Biological Target Network of Anti-Inflammatory Natural Products
Ruihan Zhang, Jing Lin, Yan Zou, Xing-Jie Zhang, Wei-Lie Xiao
Journal of Chemical Information and Modeling (2018-12-12) https://doi.org/gfs7x6
131.
KNApSAcK Family Databases: Integrated Metabolite–Plant Species Databases for Multifaceted Plant Research
Farit Mochamad Afendi, Taketo Okada, Mami Yamazaki, Aki Hirai-Morita, Yukiko Nakamura, Kensuke Nakamura, Shun Ikeda, Hiroki Takahashi, Md Altaf-Ul-Amin, Latifah K Darusman, … Shigehiko Kanaya
Plant and Cell Physiology (2011-11-28) https://doi.org/cstrnq
132.
MetaboLights: a resource evolving in response to the needs of its scientific community
Kenneth Haug, Keeva Cochrane, Venkata Chandrasekhar Nainala, Mark Williams, Jiakang Chang, Kalai Vanii Jayaseelan, Claire O’Donovan
Nucleic Acids Research (2019-11-06) https://doi.org/gg5fsw
DOI: 10.1093/nar/gkz1019 · PMID: 31691833 · PMCID: PMC7145518
133.
Mitishamba database: a web based in silico database of natural products from Kenya plants
Derese, Solomon, Ndakala, Albert, Rogo, Michael, Maynim, Cholastica, Oyim, James
(31st August to 3rd September 2015)
134.
NANPDB: A Resource for Natural Products from Northern African Sources
Fidele Ntie-Kang, Kiran K Telukunta, Kersten Döring, Conrad V Simoben, Aurélien F A. Moumbock, Yvette I Malange, Leonel E Njume, Joseph N Yong, Wolfgang Sippl, Stefan Günther
Journal of Natural Products (2017-06-22) https://doi.org/ggfdw7
135.
NPASS: natural product activity and species source database for natural product research, discovery and tool development
Xian Zeng, Peng Zhang, Weidong He, Chu Qin, Shangying Chen, Lin Tao, Yali Wang, Ying Tan, Dan Gao, Bohua Wang, … Yu Zong Chen
Nucleic Acids Research (2017-11-02) https://doi.org/gh5ptk
DOI: 10.1093/nar/gkx1026 · PMID: 29106619 · PMCID: PMC5753227
136.
NPCARE: database of natural products and fractional extracts for cancer regulation
Hwanho Choi, Sun Young Cho, Ho Jeong Pak, Youngsoo Kim, Jung-yun Choi, Yoon Jae Lee, Byung Hee Gong, Yeon Seok Kang, Taehoon Han, Geunbae Choi, … Hwangseo Park
Journal of Cheminformatics (2017-01-05) https://doi.org/f9rhrj
137.
RIKEN natural products encyclopedia (RIKEN NPEdia), a chemical database of RIKEN natural products depository (RIKEN NPDepo)
Takeshi Tomiki, Tamio Saito, Masashi Ueki, Hideaki Konno, Takeo Asaoka, Ryuichiro Suzuki, Masakazu Uramoto, Hideaki Kakeya, Hiroyuki Osada
Proceedings of the Symposium on Chemoinformatics (2006)
138.
NuBBEDB: an updated database to uncover chemical and biological information from Brazilian biodiversity
Alan C Pilon, Marilia Valli, Alessandra C Dametto, Meri Emili F Pinto, Rafael T Freire, Ian Castro-Gamboa, Adriano D Andricopulo, Vanderlan S Bolzani
Scientific Reports (2017-08-03) https://doi.org/gh5ps7
139.
PAMDB: a comprehensive Pseudomonas aeruginosa metabolome database
Weiliang Huang, Luke K Brewer, Jace W Jones, Angela T Nguyen, Ana Marcu, David S Wishart, Amanda G Oglesby-Sherrouse, Maureen A Kane, Angela Wilks
Nucleic Acids Research (2017-11-02) https://doi.org/gh5ps9
DOI: 10.1093/nar/gkx1061 · PMID: 29106626 · PMCID: PMC5753269
140.
Phenol-Explorer 3.0: a major update of the Phenol-Explorer database to incorporate data on the effects of food processing on polyphenol content
JA Rothwell, J Perez-Jimenez, V Neveu, A Medina-Remon, N M'Hiri, P Garcia-Lobato, C Manach, C Knox, R Eisner, DS Wishart, A Scalbert
Database (2013-10-07) https://doi.org/gh5ps6
141.
PhytoHub, an online platform to gather expert knowledge on polyphenols and other dietary phytochemicals
Franck Giacomoni, Andreia Leonor Bento Da Silva, Maria Bronze, Cécile Gladine, Peter Hollman, R Kopec, Dorrain Low Yanwen, Pierre Micheau, Maria Claudia Nunes Dos Santos, Balthazar Pavot, … Claudine Manach
(2017-10) https://hal.archives-ouvertes.fr/hal-01697081
142.
ProCarDB: a database of bacterial carotenoids
LNU Nupur, Asheema Vats, Sandeep Kumar Dhanda, Gajendra PS Raghava, Anil Kumar Pinnaka, Ashwani Kumar
BMC Microbiology (2016-05-26) https://doi.org/f8wjvh
143.
RIKEN tandem mass spectral database (ReSpect) for phytochemicals: A plant-specific MS/MS-based data resource and database
Yuji Sawada, Ryo Nakabayashi, Yutaka Yamada, Makoto Suzuki, Muneo Sato, Akane Sakata, Kenji Akiyama, Tetsuya Sakurai, Fumio Matsuda, Toshio Aoki, … Kazuki Saito
Phytochemistry (2012-10) https://doi.org/f36bkc
144.
SANCDB: a South African natural compound database
Rowan Hatherley, David K Brown, Thommas M Musyoka, David L Penkler, Ngonidzashe Faya, Kevin A Lobb, Özlem Tastan Bishop
Journal of Cheminformatics (2015-06-19) https://doi.org/f7gjs6
145.
StreptomeDB 2.0—an extended resource of natural products produced by streptomycetes
Dennis Klementz, Kersten Döring, Xavier Lucas, Kiran K Telukunta, Anika Erxleben, Denise Deubel, Astrid Erber, Irene Santillana, Oliver S Thomas, Andreas Bechthold, Stefan Günther
Nucleic Acids Research (2015-11-28) https://doi.org/f8cnnk
DOI: 10.1093/nar/gkv1319 · PMID: 26615197 · PMCID: PMC4702922
146.
Seaweed metabolite database (SWMD): A database of natural compounds from marine algae
GDicky John Davis, AHannah Rachel Vasanthi
Bioinformation (2011-01-22) https://doi.org/gh5ps5
147.
TMDB: A literature-curated database for small molecular compounds found from tea
Yi Yue, Gang-Xiu Chu, Xue-Shi Liu, Xing Tang, Wei Wang, Guang-Jin Liu, Tao Yang, Tie-Jun Ling, Xiao-Gang Wang, Zheng-Zhu Zhang, … Guan-Hu Bao
BMC Plant Biology (2014-09-16) https://doi.org/f6hnfz
148.
TM-MC: a database of medicinal materials and chemical compounds in Northeast Asian traditional medicine
Sang-Kyun Kim, SeJin Nam, Hyunchul Jang, Anna Kim, Jeong-Ju Lee
BMC Complementary and Alternative Medicine (2015-07-09) https://doi.org/f7hnsd
149.
Comprehensive Toxic Plants–Phytotoxins Database and Its Application in Assessing Aquatic Micropollution Potential
Barbara F Günthardt, Juliane Hollender, Konrad Hungerbühler, Martin Scheringer, Thomas D Bucheli
Journal of Agricultural and Food Chemistry (2018-06-26) https://doi.org/gd3bm6
150.
Use of Natural Products as Chemical Library for Drug Discovery and Network Pharmacology
Jiangyong Gu, Yuanshen Gui, Lirong Chen, Gu Yuan, Hui-Zhe Lu, Xiaojie Xu
PLoS ONE (2013-04-25) https://doi.org/f43xwq