Results

Disclaimer:

The test results shown here are based on preliminary data and code which still is under development.
F-UJI is rapidly evolving and not yet available in a productive environment.

Click here to assess another data set

Assessment Results (saved at 2022-09-15 22:15:02):

Evaluated Resource:

opensource-repo

{JSON} New

FAIR level:	initial
Resource PID/URL:	https://github.com/usnistgov/opensource-repo
DataCite support:	enabled
Metric Version:	metrics_v0.4
Metric Specification:	https://doi.org/10.5281/zenodo.4081213
Software version:	v1.3.8
Download saved assessment results:	{JSON}
Save and share assessment results:	Saved assessments: 2021-12-09 (v1.3.8) 2022-09-15 (v1.3.8)

Showing cached or saved response. Click here to rerun the assessment

Summary:

	Score earned:	Fair level:
Findable:	1.5 of 7	initial
Accessible:	1 of 3	initial
Interoperable:	0 of 4	initial
Reusable:	1 of 10	initial

Report:

Findable

FAIR level:

3 of 3

advanced

Score:

1 of 1

Output:

{
    "guid": "https:\/\/github.com\/usnistgov\/opensource-repo",
    "guid_scheme": "url"
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-F1-01D-1

Identifier is resolvable and follows a defined unique identifier syntax (IRI, URL)

FsF-F1-01D-2

Identifier is not resolvable but follows an UUID or HASH type syntax

Debug messages:

Level:	Message:
INFO	Using idutils schemes
SUCCESS	Unique identifier schemes found ['url']
INFO	Finalized unique identifier scheme - url

FAIR level:

0 of 3

incomplete

Score:

0 of 1

Output:

{
    "pid": null,
    "pid_scheme": null,
    "resolvable_status": true,
    "resolved_url": "https:\/\/github.com\/usnistgov\/opensource-repo"
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-F1-02D-1

Identifier follows a defined persistent identifier syntax

FsF-F1-02D-2

Persistent identifier is resolvable

Debug messages:

Level:	Message:
INFO	PID schemes-based assessment supported by the assessment service - ['ark', 'arxiv', 'bioproject', 'biosample', 'doi', 'ensembl', 'genome', 'gnd', 'handle', 'lsid', 'pmid', 'pmcid', 'purl', 'refseq', 'sra', 'uniprot', 'urn']
INFO	Retrieving page -: https://github.com/usnistgov/opensource-repo as text/html, application/xhtml+xml, application/xml;q=0.5, text/xml;q=0.5, application/rdf+xml;q=0.5
INFO	Content negotiation accept=text/html, application/xhtml+xml, application/xml;q=0.5, text/xml;q=0.5, application/rdf+xml;q=0.5, status=200
INFO	Found HTML page!
INFO	Object identifier active (status code = 200)
WARNING	Not a persistent identifier scheme -: url

FAIR level:

1 of 3

initial

Score:

0.5 of 2

Output:

{
    "core_metadata_found": {
        "object_identifier": "https:\/\/github.com\/usnistgov\/opensource-repo",
        "object_type": "http:\/\/schema.org\/SoftwareSourceCode",
        "publisher": "GitHub",
        "summary": "This repository is the recommended template repository for NIST opensource contributions. - GitHub - usnistgov\/opensource-repo: This repository is the recommended template repository for NIST opens...",
        "title": "opensource-repo"
    },
    "core_metadata_source": [
        [
            "Embedded Microdata",
            "embedded"
        ],
        [
            "Embedded OpenGraph",
            "embedded"
        ]
    ],
    "core_metadata_status": "some metadata"
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-F2-01M-1

Metadata has been made available via common web methods

0.5

Metadata is embedded in the landing page XHTML/HTML code

Metadata is accessible through content negotiation

Metadata is accessible via typed links

Metadata is accessible via signposting links

FsF-F2-01M-2

Core data citation metadata is available

FsF-F2-01M-3

Core descriptive metadata is available

Debug messages:

Level:	Message:
INFO	Starting to identify EMBEDDED metadata at -: https://github.com/usnistgov/opensource-repo
INFO	Trying to retrieve schema.org JSON-LD metadata from html page
INFO	Could not identify JSON-LD schema.org metadata
INFO	schema.org JSON-LD metadata in html page UNAVAILABLE
INFO	Trying to retrieve Dublin Core metadata from html page
INFO	DublinCore metadata UNAVAILABLE
INFO	Trying to retrieve Microdata metadata from html page
INFO	Trying to extract Microdata metadata from -: Embedded Microdata
SUCCESS	Found microdata metadata -: dict_keys(['object_type', 'title'])
INFO	Trying to retrieve RDFa metadata from html page
INFO	RDFa metadata parsing exception, probably no RDFa embedded in HTML -:RDFa parsing Error! not well-formed (invalid token): line 15, column 75
INFO	Trying to retrieve OpenGraph metadata from html page
INFO	Found OpenGraph metadata-: dict_keys(['title', 'object_identifier', 'summary', 'object_type', 'publisher'])
INFO	Could not identify OpenGraph metadata
SUCCESS	Found OpenGraph metadata -: dict_keys(['title', 'object_identifier', 'summary', 'object_type', 'publisher'])
INFO	Trying to identify Typed Links in html page
INFO	Starting to identify EXTERNAL metadata through content negotiation or typed links
INFO	Trying to retrieve XML metadata through content negotiation
INFO	Retrieving page -: https://github.com/usnistgov/opensource-repo as application/xml, text/xml;q=0.5
INFO	Content negotiation accept=application/xml, text/xml;q=0.5, status=200
INFO	Ignoring HTML response
INFO	Trying to extract/parse metadata from -: Generic XML (Negotiated)
INFO	Expected XML but content negotiation responded -: html
INFO	Trying to retrieve schema.org JSON-LD metadata through content negotiation
INFO	Retrieving page -: https://github.com/usnistgov/opensource-repo as application/vnd.schemaorg.ld+json, application/ld+json
INFO	Content negotiation accept=application/vnd.schemaorg.ld+json, application/ld+json, status=200
INFO	Ignoring HTML response
INFO	Could not identify JSON-LD schema.org metadata
INFO	Schema.org metadata through content negotiation UNAVAILABLE
INFO	Trying to retrieve RDF metadata through content negotiation
INFO	Retrieving page -: https://github.com/usnistgov/opensource-repo as text/turtle, application/turtle, application/x-turtle;q=0.8, application/rdf+xml, text/n3;q=0.9, text/rdf+n3;q=0.9,application/ld+json
INFO	Content negotiation accept=text/turtle, application/turtle, application/x-turtle;q=0.8, application/rdf+xml, text/n3;q=0.9, text/rdf+n3;q=0.9,application/ld+json, status=200
INFO	Ignoring HTML response
INFO	Expected RDF Graph but received -: text/html
INFO	Linked Data metadata UNAVAILABLE
INFO	Not a PID, therefore Datacite metadata (json) not requested.
INFO	Type of object described by the metadata -: http://schema.org/SoftwareSourceCode
INFO	Testing for required core descriptive metadata elements -: ['creator', 'title', 'publisher', 'publication_date', 'summary', 'keywords', 'object_identifier', 'object_type']
WARNING	Not all required core descriptive metadata elements exist, missing -: ['creator', 'publication_date', 'keywords']
INFO	Testing for required core citation metadata elements -: ['creator', 'title', 'object_identifier', 'publication_date', 'publisher', 'object_type']
INFO	Found some descriptive metadata elements -: dict_keys(['object_type', 'title', 'object_identifier', 'summary', 'publisher'])
WARNING	Not all required citation metadata elements exist, missing -: ['creator', 'publication_date']

FAIR level:

0 of 3

incomplete

Score:

0 of 1

Output:

{
    "object_content_identifier_included": [],
    "object_identifier_included": "https:\/\/github.com\/usnistgov\/opensource-repo"
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-F3-01M-1

Metadata contains data content related information (file name, size, type)

FsF-F3-01M-2

Metadata contains a PID or URL which indicates the location of the downloadable data content

Debug messages:

Level:	Message:
INFO	Object identifier specified -: https://github.com/usnistgov/opensource-repo
WARNING	Data (content) identifier is missing.

FAIR level:

0 of 3

incomplete

Score:

0 of 2

Output:

{
    "search_mechanisms": []
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-F4-01M-1

Metadata is given in a way major search engines can ingest it for their catalogues (JSON-LD, Dublin Core, RDFa)

FsF-F4-01M-2

Metadata is registered in major research data registries (DataCite)

Debug messages:

Level:	Message:
INFO	Supported tests of metadata retrieval/extraction -: 'Embedded DublinCore', 'Embedded OpenGraph', 'Schema.org JSON-LD (Embedded)', 'Schema.org JSON-LD (Negotiated)', 'Datacite Search', 'Typed Links', 'Signposting Typed Links', 'RDF-based Typed Links', 'Linked Data (RDF)', 'B2FIND Metadata Aggregator', 'Guessed XML Link', 'Generic XML (Negotiated)', 'Embedded RDFa', 'Embedded Microdata', 'OAI-ORE'
WARNING	Metadata is NOT found through -: ['Schema.org JSON-LD (Negotiated)', 'Schema.org JSON-LD (Embedded)', 'Embedded DublinCore', 'Embedded RDFa']
INFO	Querying Google Dataset Search cache for -:https://github.com/usnistgov/opensource-repo
INFO	Identifier not listed in Google Dataset Search cache -:https://github.com/usnistgov/opensource-repo
INFO	Querying Mendeley Data API for -:https://github.com/usnistgov/opensource-repo
INFO	Identifier not listed in Mendeley Data catalogue -:https://github.com/usnistgov/opensource-repo
WARNING	Metadata is NOT found through registries considered by the assessment service -: ['Datacite Search', 'DataCite Registry', , ]

Accessible

FAIR level:

0 of 3

incomplete

Score:

0 of 1

Output:

{
    "access_details": [],
    "access_level": null
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-A1-01M-1

Information about access restrictions or rights can be identified in metadata

FsF-A1-01M-2

Data access information is machine readable

FsF-A1-01M-3

Data access information is indicated by (not machine readable) standard terms

Debug messages:

Level:	Message:
WARNING	NO access information is available in metadata
WARNING	Unable to determine the access level

FAIR level:

0 of 3

incomplete

Score:

0 of 1

Output:

{
    "standard_data_protocol": null
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-A1-03D-1

Metadata includes a resolvable link to data based on standardized web communication protocols.

Debug messages:

Level:	Message:
INFO	NO content (data) identifier is given in metadata

FAIR level:

3 of 3

advanced

Score:

1 of 1

Output:

{
    "standard_metadata_protocol": {
        "https": "Hyper Text Transfer Protocol Secure"
    }
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-A1-02M-1

Landing page link is based on standardized web communication protocols.

Debug messages:

Level:	Message:
SUCCESS	Standard protocol for access to metadata found -: https
INFO	NOT all required metadata given, see: FsF-F2-01M

Interoperable

FAIR level:

0 of 3

incomplete

Score:

0 of 2

Output:

[]

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-I1-01M-1

Parsable, structured metadata (JSON-LD, RDFa) is embedded in the landing page XHTML/HTML code

FsF-I1-01M-2

Parsable, graph data (RDF, JSON-LD) is accessible through content negotiation, typed links or sparql endpoint

Debug messages:

Level:	Message:
INFO	Check of structured data (RDF serialization) embedded in the data page
INFO	NO structured data (RDF serialization) embedded in the data page
INFO	Check if RDF-based typed link included
INFO	NO RDF-based typed link found
INFO	Check if RDF metadata available through content negotiation
INFO	NO RDF metadata available through content negotiation
WARNING	NO SPARQL endpoint found through re3data based on the object URI provided

FAIR level:

1 of 3

initial

Score:

0 of 1

Output:

[]

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-I1-02M-1

Vocabulary namespace URIs can be identified in metadata

FsF-I1-02M-2

Namespaces of known semantic resources can be identified in metadata

Debug messages:

Level:	Message:
INFO	Number of vocabulary namespaces extracted from all RDF-based metadata -: 3
INFO	Default vocabulary namespace(s) excluded -: ['http://ogp.me/ns#', 'http://schema.org/']
INFO	Check the remaining namespace(s) exists in LOD -: []
WARNING	NO vocabulary namespace match is found
WARNING	Vocabulary namespace (s) specified but no match is found in LOD reference list -: ['http://a9.com/-/spec/opensearch/1.1/']

FAIR level:

0 of 3

incomplete

Score:

0 of 1

Output:

[]

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-I3-01M-1

Related resources are explicitly mentioned in metadata

FsF-I3-01M-2

Related resources are indicated by machine readable links or identifiers

Debug messages:

Level:	Message:
INFO	Total number of related resources extracted -: 0

Reusable

FAIR level:

0 of 3

incomplete

Score:

0 of 4

Output:

{
    "data_content_descriptor": [],
    "object_type": null
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-R1-01MD-1

Minimal information about available data content is given in metadata

Resource type (e.g. dataset) is given in metadata

Information about data content (e.g. links) is given in metadata

FsF-R1-01MD-2

Verifiable data descriptors (file info, measured variables or observation types) are specified in metadata

File size and type information are specified in metadata

Measured variables or observation types are specified in metadata

FsF-R1-01MD-3

Data content matches file type and size specified in metadata

FsF-R1-01MD-4

Data content matches measured variables or observation types specified in metadata

Debug messages:

Level:	Message:
INFO	Object landing page accessible status -: True
WARNING	No valid resource type specified -: schema.org/softwaresourcecode
WARNING	NO data object content available/accessible to perform file descriptors (type and size) tests
WARNING	NO measured variables found in metadata, skip 'measured_variable' test.
WARNING	Measured variables given in metadata do not match data object content

FAIR level:

0 of 3

incomplete

Score:

0 of 2

Output:

[]

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-R1.1-01M-1

Licence information is given in an appropriate metadata element

FsF-R1.1-01M-2

Recognized licence is valid and registered at SPDX

Debug messages:

Level:	Message:
WARNING	License information unavailable in metadata

FAIR level:

2 of 3

moderate

Score:

1 of 2

Output:

{
    "provenance_metadata_included": {
        "is_available": true,
        "provenance_metadata": [
            {
                "metadata_element": "publisher",
                "metadata_value": "GitHub",
                "prov_o_mapping": "prov:wasAttributedTo"
            }
        ]
    },
    "structured_provenance_available": {
        "is_available": false,
        "provenance_metadata": []
    }
}

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-R1.2-01M-1

Metadata contains elements which hold provenance information and can be mapped to PROV

FsF-R1.2-01M-2

Metadata contains provenance information using formal provenance ontologies (PROV-O)

Debug messages:

Level:	Message:
INFO	Check if provenance information is available in descriptive metadata
INFO	Check if provenance information is available in metadata about related resources
INFO	No provenance information found in metadata about related resources
SUCCESS	Found data creation-related provenance information
INFO	Check if provenance specific namespaces are listed in metadata
WARNING	Formal provenance metadata is unavailable

FAIR level:

0 of 3

incomplete

Score:

0 of 1

Output:

[]

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-R1.3-01M-1

Community specific metadata standard is detected using namespaces or schemas found in provided metadata or metadata services outputs

FsF-R1.3-01M-2

Community specific metadata standard is listed in the re3data record of the responsible repository

FsF-R1.3-01M-3

Multidisciplinary but community endorsed metadata (RDA Metadata Standards Catalog) standard is listed in the re3data record or detected by namespace

Debug messages:

Level:	Message:
INFO	Found OpenSearch link in HTML head (link rel=search) -: https://github.com/opensearch.xml
INFO	Retrieving API and Standards
INFO	re3data/datacite client id -: None
INFO	Trying to retrieve metadata info from re3data/datacite services using client id -: None
WARNING	NO valid OAI-PMH endpoint found
INFO	Namespaces included in the metadata -: ['http://ogp.me/ns#', 'http://schema.org/', 'http://a9.com/-/spec/opensearch/1.1/']
INFO	The following standards found through namespaces are excluded as they are not listed in RDA metadata catalog -: ['http://ogp.me/ns#', 'http://schema.org/']
WARNING	NO metadata standard(s) of the repository specified in re3data
WARNING	Unable to determine community standard(s)

FAIR level:

0 of 3

incomplete

Score:

0 of 1

Output:

[]

Metric tests:

Test:

Test name:

Score:

Maturity:

Result:

FsF-R1.3-02D-1

The format of a data file given in the metadata is listed in the long term file formats, open file formats or scientific file formats controlled list

The format of the data file is an open format

The format of the data file is a long term format

The format of the data file is a scientific format

Debug messages:

Level:	Message:
WARNING	Could not perform file format checks as data content identifier(s) unavailable/inaccesible

Results

Disclaimer:

Assessment Results (saved at 2022-09-15 22:15:02):

Evaluated Resource:

opensource-repo

initial

Summary:

initial

initial

initial

initial

Report:

Findable

FsF-F1-01D - Data is assigned a globally unique identifier.

FsF-F1-02D - Data is assigned a persistent identifier.

FsF-F2-01M - Metadata includes descriptive core elements (creator, title, data identifier, publisher, publication date, summary and keywords) to support data findability.

FsF-F3-01M - Metadata includes the identifier of the data it describes.

FsF-F4-01M - Metadata is offered in such a way that it can be retrieved programmatically.

Accessible

FsF-A1-01M - Metadata contains access level and access conditions of the data.

FsF-A1-03D - Data is accessible through a standardized communication protocol.

FsF-A1-02M - Metadata is accessible through a standardized communication protocol.

Interoperable

FsF-I1-01M - Metadata is represented using a formal knowledge representation language.

FsF-I1-02M - Metadata uses semantic resources

FsF-I3-01M - Metadata includes links between the data and its related entities.

Reusable

FsF-R1-01MD - Metadata specifies the content of the data.

FsF-R1.1-01M - Metadata includes license information under which data can be reused.

FsF-R1.2-01M - Metadata includes provenance information about data creation or generation.

FsF-R1.3-01M - Metadata follows a standard recommended by the target research community of the data.

FsF-R1.3-02D - Data is available in a file format recommended by the target research community.