Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments

https://w3id.org/np/RAdE2K2HTb_Fn3fUY6LdmWod883m8Nj05Fcww2X_1RFcY

 Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments ScholarlyWork ConferencePaper ▼ comment... approve/disapprove... edit as derived nanopublication...

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://purl.org/dc/terms/abstract

abstract

(this is a literal)

"Scientific publishing seems to be at a turning point. Its paradigm has stayed basically the same for 300 years but is now challenged by the increasing volume of articles that makes it very hard for scientists to stay up to date in their respective fields. In fact, many have pointed out serious flaws of current scientific publishing practices, including the lack of accuracy and efficiency of the reviewing process. To address some of these problems, we apply here the general principles of the Web and the Semantic Web to scientific publishing, focusing on the reviewing process. We want to determine if a fine-grained model of the scientific publishing workflow can help us make the reviewing processes better organized and more accurate, by ensuring that review comments are created with formal links and semantics from the start. Our contributions include a novel model called Linkflows that allows for such detailed and semantically rich representations of reviews and the reviewing processes. We evaluate our approach on a manually curated dataset from several recent Computer Science journals and conferences that come with open peer reviews. We gathered ground-truth data by contacting the original reviewers and asking them to categorize their own review comments according to our model. Comparing this ground truth to answers provided by model experts, peers, and automated techniques confirms that our approach of formally capturing the reviewers' intentions from the start prevents substantial discrepancies compared to when this information is later extracted from the plain-text comments. In general, our analysis shows that our model is well understood and easy to apply, and it revealed the semantic properties of such review comments."

.

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://purl.org/dc/terms/date

date

(this is a literal)

"2019-09-23"

.

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://purl.org/dc/terms/isPartOf

isPartOf

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../kcap-2019

kcap-2019

.

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://purl.org/dc/terms/title

title

(this is a literal)

"Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments"

.

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://purl.org/ontology/bibo/authorList

authorList

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../author-list

author-list

.

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://purl.org/ontology/bibo/pageEnd

pageEnd

(this is a literal)

"187"

.

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://purl.org/ontology/bibo/pageStart

pageStart

(this is a literal)

"179"

.

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

http://www.w3.org/1999/02/22-rdf-syntax-ns#type

type

http://purl.org/spar/fabio/ConferencePaper

ConferencePaper

.

https://orcid.org/0000-0002-1267-0234

Tobias Kuhn

http://schema.org/affiliation

affiliation

https://ror.org/008xxew50

008xxew50

.

https://orcid.org/0000-0002-1267-0234

Tobias Kuhn

http://xmlns.com/foaf/0.1/name

name

(this is a literal)

"Tobias Kuhn"

.

https://orcid.org/0000-0002-2241-8585

Cristina-Iulia Bucur

http://schema.org/affiliation

affiliation

https://ror.org/008xxew50

008xxew50

.

https://orcid.org/0000-0002-2241-8585

Cristina-Iulia Bucur

http://xmlns.com/foaf/0.1/name

name

(this is a literal)

"Cristina-Iulia Bucur"

.

https://orcid.org/0000-0002-3357-9130

Davide Ceolin

http://schema.org/affiliation

affiliation

https://ror.org/00x7ekv49

00x7ekv49

.

https://orcid.org/0000-0002-3357-9130

Davide Ceolin

http://xmlns.com/foaf/0.1/name

name

(this is a literal)

"Davide Ceolin"

.

https://ror.org/008xxew50

008xxew50

http://xmlns.com/foaf/0.1/name

name

(this is a literal)

"Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands"

.

https://ror.org/00x7ekv49

00x7ekv49

http://xmlns.com/foaf/0.1/name

name

(this is a literal)

"Centrum Wiskunde & Informatica, Amsterdam, Netherlands"

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../author-list

author-list

http://www.w3.org/1999/02/22-rdf-syntax-ns#_1

_1

https://orcid.org/0000-0002-2241-8585

Cristina-Iulia Bucur

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../author-list

author-list

http://www.w3.org/1999/02/22-rdf-syntax-ns#_2

_2

https://orcid.org/0000-0002-1267-0234

Tobias Kuhn

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../author-list

author-list

http://www.w3.org/1999/02/22-rdf-syntax-ns#_3

_3

https://orcid.org/0000-0002-3357-9130

Davide Ceolin

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../kcap-2019

kcap-2019

http://purl.org/dc/terms/title

title

(this is a literal)

"Proceedings of the 10th International Conference on Knowledge Capture (K-CAP 2019)"

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAdE2K2HTb.../assertion The assertion above http://www.w3.org/ns/prov#wasAttributedTo

wasAttributedTo

https://orcid.org/0000-0002-1267-0234

Tobias Kuhn

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAdE2K2HTb.../assertion The assertion above http://www.w3.org/ns/prov#wasAttributedTo

wasAttributedTo

https://orcid.org/0000-0002-2241-8585

Cristina-Iulia Bucur

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAdE2K2HTb.../assertion The assertion above http://www.w3.org/ns/prov#wasAttributedTo

wasAttributedTo

https://orcid.org/0000-0002-3357-9130

Davide Ceolin

.

This is the identifier for the assertion of this nanopublication. https://w3id.org/np/RAdE2K2HTb.../assertion The assertion above http://www.w3.org/ns/prov#wasDerivedFrom

wasDerivedFrom

https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

.

https://orcid.org/0000-0002-1267-0234

Tobias Kuhn

http://xmlns.com/foaf/0.1/name has the name (this is a literal)

"Tobias Kuhn"

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAdE2K2HTb... This nanopublication http://www.w3.org/2000/01/rdf-schema#label has the label (this is a literal)

"Peer Reviewing Revisited: Assessing Research with Interlinked Semantic Comments"

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAdE2K2HTb... This nanopublication http://purl.org/nanopub/x/hasNanopubType has the type http://purl.org/spar/fabio/ScholarlyWork

ScholarlyWork

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAdE2K2HTb... This nanopublication date and time when the nanopublication was created http://purl.org/dc/terms/created was created on (this is a literal)

"2026-02-22T17:32:05.000+01:00"

(xsd:dateTime) .

This is the identifier for this whole nanopublication. https://w3id.org/np/RAdE2K2HTb... This nanopublication the nanopublication consists of an introduction of the given resource http://purl.org/nanopub/x/introduces introduces https://doi.org/10.1145/3360901.3364434

doi:10.1145/3360901.3364434

.

https://orcid.org/0000-0002-2241-8585

Cristina-Iulia Bucur

http://xmlns.com/foaf/0.1/name has the name (this is a literal)

"Cristina-Iulia Bucur"

.

https://orcid.org/0000-0002-3357-9130

Davide Ceolin

http://xmlns.com/foaf/0.1/name has the name (this is a literal)

"Davide Ceolin"

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../sig

sig

http://purl.org/nanopub/x/hasSignatureTarget has as target This is the identifier for this whole nanopublication. https://w3id.org/np/RAdE2K2HTb... this nanopublication .

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../sig

sig

http://purl.org/nanopub/x/hasAlgorithm has the algorithm (this is a literal)

"RSA"

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../sig

sig

http://purl.org/nanopub/x/hasPublicKey has the public key (this is a literal)

"MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEArRL5MjH1KfuE89dpKsIiscF/THrJ4uSvhl0NgaC8x3TdTDrL00kCnlH+2g7PMYhaUQIGWq27TTXHAGp7ehO8yLjRNeDCc8zjUCQJqLbzay3DB51PCiz50OsMgxiZC1+e0bVdk/CAQV4oVo+VgI+awHI1bTT4Yp7pR2I67imf1PIcwczGVhn8EQwtNdWQOZ63wDgUCY+6IubHBQzjLfbYh0828UETEyIV28T7fvf5+y4A5M590InmgkLGpJbRXoL0pnCm1BtFOoxeAVqfivbxIZWPYN2Yd0cSfqwIIUYyaLFpjDrBwc4iJdOus4UQ9OYqkeZDMpU3opU8jWKDIm77jwIDAQAB"

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../sig

sig

http://purl.org/nanopub/x/hasSignature has the signature (this is a literal)

"YhFqu5jFzcQJv/OR3a/Rdj9fWn0+av1LtZqkVFI09Pd00ouMqvw6u3rXkLdHGJ6dYyWA03mx+5Jdz2k+7lWXFPJYz9b941SW8Qrr+QCNKst/G8+QkT6nCmJFs81+sXHh/Q8J3lN7o1/J/D6ZAjXgU18pYx0cE88zMHZjhmj2E4J6HVGgmOcYwszWT1snKxArOnngCNY9W/kbCKsH81YEyYGrM3yMaiokrznzie1WZOKMWNZJtADe9kYvEODMpQKnlgAfJc5UGPt6idaW67HWwjwPqueUfZTQR1nIzRV+HextUVkjczzXGWh+xCXA+/qwZrOgiWUC4cNbke23rY66aQ=="

.

This is a local identifier minted within the nanopublication. https://w3id.org/np/RAdE2K2HTb.../sig

sig

http://purl.org/nanopub/x/signedBy is signed by https://w3id.org/np/RAkkUz7qBJ.../DOI-bot

DOI bot

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAdE2K2HTb...

this nanopublication

http://purl.org/dc/terms/creator

creator

https://w3id.org/np/RAkkUz7qBJ.../DOI-bot

DOI bot

.

This is the identifier for this whole nanopublication. https://w3id.org/np/RAdE2K2HTb...

this nanopublication

http://purl.org/dc/terms/license

license

https://creativecommons.org/publicdomain/zero/1.0/

1.0

.

DOI bot, 22 Feb 2026, 16:32:05 UTC

References