Being asked to review a paper in conference one has submitted to
As stated in the title (an IEEE conference). Does this create a conflict of interest antithetical to the reviewing process? Is it possible that accepting or refusing to review could jeopardise the chances of one's own paper being accepted?
peer-review ethics conference conflict-of-interest
add a comment |
As stated in the title (an IEEE conference). Does this create a conflict of interest antithetical to the reviewing process? Is it possible that accepting or refusing to review could jeopardise the chances of one's own paper being accepted?
peer-review ethics conference conflict-of-interest
4
As another example, I just finished reviewing papers for CogSci 2019, and while I didn't submit, I know a few people who both reviewed and submitted. As far as I know, it's pretty common at conferences this large, and the sheer numbers involved--both in terms of total submissions, and variety of areas--make it extremely unlikely for you accepting a paper you reviewed to have any effect on the chances of your own paper getting accepted.
– twoblackboxes
yesterday
add a comment |
As stated in the title (an IEEE conference). Does this create a conflict of interest antithetical to the reviewing process? Is it possible that accepting or refusing to review could jeopardise the chances of one's own paper being accepted?
peer-review ethics conference conflict-of-interest
As stated in the title (an IEEE conference). Does this create a conflict of interest antithetical to the reviewing process? Is it possible that accepting or refusing to review could jeopardise the chances of one's own paper being accepted?
peer-review ethics conference conflict-of-interest
peer-review ethics conference conflict-of-interest
edited yesterday
corey979
4,27052233
4,27052233
asked yesterday
StumblerStumbler
742414
742414
4
As another example, I just finished reviewing papers for CogSci 2019, and while I didn't submit, I know a few people who both reviewed and submitted. As far as I know, it's pretty common at conferences this large, and the sheer numbers involved--both in terms of total submissions, and variety of areas--make it extremely unlikely for you accepting a paper you reviewed to have any effect on the chances of your own paper getting accepted.
– twoblackboxes
yesterday
add a comment |
4
As another example, I just finished reviewing papers for CogSci 2019, and while I didn't submit, I know a few people who both reviewed and submitted. As far as I know, it's pretty common at conferences this large, and the sheer numbers involved--both in terms of total submissions, and variety of areas--make it extremely unlikely for you accepting a paper you reviewed to have any effect on the chances of your own paper getting accepted.
– twoblackboxes
yesterday
4
4
As another example, I just finished reviewing papers for CogSci 2019, and while I didn't submit, I know a few people who both reviewed and submitted. As far as I know, it's pretty common at conferences this large, and the sheer numbers involved--both in terms of total submissions, and variety of areas--make it extremely unlikely for you accepting a paper you reviewed to have any effect on the chances of your own paper getting accepted.
– twoblackboxes
yesterday
As another example, I just finished reviewing papers for CogSci 2019, and while I didn't submit, I know a few people who both reviewed and submitted. As far as I know, it's pretty common at conferences this large, and the sheer numbers involved--both in terms of total submissions, and variety of areas--make it extremely unlikely for you accepting a paper you reviewed to have any effect on the chances of your own paper getting accepted.
– twoblackboxes
yesterday
add a comment |
6 Answers
6
active
oldest
votes
No, there is no conflict. Your advice will be backed up or not by other reviewers. Likely the conference committee already knows that you are also a submitter.
But if you want double assurance of this, just send a note to the program chair that you have also submitted. If they see any issue, they will deal with it.
Just give an honest review as you would in any case. And trust that your paper will be accepted or not on its merits. Of course, there is quite a lot of competition, but that is always true.
2
I would add to this to say that colleagues have realised in the past, after submitting to a conference they were reviewing, that it was not against the rules but also "not the done thing", something you can't possibly know without speaking to the program chair! So getting in touch with the program chair should clear it all up.
– Jack Parkinson
yesterday
add a comment |
I see no reason why it would be a conflict of interest. An analogous question would be if there is a conflict of interest in you reviewing papers in a journal you might publish in. Given that other conference attendees are in the same/similar field as you, and are interested in a good conference, those attendees would seem to be the ideal group to pull reviewers from.
In conferences where I've seen the sausage being made, accepting to review gains no advantage. Refusing any and all review requests will ultimately be viewed as rude, but will not disadvantage you in having your paper accepted. (Invitations for invited talks and membership on the conference committee may well be hindered, however.)
4
Journals aren't analogous because there's more scope for accepting "too many" papers today and dealing with the backlog tomorrow. Conferences are closer to a zero-sum game, where getting rid of competitors makes it more likely that your own paper will be accepted.
– David Richerby
yesterday
@DavidRicherby - still it is a pretty close analog, perhaps less so now than in the old days of mail delivery of printed copies of journals. A finite number of papers are published a year. A 'conference proceedings' issue of a journal could often dwarf the rest of the journal's output that year, at least in the old days. The point is, your fellow attendees (and paper submitters) are the same folks as are publishing in your favorite journal(s).
– Jon Custer
yesterday
Sure but a journal can always accept your paper today and not actually print it for another three or four issues. It can also decide to print an extra issue to make up the backlog, of print fatter issues for a while. A conference doesn't have the option of saying "We're accepting your paper, but you can't present it until next year" and it has less scope for making the conference larger to accommodate more papers.
– David Richerby
yesterday
@DavidRicherby "Getting rid of competitors" is also a zero sum game, if most of the submitters are also reviewers. Or it might be better to describe it as a prisoner's dilemma situation - if everybody rejects the papers they review because they are competing with their own submission, nothing gets accepted.
– alephzero
21 hours ago
@alephzero You're confusing games and strategies. The conference is the game; trashing other authors' papers is a strategy. Zero-sum is a property of games, not strategies. The key point is that most people don't use the strategy of trashing other people's papers. (Alas, everybody using it would be a Nash equilibrium)
– David Richerby
21 hours ago
|
show 2 more comments
I've reviewed for many CS conferences and never seen one that has a conflict of interest policy saying that people who've submitted a paper can't review. I'm sure I've reviewed papers for conferences I've submitted to. Yes, there is the slight conflict that a negative review for some other paper will likely mean a higher chance of yours being accepted, but it's going to look mighty suspicious if the reviews for a paper are "accept", "accept", "accept", "strong reject" and the "strong reject" just happens to come from a competitor.
I think I would decline to review a paper that was on a topic very close to my own submission because a positive review might be seen as "Oh, he's just hyping the subject so we think his own paper's awesome, too" and a negative review as "Oh, he's just trying to kill off the competition." At the very least, I'd check that the PC member who asked me to review was aware that I'd submitted a paper on the same topic. And you can always check that the PC member is happy for you to review.
add a comment |
In conferences, even selective ones, the conflict of interest (as long as you do not review the paper of a past or current supervisor or supervised or obvious ally or enemy) is minimal. Also, good conferences concentrate the main experts on the field, so it would be very difficult to run it if they would perceive their reviews as conflict of interest.
This is quite different from reviewing for project proposals programs to which you submitted yourself. In these typically the total budget is very restrictive, and you are effectively placed in immediate antagonistic relation with all other submitters. Or else, if you end up being honest and recommend someone else's proposal in such a setting, if your own proposal ends up being rejected, you will keep asking yourself whether it was not your own recommendation of a competitor's that killed it. Or if you reject theirs, it is never clear how objective your judgement was.
And yes, as unbelievable as it sounds, it does occur that people are expressly and emphatically asked to review for calls to which they themselves submitted (e.g. because expertise is so scarce).
add a comment |
On the contrary, the IEEE conferences I am involved with (robotics and controls), explicitly expect authors to provide 2-3 reviews per paper submitted.
Reviews are not being submitted in a vacuum -- each paper gets multiple reviews, mediated by layers of editorial oversight. The downside risk of trying to game the system by submitting unwarranted bad reviews (losing the respect of senior members of your research community) far outweighs the minuscule potential benefits (the tiny chance that your paper is on the dividing edge of a hard quota line, such that bumping one other paper down bumps you over the line [if such a ranking/quota even exists], and that your bad review of an otherwise decent paper will tip the balance enough on it to bump it down when combined with the other reviews).
add a comment |
Assuming the papers are part of a blind peer-review process, I've never seen an example of this cited as a conflict of interest. Doesn't mean it isn't a potential conflict; I haven't come across this as such.
What would the conflict be in this regard? Are you worried about providing accurate feedback on papers? Usually, as a reviewer, there's a system in place whereby you're not just saying "yes" or "no" without giving written feedback.
2
The conflict is that the asker can increase the chance of their own paper being accepted to the converence by giving a bad review to somebody else's paper.
– David Richerby
yesterday
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "415"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f126053%2fbeing-asked-to-review-a-paper-in-conference-one-has-submitted-to%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
6 Answers
6
active
oldest
votes
6 Answers
6
active
oldest
votes
active
oldest
votes
active
oldest
votes
No, there is no conflict. Your advice will be backed up or not by other reviewers. Likely the conference committee already knows that you are also a submitter.
But if you want double assurance of this, just send a note to the program chair that you have also submitted. If they see any issue, they will deal with it.
Just give an honest review as you would in any case. And trust that your paper will be accepted or not on its merits. Of course, there is quite a lot of competition, but that is always true.
2
I would add to this to say that colleagues have realised in the past, after submitting to a conference they were reviewing, that it was not against the rules but also "not the done thing", something you can't possibly know without speaking to the program chair! So getting in touch with the program chair should clear it all up.
– Jack Parkinson
yesterday
add a comment |
No, there is no conflict. Your advice will be backed up or not by other reviewers. Likely the conference committee already knows that you are also a submitter.
But if you want double assurance of this, just send a note to the program chair that you have also submitted. If they see any issue, they will deal with it.
Just give an honest review as you would in any case. And trust that your paper will be accepted or not on its merits. Of course, there is quite a lot of competition, but that is always true.
2
I would add to this to say that colleagues have realised in the past, after submitting to a conference they were reviewing, that it was not against the rules but also "not the done thing", something you can't possibly know without speaking to the program chair! So getting in touch with the program chair should clear it all up.
– Jack Parkinson
yesterday
add a comment |
No, there is no conflict. Your advice will be backed up or not by other reviewers. Likely the conference committee already knows that you are also a submitter.
But if you want double assurance of this, just send a note to the program chair that you have also submitted. If they see any issue, they will deal with it.
Just give an honest review as you would in any case. And trust that your paper will be accepted or not on its merits. Of course, there is quite a lot of competition, but that is always true.
No, there is no conflict. Your advice will be backed up or not by other reviewers. Likely the conference committee already knows that you are also a submitter.
But if you want double assurance of this, just send a note to the program chair that you have also submitted. If they see any issue, they will deal with it.
Just give an honest review as you would in any case. And trust that your paper will be accepted or not on its merits. Of course, there is quite a lot of competition, but that is always true.
answered yesterday
BuffyBuffy
50.8k14165253
50.8k14165253
2
I would add to this to say that colleagues have realised in the past, after submitting to a conference they were reviewing, that it was not against the rules but also "not the done thing", something you can't possibly know without speaking to the program chair! So getting in touch with the program chair should clear it all up.
– Jack Parkinson
yesterday
add a comment |
2
I would add to this to say that colleagues have realised in the past, after submitting to a conference they were reviewing, that it was not against the rules but also "not the done thing", something you can't possibly know without speaking to the program chair! So getting in touch with the program chair should clear it all up.
– Jack Parkinson
yesterday
2
2
I would add to this to say that colleagues have realised in the past, after submitting to a conference they were reviewing, that it was not against the rules but also "not the done thing", something you can't possibly know without speaking to the program chair! So getting in touch with the program chair should clear it all up.
– Jack Parkinson
yesterday
I would add to this to say that colleagues have realised in the past, after submitting to a conference they were reviewing, that it was not against the rules but also "not the done thing", something you can't possibly know without speaking to the program chair! So getting in touch with the program chair should clear it all up.
– Jack Parkinson
yesterday
add a comment |
I see no reason why it would be a conflict of interest. An analogous question would be if there is a conflict of interest in you reviewing papers in a journal you might publish in. Given that other conference attendees are in the same/similar field as you, and are interested in a good conference, those attendees would seem to be the ideal group to pull reviewers from.
In conferences where I've seen the sausage being made, accepting to review gains no advantage. Refusing any and all review requests will ultimately be viewed as rude, but will not disadvantage you in having your paper accepted. (Invitations for invited talks and membership on the conference committee may well be hindered, however.)
4
Journals aren't analogous because there's more scope for accepting "too many" papers today and dealing with the backlog tomorrow. Conferences are closer to a zero-sum game, where getting rid of competitors makes it more likely that your own paper will be accepted.
– David Richerby
yesterday
@DavidRicherby - still it is a pretty close analog, perhaps less so now than in the old days of mail delivery of printed copies of journals. A finite number of papers are published a year. A 'conference proceedings' issue of a journal could often dwarf the rest of the journal's output that year, at least in the old days. The point is, your fellow attendees (and paper submitters) are the same folks as are publishing in your favorite journal(s).
– Jon Custer
yesterday
Sure but a journal can always accept your paper today and not actually print it for another three or four issues. It can also decide to print an extra issue to make up the backlog, of print fatter issues for a while. A conference doesn't have the option of saying "We're accepting your paper, but you can't present it until next year" and it has less scope for making the conference larger to accommodate more papers.
– David Richerby
yesterday
@DavidRicherby "Getting rid of competitors" is also a zero sum game, if most of the submitters are also reviewers. Or it might be better to describe it as a prisoner's dilemma situation - if everybody rejects the papers they review because they are competing with their own submission, nothing gets accepted.
– alephzero
21 hours ago
@alephzero You're confusing games and strategies. The conference is the game; trashing other authors' papers is a strategy. Zero-sum is a property of games, not strategies. The key point is that most people don't use the strategy of trashing other people's papers. (Alas, everybody using it would be a Nash equilibrium)
– David Richerby
21 hours ago
|
show 2 more comments
I see no reason why it would be a conflict of interest. An analogous question would be if there is a conflict of interest in you reviewing papers in a journal you might publish in. Given that other conference attendees are in the same/similar field as you, and are interested in a good conference, those attendees would seem to be the ideal group to pull reviewers from.
In conferences where I've seen the sausage being made, accepting to review gains no advantage. Refusing any and all review requests will ultimately be viewed as rude, but will not disadvantage you in having your paper accepted. (Invitations for invited talks and membership on the conference committee may well be hindered, however.)
4
Journals aren't analogous because there's more scope for accepting "too many" papers today and dealing with the backlog tomorrow. Conferences are closer to a zero-sum game, where getting rid of competitors makes it more likely that your own paper will be accepted.
– David Richerby
yesterday
@DavidRicherby - still it is a pretty close analog, perhaps less so now than in the old days of mail delivery of printed copies of journals. A finite number of papers are published a year. A 'conference proceedings' issue of a journal could often dwarf the rest of the journal's output that year, at least in the old days. The point is, your fellow attendees (and paper submitters) are the same folks as are publishing in your favorite journal(s).
– Jon Custer
yesterday
Sure but a journal can always accept your paper today and not actually print it for another three or four issues. It can also decide to print an extra issue to make up the backlog, of print fatter issues for a while. A conference doesn't have the option of saying "We're accepting your paper, but you can't present it until next year" and it has less scope for making the conference larger to accommodate more papers.
– David Richerby
yesterday
@DavidRicherby "Getting rid of competitors" is also a zero sum game, if most of the submitters are also reviewers. Or it might be better to describe it as a prisoner's dilemma situation - if everybody rejects the papers they review because they are competing with their own submission, nothing gets accepted.
– alephzero
21 hours ago
@alephzero You're confusing games and strategies. The conference is the game; trashing other authors' papers is a strategy. Zero-sum is a property of games, not strategies. The key point is that most people don't use the strategy of trashing other people's papers. (Alas, everybody using it would be a Nash equilibrium)
– David Richerby
21 hours ago
|
show 2 more comments
I see no reason why it would be a conflict of interest. An analogous question would be if there is a conflict of interest in you reviewing papers in a journal you might publish in. Given that other conference attendees are in the same/similar field as you, and are interested in a good conference, those attendees would seem to be the ideal group to pull reviewers from.
In conferences where I've seen the sausage being made, accepting to review gains no advantage. Refusing any and all review requests will ultimately be viewed as rude, but will not disadvantage you in having your paper accepted. (Invitations for invited talks and membership on the conference committee may well be hindered, however.)
I see no reason why it would be a conflict of interest. An analogous question would be if there is a conflict of interest in you reviewing papers in a journal you might publish in. Given that other conference attendees are in the same/similar field as you, and are interested in a good conference, those attendees would seem to be the ideal group to pull reviewers from.
In conferences where I've seen the sausage being made, accepting to review gains no advantage. Refusing any and all review requests will ultimately be viewed as rude, but will not disadvantage you in having your paper accepted. (Invitations for invited talks and membership on the conference committee may well be hindered, however.)
answered yesterday
Jon CusterJon Custer
4,14121327
4,14121327
4
Journals aren't analogous because there's more scope for accepting "too many" papers today and dealing with the backlog tomorrow. Conferences are closer to a zero-sum game, where getting rid of competitors makes it more likely that your own paper will be accepted.
– David Richerby
yesterday
@DavidRicherby - still it is a pretty close analog, perhaps less so now than in the old days of mail delivery of printed copies of journals. A finite number of papers are published a year. A 'conference proceedings' issue of a journal could often dwarf the rest of the journal's output that year, at least in the old days. The point is, your fellow attendees (and paper submitters) are the same folks as are publishing in your favorite journal(s).
– Jon Custer
yesterday
Sure but a journal can always accept your paper today and not actually print it for another three or four issues. It can also decide to print an extra issue to make up the backlog, of print fatter issues for a while. A conference doesn't have the option of saying "We're accepting your paper, but you can't present it until next year" and it has less scope for making the conference larger to accommodate more papers.
– David Richerby
yesterday
@DavidRicherby "Getting rid of competitors" is also a zero sum game, if most of the submitters are also reviewers. Or it might be better to describe it as a prisoner's dilemma situation - if everybody rejects the papers they review because they are competing with their own submission, nothing gets accepted.
– alephzero
21 hours ago
@alephzero You're confusing games and strategies. The conference is the game; trashing other authors' papers is a strategy. Zero-sum is a property of games, not strategies. The key point is that most people don't use the strategy of trashing other people's papers. (Alas, everybody using it would be a Nash equilibrium)
– David Richerby
21 hours ago
|
show 2 more comments
4
Journals aren't analogous because there's more scope for accepting "too many" papers today and dealing with the backlog tomorrow. Conferences are closer to a zero-sum game, where getting rid of competitors makes it more likely that your own paper will be accepted.
– David Richerby
yesterday
@DavidRicherby - still it is a pretty close analog, perhaps less so now than in the old days of mail delivery of printed copies of journals. A finite number of papers are published a year. A 'conference proceedings' issue of a journal could often dwarf the rest of the journal's output that year, at least in the old days. The point is, your fellow attendees (and paper submitters) are the same folks as are publishing in your favorite journal(s).
– Jon Custer
yesterday
Sure but a journal can always accept your paper today and not actually print it for another three or four issues. It can also decide to print an extra issue to make up the backlog, of print fatter issues for a while. A conference doesn't have the option of saying "We're accepting your paper, but you can't present it until next year" and it has less scope for making the conference larger to accommodate more papers.
– David Richerby
yesterday
@DavidRicherby "Getting rid of competitors" is also a zero sum game, if most of the submitters are also reviewers. Or it might be better to describe it as a prisoner's dilemma situation - if everybody rejects the papers they review because they are competing with their own submission, nothing gets accepted.
– alephzero
21 hours ago
@alephzero You're confusing games and strategies. The conference is the game; trashing other authors' papers is a strategy. Zero-sum is a property of games, not strategies. The key point is that most people don't use the strategy of trashing other people's papers. (Alas, everybody using it would be a Nash equilibrium)
– David Richerby
21 hours ago
4
4
Journals aren't analogous because there's more scope for accepting "too many" papers today and dealing with the backlog tomorrow. Conferences are closer to a zero-sum game, where getting rid of competitors makes it more likely that your own paper will be accepted.
– David Richerby
yesterday
Journals aren't analogous because there's more scope for accepting "too many" papers today and dealing with the backlog tomorrow. Conferences are closer to a zero-sum game, where getting rid of competitors makes it more likely that your own paper will be accepted.
– David Richerby
yesterday
@DavidRicherby - still it is a pretty close analog, perhaps less so now than in the old days of mail delivery of printed copies of journals. A finite number of papers are published a year. A 'conference proceedings' issue of a journal could often dwarf the rest of the journal's output that year, at least in the old days. The point is, your fellow attendees (and paper submitters) are the same folks as are publishing in your favorite journal(s).
– Jon Custer
yesterday
@DavidRicherby - still it is a pretty close analog, perhaps less so now than in the old days of mail delivery of printed copies of journals. A finite number of papers are published a year. A 'conference proceedings' issue of a journal could often dwarf the rest of the journal's output that year, at least in the old days. The point is, your fellow attendees (and paper submitters) are the same folks as are publishing in your favorite journal(s).
– Jon Custer
yesterday
Sure but a journal can always accept your paper today and not actually print it for another three or four issues. It can also decide to print an extra issue to make up the backlog, of print fatter issues for a while. A conference doesn't have the option of saying "We're accepting your paper, but you can't present it until next year" and it has less scope for making the conference larger to accommodate more papers.
– David Richerby
yesterday
Sure but a journal can always accept your paper today and not actually print it for another three or four issues. It can also decide to print an extra issue to make up the backlog, of print fatter issues for a while. A conference doesn't have the option of saying "We're accepting your paper, but you can't present it until next year" and it has less scope for making the conference larger to accommodate more papers.
– David Richerby
yesterday
@DavidRicherby "Getting rid of competitors" is also a zero sum game, if most of the submitters are also reviewers. Or it might be better to describe it as a prisoner's dilemma situation - if everybody rejects the papers they review because they are competing with their own submission, nothing gets accepted.
– alephzero
21 hours ago
@DavidRicherby "Getting rid of competitors" is also a zero sum game, if most of the submitters are also reviewers. Or it might be better to describe it as a prisoner's dilemma situation - if everybody rejects the papers they review because they are competing with their own submission, nothing gets accepted.
– alephzero
21 hours ago
@alephzero You're confusing games and strategies. The conference is the game; trashing other authors' papers is a strategy. Zero-sum is a property of games, not strategies. The key point is that most people don't use the strategy of trashing other people's papers. (Alas, everybody using it would be a Nash equilibrium)
– David Richerby
21 hours ago
@alephzero You're confusing games and strategies. The conference is the game; trashing other authors' papers is a strategy. Zero-sum is a property of games, not strategies. The key point is that most people don't use the strategy of trashing other people's papers. (Alas, everybody using it would be a Nash equilibrium)
– David Richerby
21 hours ago
|
show 2 more comments
I've reviewed for many CS conferences and never seen one that has a conflict of interest policy saying that people who've submitted a paper can't review. I'm sure I've reviewed papers for conferences I've submitted to. Yes, there is the slight conflict that a negative review for some other paper will likely mean a higher chance of yours being accepted, but it's going to look mighty suspicious if the reviews for a paper are "accept", "accept", "accept", "strong reject" and the "strong reject" just happens to come from a competitor.
I think I would decline to review a paper that was on a topic very close to my own submission because a positive review might be seen as "Oh, he's just hyping the subject so we think his own paper's awesome, too" and a negative review as "Oh, he's just trying to kill off the competition." At the very least, I'd check that the PC member who asked me to review was aware that I'd submitted a paper on the same topic. And you can always check that the PC member is happy for you to review.
add a comment |
I've reviewed for many CS conferences and never seen one that has a conflict of interest policy saying that people who've submitted a paper can't review. I'm sure I've reviewed papers for conferences I've submitted to. Yes, there is the slight conflict that a negative review for some other paper will likely mean a higher chance of yours being accepted, but it's going to look mighty suspicious if the reviews for a paper are "accept", "accept", "accept", "strong reject" and the "strong reject" just happens to come from a competitor.
I think I would decline to review a paper that was on a topic very close to my own submission because a positive review might be seen as "Oh, he's just hyping the subject so we think his own paper's awesome, too" and a negative review as "Oh, he's just trying to kill off the competition." At the very least, I'd check that the PC member who asked me to review was aware that I'd submitted a paper on the same topic. And you can always check that the PC member is happy for you to review.
add a comment |
I've reviewed for many CS conferences and never seen one that has a conflict of interest policy saying that people who've submitted a paper can't review. I'm sure I've reviewed papers for conferences I've submitted to. Yes, there is the slight conflict that a negative review for some other paper will likely mean a higher chance of yours being accepted, but it's going to look mighty suspicious if the reviews for a paper are "accept", "accept", "accept", "strong reject" and the "strong reject" just happens to come from a competitor.
I think I would decline to review a paper that was on a topic very close to my own submission because a positive review might be seen as "Oh, he's just hyping the subject so we think his own paper's awesome, too" and a negative review as "Oh, he's just trying to kill off the competition." At the very least, I'd check that the PC member who asked me to review was aware that I'd submitted a paper on the same topic. And you can always check that the PC member is happy for you to review.
I've reviewed for many CS conferences and never seen one that has a conflict of interest policy saying that people who've submitted a paper can't review. I'm sure I've reviewed papers for conferences I've submitted to. Yes, there is the slight conflict that a negative review for some other paper will likely mean a higher chance of yours being accepted, but it's going to look mighty suspicious if the reviews for a paper are "accept", "accept", "accept", "strong reject" and the "strong reject" just happens to come from a competitor.
I think I would decline to review a paper that was on a topic very close to my own submission because a positive review might be seen as "Oh, he's just hyping the subject so we think his own paper's awesome, too" and a negative review as "Oh, he's just trying to kill off the competition." At the very least, I'd check that the PC member who asked me to review was aware that I'd submitted a paper on the same topic. And you can always check that the PC member is happy for you to review.
answered yesterday
David RicherbyDavid Richerby
29.6k661125
29.6k661125
add a comment |
add a comment |
In conferences, even selective ones, the conflict of interest (as long as you do not review the paper of a past or current supervisor or supervised or obvious ally or enemy) is minimal. Also, good conferences concentrate the main experts on the field, so it would be very difficult to run it if they would perceive their reviews as conflict of interest.
This is quite different from reviewing for project proposals programs to which you submitted yourself. In these typically the total budget is very restrictive, and you are effectively placed in immediate antagonistic relation with all other submitters. Or else, if you end up being honest and recommend someone else's proposal in such a setting, if your own proposal ends up being rejected, you will keep asking yourself whether it was not your own recommendation of a competitor's that killed it. Or if you reject theirs, it is never clear how objective your judgement was.
And yes, as unbelievable as it sounds, it does occur that people are expressly and emphatically asked to review for calls to which they themselves submitted (e.g. because expertise is so scarce).
add a comment |
In conferences, even selective ones, the conflict of interest (as long as you do not review the paper of a past or current supervisor or supervised or obvious ally or enemy) is minimal. Also, good conferences concentrate the main experts on the field, so it would be very difficult to run it if they would perceive their reviews as conflict of interest.
This is quite different from reviewing for project proposals programs to which you submitted yourself. In these typically the total budget is very restrictive, and you are effectively placed in immediate antagonistic relation with all other submitters. Or else, if you end up being honest and recommend someone else's proposal in such a setting, if your own proposal ends up being rejected, you will keep asking yourself whether it was not your own recommendation of a competitor's that killed it. Or if you reject theirs, it is never clear how objective your judgement was.
And yes, as unbelievable as it sounds, it does occur that people are expressly and emphatically asked to review for calls to which they themselves submitted (e.g. because expertise is so scarce).
add a comment |
In conferences, even selective ones, the conflict of interest (as long as you do not review the paper of a past or current supervisor or supervised or obvious ally or enemy) is minimal. Also, good conferences concentrate the main experts on the field, so it would be very difficult to run it if they would perceive their reviews as conflict of interest.
This is quite different from reviewing for project proposals programs to which you submitted yourself. In these typically the total budget is very restrictive, and you are effectively placed in immediate antagonistic relation with all other submitters. Or else, if you end up being honest and recommend someone else's proposal in such a setting, if your own proposal ends up being rejected, you will keep asking yourself whether it was not your own recommendation of a competitor's that killed it. Or if you reject theirs, it is never clear how objective your judgement was.
And yes, as unbelievable as it sounds, it does occur that people are expressly and emphatically asked to review for calls to which they themselves submitted (e.g. because expertise is so scarce).
In conferences, even selective ones, the conflict of interest (as long as you do not review the paper of a past or current supervisor or supervised or obvious ally or enemy) is minimal. Also, good conferences concentrate the main experts on the field, so it would be very difficult to run it if they would perceive their reviews as conflict of interest.
This is quite different from reviewing for project proposals programs to which you submitted yourself. In these typically the total budget is very restrictive, and you are effectively placed in immediate antagonistic relation with all other submitters. Or else, if you end up being honest and recommend someone else's proposal in such a setting, if your own proposal ends up being rejected, you will keep asking yourself whether it was not your own recommendation of a competitor's that killed it. Or if you reject theirs, it is never clear how objective your judgement was.
And yes, as unbelievable as it sounds, it does occur that people are expressly and emphatically asked to review for calls to which they themselves submitted (e.g. because expertise is so scarce).
answered yesterday
Captain EmacsCaptain Emacs
23.2k95384
23.2k95384
add a comment |
add a comment |
On the contrary, the IEEE conferences I am involved with (robotics and controls), explicitly expect authors to provide 2-3 reviews per paper submitted.
Reviews are not being submitted in a vacuum -- each paper gets multiple reviews, mediated by layers of editorial oversight. The downside risk of trying to game the system by submitting unwarranted bad reviews (losing the respect of senior members of your research community) far outweighs the minuscule potential benefits (the tiny chance that your paper is on the dividing edge of a hard quota line, such that bumping one other paper down bumps you over the line [if such a ranking/quota even exists], and that your bad review of an otherwise decent paper will tip the balance enough on it to bump it down when combined with the other reviews).
add a comment |
On the contrary, the IEEE conferences I am involved with (robotics and controls), explicitly expect authors to provide 2-3 reviews per paper submitted.
Reviews are not being submitted in a vacuum -- each paper gets multiple reviews, mediated by layers of editorial oversight. The downside risk of trying to game the system by submitting unwarranted bad reviews (losing the respect of senior members of your research community) far outweighs the minuscule potential benefits (the tiny chance that your paper is on the dividing edge of a hard quota line, such that bumping one other paper down bumps you over the line [if such a ranking/quota even exists], and that your bad review of an otherwise decent paper will tip the balance enough on it to bump it down when combined with the other reviews).
add a comment |
On the contrary, the IEEE conferences I am involved with (robotics and controls), explicitly expect authors to provide 2-3 reviews per paper submitted.
Reviews are not being submitted in a vacuum -- each paper gets multiple reviews, mediated by layers of editorial oversight. The downside risk of trying to game the system by submitting unwarranted bad reviews (losing the respect of senior members of your research community) far outweighs the minuscule potential benefits (the tiny chance that your paper is on the dividing edge of a hard quota line, such that bumping one other paper down bumps you over the line [if such a ranking/quota even exists], and that your bad review of an otherwise decent paper will tip the balance enough on it to bump it down when combined with the other reviews).
On the contrary, the IEEE conferences I am involved with (robotics and controls), explicitly expect authors to provide 2-3 reviews per paper submitted.
Reviews are not being submitted in a vacuum -- each paper gets multiple reviews, mediated by layers of editorial oversight. The downside risk of trying to game the system by submitting unwarranted bad reviews (losing the respect of senior members of your research community) far outweighs the minuscule potential benefits (the tiny chance that your paper is on the dividing edge of a hard quota line, such that bumping one other paper down bumps you over the line [if such a ranking/quota even exists], and that your bad review of an otherwise decent paper will tip the balance enough on it to bump it down when combined with the other reviews).
answered 16 hours ago
RLHRLH
421145
421145
add a comment |
add a comment |
Assuming the papers are part of a blind peer-review process, I've never seen an example of this cited as a conflict of interest. Doesn't mean it isn't a potential conflict; I haven't come across this as such.
What would the conflict be in this regard? Are you worried about providing accurate feedback on papers? Usually, as a reviewer, there's a system in place whereby you're not just saying "yes" or "no" without giving written feedback.
2
The conflict is that the asker can increase the chance of their own paper being accepted to the converence by giving a bad review to somebody else's paper.
– David Richerby
yesterday
add a comment |
Assuming the papers are part of a blind peer-review process, I've never seen an example of this cited as a conflict of interest. Doesn't mean it isn't a potential conflict; I haven't come across this as such.
What would the conflict be in this regard? Are you worried about providing accurate feedback on papers? Usually, as a reviewer, there's a system in place whereby you're not just saying "yes" or "no" without giving written feedback.
2
The conflict is that the asker can increase the chance of their own paper being accepted to the converence by giving a bad review to somebody else's paper.
– David Richerby
yesterday
add a comment |
Assuming the papers are part of a blind peer-review process, I've never seen an example of this cited as a conflict of interest. Doesn't mean it isn't a potential conflict; I haven't come across this as such.
What would the conflict be in this regard? Are you worried about providing accurate feedback on papers? Usually, as a reviewer, there's a system in place whereby you're not just saying "yes" or "no" without giving written feedback.
Assuming the papers are part of a blind peer-review process, I've never seen an example of this cited as a conflict of interest. Doesn't mean it isn't a potential conflict; I haven't come across this as such.
What would the conflict be in this regard? Are you worried about providing accurate feedback on papers? Usually, as a reviewer, there's a system in place whereby you're not just saying "yes" or "no" without giving written feedback.
answered yesterday
PareverParever
16226
16226
2
The conflict is that the asker can increase the chance of their own paper being accepted to the converence by giving a bad review to somebody else's paper.
– David Richerby
yesterday
add a comment |
2
The conflict is that the asker can increase the chance of their own paper being accepted to the converence by giving a bad review to somebody else's paper.
– David Richerby
yesterday
2
2
The conflict is that the asker can increase the chance of their own paper being accepted to the converence by giving a bad review to somebody else's paper.
– David Richerby
yesterday
The conflict is that the asker can increase the chance of their own paper being accepted to the converence by giving a bad review to somebody else's paper.
– David Richerby
yesterday
add a comment |
Thanks for contributing an answer to Academia Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f126053%2fbeing-asked-to-review-a-paper-in-conference-one-has-submitted-to%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
4
As another example, I just finished reviewing papers for CogSci 2019, and while I didn't submit, I know a few people who both reviewed and submitted. As far as I know, it's pretty common at conferences this large, and the sheer numbers involved--both in terms of total submissions, and variety of areas--make it extremely unlikely for you accepting a paper you reviewed to have any effect on the chances of your own paper getting accepted.
– twoblackboxes
yesterday