Guidelines for TPC members

IEEE INFOCOM 2012

March 25 - March 30, 2012, Orlando, FL, USA

Questions? Please email TPC Chairs at infocom2012.chairs@gmail.com


Disclaimer: This document and the process described are subject to change without notice!


Summary of Action Items for TPC Members

  1. Accept or Decline the TPC Invitation (within 1 week of receipt).
  2. Plan to attend INFOCOM 2012 TPC Informational/Planning Meeting on April 13, 2011 - during INFOCOM 2011 (Highly Recommended).
  3. Select TPC topics of interest and update Conflicts of Interest by July 15, 2011 (Required)
  4. Claim papers by August 5, 11:59PM PDT.
  5. Expect to be notified of all papers assigned to you by August 22, 2011.
  6. Complete TPC Regular Reviews for papers by October 1, 2011 (Required)
  7. Lead/Participate in online discussion on your assigned papers (October 2-16, 2011) (Required)
  8. Write Lead TPC Discussion Summary/Review by October 17, 2011 (Required)
  9. Attend TPC Meeting (Highly Recommended) on November 12, 2011 in Columbia University, New York.

As an IEEE INFOCOM 2012 TPC member, your reviews and participation in the TPC are crucial in determining the ultimate quality of the conference. Here are some guidelines to help clarify the TPC work. A simple way to think about the TPC duties is to think reciprocally about what you expect as an author of a paper from a peer in the community: a good, substantive review, a decision that is well-founded on the consensus of the reviews and good feedback. This is what we expect from TPC members. The element of randomness in the process cannot be eliminated, but we want to minimize it while biasing it towards merit and providing good feedback to authors.

Table of Contents

Updating your topics of interest and conflicts of interest information

You are requested to update your topics of interest for INFOCOM 2012 and your conflicts of interest information on EDAS after accepting the invitation to serve on the TPC by following the instructions below. You can update your topics of interest by logging into http://edas.info/ using your login email address and your EDAS password. Then click on "My TPCs" tab. You will see a list of conferences in which you serve as a TPC member. In the row for "INFOCOM 2012", please click on the cell in the "Interests (edit)" column. The link is usually set as "undefined", by default. In the subsequent screen, you will see that you are listed as "neutral" to all the topics for the conference. Please select at least eight (8) topics and click on the corresponding menu buttons in the "of interest" column. Similarly, please select as many topics which are not "of interest" to you. Please be sure to click on "Change topics of interest" button at the bottom of the page to update your topics of interest. In the list of topics for INFOCOM 2012, please note that the suffix SIM refers to both Simulation and Experimental work; MOD refers to Analytical modeling, Performance evaluation and Theory. It is critical that you update your topics of interest before the review assignment, in order to make sure that you have the best chance to receive papers which fall in your topics of interest.

You can update your conflicts of interest (COI) information by logging into http://edas.info/ using your login email address and your EDAS password. Then click on "My Profile" tab. On the first line, please click on the link listed as "conflicts of interest". In the subsequent screen, you will see a list of individuals with whom you have identified Conflicts-of-Interest. Please note that in EDAS, "Your initial list of conflicts-of-interest consists of individuals having the same email domain, the same name or those that have co-authored EDAS-registered papers with you. You can provide either the name of the organization, the name of an individual, or an email domain, or several of these." Please be sure to identify all individuals with whom you have conflicts of interest, paying particular attention to potential INFOCOM 2012 authors and TPC members. We greatly appreciate your efforts in updating this information in EDAS so that we may avoid unnecessary changes to review assignments later, a time-consuming process.

Please read the INFOCOM 2012 Definition of Conflict of Interest for determining the set of individuals you need to list on EDAS provided below. People/institutions that you are in "conflict of interest" consist of the following:

Claiming papers

You can claim (request) the papers that you would like to review for INFOCOM 2012 by logging into EDAS (http://edas.info) using your login email address and your EDAS password. Then click on "My TPCs" tab. You will see a list of conferences in which you serve as a TPC member. In the row for "INFOCOM 2012", please click on the cell in the "Requested (claim)" column. In the subsequent screen, you will see a list of papers marked as one of the following: Want to review, Can review, Review if needed and Cannot review. Please select at least 75 papers and click on the corresponding menu buttons in the "Want to review," "Can review" and "Review if needed" columns. Similarly, please select as many papers which you feel you "Cannot review." Please be sure to click on "Change" button at the bottom of the page to update your list of claimed (requested) papers for INFOCOM 2012. Please be sure to list at least 75 papers in the Want to review, Can review and Review if needed columns to provide us with enough flexibility to assign three independent reviewers to each paper.

Frequently asked questions

         I am not able to view the list of abstracts to claim from? - Detailed Instructions

Please log into EDAS (http://edas.info) using your login email address and your EDAS password. If you have forgotten your EDAS password, you will need to follow instructions at http://edas.info to request the system to email you your password. If you have already logged in to EDAS, you can Claim Papers by clicking on the "My TPCs" tab at the top, then going to the row marked "INFOCOM 2012" and clicking on the number (usually 0) in the corresponding cell in the column marked "Requested (claim)." If the list of papers (abstracts) that match your interest is large, you will receive a message such as: "There are *NUM* papers in the list for *your EDAS ID* - restrict topics." To modify (or select) topics "Of Interest" and restrict the list of papers that are shown to you, please follow the directions above. Please make sure that you mark as many topics as possible under "no interest" and click on "Change topics of interest." Then please try the process of Claiming papers again. According to the EDAS webpage on selecting topics: "Papers containing the topics labeled 'of interest' will be included, those containing topics 'not of interest' will be excluded even if they contain topics of interest. Papers labeled with the neutral topics will be included if they also contain topics that are of interest." Please be sure to list at least 75 papers in the Want to Review, Can Review and Review if needed columns (total) and at least 30 papers in the Want to Review column.

         I am not able to see the My TPCs tab - Detailed Instructions

Please click on the "My profile" tab and then click on the "My TPCs" tab.

         I have too many papers (> 100) claimed in the categories: Want to Review + Can Review + Review if needed. How do I reduce this number?

You need to move more papers to the other category: Cannot Review. This is done by clicking on the Claim link and then marking a different category (column) for the papers in the Can Review category, since these constitute the bulk of your selections typically. Another option for you is to modify your set of topics to mark more of the topics as "no interest" and try the claims process with fewer abstracts. Reminder: We would like you to claim at least 75 papers as the sum of the three categories: Want to Review, Can Review, and Review if needed. Please also claim at least 30 papers in the Want to Review category.

Regular Review vs. Lead TPC Review/Summary

Accepting and Delegating Reviews - HOWTO

If you are a TPC member with primary review responsibilities, you will receive by the deadline, your review assignments with upto 5 papers for which you are the TPC lead reviewer and upto 14-16 papers for which you are the regular reviewer. Please note that you will be assigned a regular review for each of the papers for which you are a TPC lead reviewer. So the actual number of papers that you will deal with is only around 14-16.

  1. How do I accept all of my review assignments?

When you log in to your EDAS page (http://edas.info) for INFOCOM 2012 (and click on My Reviews tab), you will be shown a list of all the papers you are handling for this conference. Please click on the link at the top of the table which states "You can also accept and decline reviews in a batch." You will be presented with a list of all your review assignments with the status Accepted column marked for each paper. If you have ensured that you do not have a conflict of interest with any of the authors for the papers in this list, please go ahead and click on the "Change" button at the bottom of the page.

  1. How do I accept my review assignments one by one?

When you log in to your EDAS page (http://edas.info) for INFOCOM 2012 (and click on My Reviews tab), you will be shown a list of all the papers you are handling for this conference.

To accept your TPC lead (meta) review assignments: In the second column (marked Type of review), please click on the link marked "tpc" and then click on the "Accept review" button. Please do this for each of the papers for which you are the TPC lead (meta) reviewer. Please note that you may not delegate your TPC lead (meta) reviews and you may not decline your TPC review assignments unless you have a conflict of interest with the authors.

To accept your regular review assignments: In the second column (marked Type of review), please click on the link marked "review" and then click on the "Accept review" button. Please do this for each of the papers for which you are the regular reviewer. Please note that you may not delegate your regular reviews to graduate students and you may only delegate a maximum of one-third (up to 5) of your regular reviews to qualified colleagues and you may not decline your regular review assignments unless you have a conflict of interest with the authors.

We request that you ACCEPT all of your review assignments within a week after receiving the notification emails and no later than Sep. 1, 2011.

  1. How do I decline my review assignments?

Please follow the instructions above to view the review assignments and instead of clicking on "Accept review" button, please click on the "Decline review" button. Please decline reviews ONLY when there is a conflict of interest with the authors of the paper.

  1. How do I delegate my regular review to a qualified colleague?

First, please read the INFOCOM Delegation guidelines below. From your INFOCOM 2012 TPC member page, please do the following:

    1. Click on the paper number
    2. Click on the pencil icon for editing your Review
    3. Click on Delegate the review
    4. Please enter the last name or EDAS ID of the reviewer. There may be many IDs for an individual and so please select the active one in consultation with the potential reviewer.
    5. You will then be able to edit the Review invitation email sent out by EDAS. Please add content at the top to let the potential reviewer know that the invitation is coming from you and not the INFOCOM 2012 TPC Co-chairs (default).
    6. You will receive a copy of the completed review by email when your delegate has submitted it.
    7. Delegation must be done within 2 weeks of papers assigned to the TPC member.
    8. The TPC member must also follow up with their delegates to finish their reviews, and oversee the quality. Please inform the delegate that they are also co-responsible with you for actively participating in the online discussion phase.

Participating in Online Discussions - HOWTO

To post an online discussion message for a paper that you are reviewing, please do the following (after the Regular Review deadline).

  1. Click on the Paper number (after clicking on My reviews tab upon EDAS login).
  2. You should be able to view the reviews and at the bottom of the page, there will be a Discussion section.
  3. Click on the Discuss bubble icon . You will see a text box in the subsequent screen. Please type in your comments about the paper. The discussion messages will be emailed to all the reviewers and Lead TPC member for that paper. You will also be able to view the discussion messages online.
  4. For guidelines on the online discussion phase, please see below.

As lead TPC member of a paper, you will need to take an active role in the discussion regarding that paper. You may ask reviewers to clarify their remarks, provide additional justification for their comments etc. Once you have completed the discussion phase, you (as Lead TPC member) will need to summarize the discussion in your Lead TPC Review/Summary.

High-Quality Review

High-quality reviews is by far the most important contribution of a TPC member.

So, if you want your reviews to matter in TPC discussions, please enter substantive, high-quality reviews.

Coherence between numerical scores and review content

INFOCOM 2012 will adopt a numerical score range of 1 to 5 for  reviews. The TPC lead assigned to a given paper will have to check if the numerical scores are well justified by the written reviews (and also catch short/low quality reviews), and follow up with reviewers using EDAS. Since every TPC member is a lead for some papers, kindly use this opportunity to check the coherence of the scores/reviews you give to papers.

For example, if there is a score of 5, there has to be clear enumeration of reasons why this paper deserves that rating. (Remember that the scores are logarithmic!) After you have reviewed all papers, and see the distribution of scores you have given, please see if there is any bias in your scoring and if it is indeed justified by the quality of the papers in your set.

Similarly, a rating of 2 or 1 may lead to a paper not making it to the TPC meeting: so it is the reviewer's responsibility to give more feedback for authors. Please note that irrespective of your scores, if a paper has reviews that are not strong, the scores may not matter.

Delegation guidelines

The following guidelines apply to delegation of reviews. In principle, we strongly discourage delegation unless there is a compelling need such as a very qualified reviewer for a given paper.

TPC On-line discussion phase: Guidelines

Role of Area TPC Chairs

For INFOCOM 2012, Area TPC Chairs will play a critical role in the review process after the online discussion phase is completed and the Lead TPC review/summary has been submitted. The role of the Area TPC Chairs is to categorize the paper as Accept, Discuss at TPC meeting or Reject. The Area TPC chairs may seek or provide additional reviews. The Area TPC chairs will also lead the discussion groups at the INFOCOM 2012 TPC meeting described below. Additional information about the role of the Area TPC Chairs can be found here.

TPC Meeting

The INFOCOM 2012 TPC Meeting is scheduled on November 12, 2011 in Columbia University, New York.

Details are on the INFOCOM 2012 website at TPC Meeting Info page. Please let us know if you will attend the meeting and the dinner by filling out the TPC meeting page on EDAS. All TPC members are invited to the TPC meeting. In order to put together a high-quality program, it is important to have you participate in this meeting. This is an invaluable experience to see how papers are actually accepted/rejected and which reviews matter and which reviews do not. It is a way to tap into the decision mindset of your peers in the community (especially for newer TPC members) so that you can write more competitive papers to INFOCOM and other conferences.

We expect to have a more focused set of papers at the TPC meeting with a higher acceptance probability (almost 40-50%) compared to the overall conference acceptance rate of 20%. This will hopefully bias the discussions to be positive and discuss papers which have good feedback from the TPC review, TPC discussion and Area TPC processes.

We expect to have groups discussing about 25--30 papers each, which will give an average of 15 min per paper (Note: these numbers are tentative at this stage and we will know better by October 2011). This is why the on-line TPC discussion should not "punt" the hard work to the TPC meeting and instead should give good feedback. Also, reviews having high ratings with short reviews may be discounted. Area TPC chairs may choose to bring in papers with lower numerical scores, but have substantive feedback (possibly through an extra review).

Registering for TPC Meeting - HOWTO

You may visit this page on EDAS. Alternatively, when you log in to your EDAS page (http://edas.info), please click on the "My TPCs" tab, you will then be shown a list of all the conferences for which you are a TPC member. In the row for "INFOCOM 2012", you will see the iconunder the column "TPC meeting". Please click on the icon. Then answer the following questions:

You may indicate in the Comments field additional information such as "I will be arriving late", "I will have to leave early" etc. You may indicate your dietary restrictions by updating your profile on EDAS. There is a link provided to your profile in your TPC meeting page. Please click on the "Submit" button when you are finished.

You may visit this page on EDAS. Alternatively, when you log in to your EDAS page (http://edas.info), please click on the "My TPCs" tab), you will then be shown a list of all the conferences for which you are a TPC member. In the row for "INFOCOM 2012", you will see the iconunder the column "TPC meeting". Please click on the icon and you will see your earlier response (both the radio buttons and the text box).


Please see the Main Page