Monday, December 22, 2014

CFP Selection Committee Protocol Defines Nonsense

sELECTION COMMITTEE PROTOCOL


How To Select the Four Best Teams to Compete for the College Football National Championship
(Adopted unanimously by the BCS Group - June 20, 2012)

Ranking football teams is an art, not a science. There is nothing about ranking teams that requires it be done through voting. Football is popular in some measure because the outcome of a game between reasonably matched teams is so often decided by emotional commitment, momentum, injuries and the "unexpected bounce of the ball." So what? Still does not require voting. In any ranking system, perfection or consensus (are empty terms) is not possible and the physical impact of the game on student athletes prevents elaborate playoff systems of multiple games except that an FBS team could play as many as 16 games and lower divisions have playoff systems of multiple games. For purposes of any four team playoff, the process will inevitably need to select the four best teams from among several with legitimate claims to participate. Nonsense. For the purposes of any playoff system, the process should advance the required number of teams whose seasons have greater value under the rules in play. Unless, of course, there are no rules because the BCS Group prefers a beauty contest to an objectively determined competition.

Proposed Selection Process:

Establish a committee that will be instructed to place an emphasis on winning conference championships, strength of schedule and head-to-head competition when comparing teams with similar records and pedigree (treat final determination like a tie-breaker; apply specific guidelines). An objective system could do not this and maintain consistency?
The criteria to be provided to the selection committee must be aligned with the ideals of the commissioners, Presidents, athletic directors and coaches to honor regular season success while at the same time providing enough flexibility to invent new justifications for desired outcomes and discretion to select a non-champion or independent under circumstances where that particular non-champion or independent is unequivocally one of the four best teams in the country.
When circumstances at the margins indicate that teams are comparable, then the following criteria must be considered:
  • Championships won
  • Strength of schedule
  • Head-to-head competition (if it occurred)
  • Comparative outcomes of common opponents (without incenting margin of victory) Except that Florida State was repeatedly punished for its lack of "game control" which clearly valued margin of victory.
We believe that a committee of experts properly instructed (based on beliefs that the regular season is unique and must be preserved; and that championships won on the field and strength of schedule are important values that must be incorporated into the selection process) has very strong support throughout the college football community. Experts at what? The "unique" regular season cannot be preserved by an objective ranking system? An objective ranking system cannot consider championships won on the field and strength of schedule? The college football community could not support the use of an objective ranking system?
Under the current construct, polls (although well-intended) have not expressed these values; particularly at the margins where teams that have won head-to-head competition and championships are sometimes ranked behind non-champions and teams that have lost in head-to-head competition. So one beauty contest method will do a better job of considering objective results like head-to-head competition and conference championships than another beauty contest method? Nuanced mathematical formulas ignore some teams who "deserve" to be selected. This is quite possibly the most nonsensical statement ever. How do math systems ignore any teams? The point system promoted by this blog ranks all FBS teams based on the results of their games. The fact that only four teams can place in the top four does not mean the remaining teams were ignored. How many teams deserve to place in the top four anyway?  And what does "deserve" have to do with the inevitable need to select the four best teams? "Best" and "deserve" are not synonyms.  
As we expand from two teams to four teams we want to establish a human selection committee that will accomplish none of the following goals: (1) will be provided a clear set of guidelines; (2) will be expected to take the facts of each case and specifically apply the guidelines; and (3) will be led by a Chairperson who will be expected to explain publicly the committee's decisions.
Some of the guidelines and protocols expected to be established to guide the committee would include, but not be limited to, the following:
  • While it is understood that committee members will take into consideration all kinds of data including polls, committee members will be required to discredit polls wherein initial rankings are established before competition has occurred; How do you prevent committee members from considering any information they are required to discredit?
  • Any polls that are taken into consideration by the selection committee must be completely open and transparent to the public;
  • Strength of schedule, head-to-head competition and championships won must be specifically applied as tie-breakers between teams that look similar; How do we know what circumstances favor each of those tiebreakers? For example, when does strength of schedule trump head-to-head competition and vice versa?
  • Committee members associated with any team under consideration during the selection process will be required to recuse themselves from any deliberations associated with that team; How does this prevent a committee member from undermining the teams that are a threat to their associated school's playoff chances?
We would expect this same set of principles to be applied, particularly at the margins (teams 10-11-12).

College Football Playoff Selection Committee Protocol

  1. Mission. The committee's task will be to select the best teams, rank the teams for inclusion in the playoff and selected other bowl games and, then assign the teams to sites.
  2. Principles. The committee will select the teams using a process that distinguishes among otherwise comparable teams by considering:
    • Conference championships won,
    • Strength of schedule,
    • Head-to-head competition,
    • Comparative outcomes of common opponents (without incenting margin of victory), and,
    • Other relevant factors such as key injuries that may have affected a team's performance during the season or likely will affect its postseason performance. So teams may be awarded mulligans for games determined to be lost due to injury or be denied advancement due to the absence of key players and this makes sense how? After all, if an injury occurs after selections are made perhaps during a semifinal win, there will be no substitutions. Besides that, injuries have no bearing on the standings of most every competition including conference play in college football. 
  1. Voting Process. The voting process will include a series of ballots through which the committee members first will select a pool of teams to be considered, then will rank those teams. Individual ballots will be compiled into a composite ranking. Each committee member will independently evaluate an immense amount of information during the process. This evaluation will lead to individual qualitative and quantitative opinions that will inform each member's votes.
  2. Number of Teams to Be Ranked. The committee will rank 25 teams. If no champion of a non-contract conference is among that group, then the committee will conduct an additional process to identify the top-ranked champion of those conference champions.
  3. Meeting Schedule. The committee will meet in person weekly beginning at mid-season to produce interim rankings before selection weekend.The dates in the fall of 2014 will be as follows:
    • Monday and Tuesday, October 27-28
    • Monday and Tuesday, November 3-4
    • Monday and Tuesday, November 10-11
    • Monday and Tuesday, November 17-18
    • Monday and Tuesday, November 24-25
    • Monday and Tuesday, December 1-2
    • Friday-Sunday, December 5-7
  4. Point Persons for Gathering Information. The committee has assigned two members to be the "point persons" to gather material about the teams in each conference and the independent teams. The process will assure that each team is fully reviewed and that no information is overlooked. The point persons will ensure that (1) the committee has complete, detailed information about each team, and (2) the conferences and independent institutions have an effective and efficient channel for providing facts to the committee. The committee wishes to be clear about the role of the point persons. They are not and will not be advocates for teams in any conference or for any independent institution. They will not speak on behalf of any conference or institution during the committee's deliberations or represent any conference's or independent institution's interests during those deliberations. Their function is to gather information and ensure that it is available to the committee. Their role as a liaison to a particular conference or independent institution is purely for the purpose of objective fact-gathering. The point persons will communicate with conference staff members on three teleconferences during the regular season. The point persons will accept objective factual information from a conference and may actively seek such information from a conference during a teleconference. They may take subjective viewpoints provided by a conference comparing the performance of one conference institution to another. They will ensure that all information provided by a conference is presented to the committee for its consideration. Outside of the three teleconferences, there will be no contact between the point persons and any conference staff member, or vice-versa; all information will be relayed through the CFP staff. Following are the point persons for 2014-15:
    • American - Mike Gould and Pat Haden
    • Atlantic Coast - Tom Jernstedt and Steve Wieberg
    • Big Ten - Pat Haden and Condoleezza Rice
    • Big 12 - Barry Alvarez and Mike Tranghese
    • Conference-USA - Tom Osborne and Condoleezza Rice
    • Mid-American - Barry Alvarez and Tyrone Willingham
    • Mountain West - Oliver Luck and Mike Tranghese
    • Pac-12 - Mike Gould and Tom Osborne
    • Southeastern - Oliver Luck and Steve Wieberg
    • Sun Belt - Dan Radakovich and Tyrone Willingham
    • Independents - Dan Radakovich and Steve Wieberg
  5. Metrics. There will not be one single metric to assist the committee. Rather, the committee will consider a wide variety of data and information. Of course not. One set of rules assisted by no committee makes too much sense. College football requires a panel of experts to produce an arbitrary outcome due to inconsistent reasons.
  6. Participants. There shall be no limit on the number of teams that may participate from one conference in the playoff semifinals and the associated bowl games.
  7. Pairings for Semifinals.
    1. The team ranked No. 1 by the selection committee will play team No. 4 in the semifinals. Team No. 2 will meet team No. 3.
    2. When assigning teams to sites, the committee will place the top two seeds at the most advantageous sites, weighing criteria such as convenience of travel for its fans, home-crowd advantage or disadvantage and general familiarity with the host city and its stadium. Preference will go to the No. 1 seed.
  8. Pairings for Selected Other Bowl Games.
    1. All displaced conference champions and the highest ranked champion from a non-contract conference, as ranked by the committee, will participate in selected other bowl games and will be assigned to those games by the committee. If berths in the selected other bowl games remain available after those teams have been identified, the highest ranked other teams, as ranked by the committee, will fill those berths in rank order.'(Note: A "displaced conference champion" is a champion of a contract conference that does not qualify for the playoff in a year when its contract bowl hosts a semifinal game.)
    2. The committee shall create the best matchups in these bowl games in light of the following considerations. None of these considerations shall affect the ranking of teams. Also, none of these considerations will be controlling in determining the assignment of teams to available bowl games.
      • The committee will use geography as a consideration in the pairing of teams and assigning them to available bowl games.
      • The committee will attempt to avoid regular-season rematches when assigning teams to bowls.
      • To benefit fans and student-athletes, the committee will attempt to avoid assigning a team, or conference, or the highest-ranked champion of a non-contract conference, to the same bowl game repeatedly.
      • The committee will consider regular-season head-to-head results when assigning teams to bowls.
      • The committee will consider conference championships when assigning teams to bowls.
  9. Selection Sequence.
    • Selection committee will rank teams 1-25.
    • Selection committee will place teams in the playoff semifinals bowls.
    • Contract bowls will fill their berths in accordance with their contracts.
    • Selection committee will assign teams to remainder of the Cotton, Fiesta and Peach Bowl berths.
  10. Recusal Policy. If a committee member or an immediate family member, e.g., spouse, sibling or child, (a) is compensated by a school, (b) provides professional services for a school, or (c) is on the coaching staff or administrative staff at a school or is a football student-athlete at a school, that member will be recused. Such compensation shall include not only direct employment, but also current paid consulting arrangements, deferred compensation (e.g., contract payments continuing after employment has ended) or other benefits.The committee will have the option to add other recusals if special circumstances arise.A recused member shall not participate in any votes involving the team from which the individual is recused.A recused member is permitted to answer only factual questions about the institution from which the member is recused, but shall not be present during any deliberations regarding that team's selection or seeding.Recused members shall not participate in discussions regarding the placement of the reduced team into a bowl game.
      Following are the recusals for 2014-15:
    • Air Force - Mike Gould
    • Arkansas - Jeff Long
    • Clemson - Dan Radakovich
    • Mississippi - Archie Manning
    • Nebraska - Tom Osborne
    • Southern California - Pat Haden
    • Stanford - Condoleezza Rice
    • West Virginia - Oliver Luck
    • Wisconsin - Barry Alvarez
  11. Terms. Generally, the members shall serve three-year terms. Until the rotation has been achieved, certain terms may be shorter or longer. Terms shall be staggered to allow for an eventual rotation of members. Members will not be eligible for re-appointment
    Terms Expire February 2016
    Gould, Mike
    Haden, Pat
    Osborne, Tom
    Tranghese, Mike
    Terms Expire February 2017
    Alvarez, Barry
    Luck, Oliver
    Manning, Archie
    Rice, Condoleezza
    Terms Expire February 2018
    Jernstedt, Tom
    Long, Jeff
    Radakovich, Dan
    Wieberg, Steve
    Willingham, Tyrone
  12. Committee Chair. The Management Committee selected the first chair of the committee. The selection committee members will select future chairs.

College Football Playoff Selection Committee Voting Process

  1. Each committee member will create a list of the 25 teams he or she believes to be the best in the country, in no particular order. Teams listed by three or more members will remain under consideration.
  2. Each member will list the best six teams, in no particular order. The six teams receiving the most votes will comprise the pool for the first ranking step.
  3. In the first ranking step, each member will rank those six teams, one through six, with one being the best. The three teams receiving the fewest points will become the top three seeds. The three teams that were not seeded will be held over for the next ranking step.
  4. Each member will list the six best remaining teams, in no particular order. The three teams receiving the most votes will be added to the three teams held over to comprise the next ranking step.
  5. Steps No. 3 and 4 will be repeated until 25 teams have been seeded. There will be seven rounds of voting; each round will consist of a "listing step" and a "ranking step." Except for an excuse to have a weekly show dedicated to announcing the latest rankings, every ranking but the final one was completely meaningless as no one had any real idea where their team stood in relation to other teams regardless of their assigned ranking. For example, TCU was ranked third entering the final weekend but they like the rest of us had no idea what kind of "lead" they had over Florida State, Baylor, and Ohio State and how vulnerable that lead was based on who each of the teams played in their final game. Under the point system promoted by this blog, its certainly possible for the third place team to have less control over its destiny than the fourth, fifth, and sixth place teams based on the value of their remaining games. However, this would be quite apparent to everyone if competing under those rules. We have no idea where TCU actually stood entering the final weekend. Did Ohio State have to win 59-0 to pass TCU? Would 35-0 be enough? Or 2-0? After all, margin of victory is supposed to be ignored. Why did Baylor pass TCU? Baylor owned the head-to-head argument before the final weekend. Did the completion of the season move their overall strength of schedule close enough to TCU's to allow the committee to emphasize head-to-head? If the difference in strength of schedule between Minnesota and Buffalo is small enough to favor head-to-head, how great must the difference be to favor strength of schedule? The committee format fails to answer all of these questions.  
Notes:
  1. Any "recused" member can participate in Step No. 1, but cannot list the team for which he or she is recused. "Recused" teams (i.e., teams for whom a member has been recused) receiving at least three votes in Step No. 1 will remain under consideration.
  2. A recused member can participate in Step No. 2, but cannot list the recused team. If a recused team is within one vote of advancing to the pool, that team will be pooled with the team (or teams) receiving the fewest votes. A "tie-breaker" ranking vote will be conducted among those teams to identify the team or teams that would be added to the pool.
  3. A recused member cannot participate in Step No. 3 if the recused team is in the pool.
  4. Between each step, the committee members will conduct a thorough evaluation of the teams before conducting the vote.
  5. After each round is completed, any group of three or more teams can be reconsidered if more than three members vote to do so. Step No. 3 would be repeated to determine if adjustments should be made.
  6. After the first nine teams are seeded, the number of teams listed in Step No. 2 will be increased to eight, and the number of teams seeded and held in Steps No. 3 and 4 will be increased to four.
  7. At any time in the process, the number of teams to be included in a pool may be increased or decreased with approval of more than eight members of the committee.
  8. After any round of voting, a team or teams may be added to the initial pool by an affirmative vote of three or more committee members.
  9. All votes will be by secret ballot. The CFP Group does not value transparency? Of course, there is the "fear" that committee members might be harassed by fans of teams denied a playoff berth. If so, that is all the more reason to play by actual rules versus pretending the committee format has any integrity when its members must recuse themselves under some circumstances and their ballots are kept secret and the final result does nothing to explain what beats what at any moment in time.

No comments: