As far as consequences, we're told that referees get reviewed, but what outcomes do we see? As far as I know, we don't see referees get demoted to the G-League, and we don't see them get suspended for poor performance. Maybe they get shifted to different crews? Or maybe they're not allowed to work the playoffs? I don't know. But things like this are an obvious injustice that can have a ripple effect.
It's not the most widely publicised thing, because why would it be, it's not exactly hidden knowledge if you want to look for it.
But it sort of is hidden knowledge. According to the excerpts you posted, there's a system in place for referee evaluation, but the public isn't allowed to see inside that system. So we have little idea of what actually is happening. I understand that there are pitfalls to divulging all of that information, but since the NBA is a very public enterprise, and we're told virtually everything that happens with players and coaches—we hear about suspensions (the reason and the length), we hear about fines (the reason and the amount), we hear about scandals—why not tell us more about the refs?
Yeah, it's a good point, and while it's clear that, from the league's perspective, the problem with sharing that information outweighs the benefits, it is worth keeping in mind that we can probably tease out more than we might think working backwards with the access to the information that we do have.
Consider how much heavy lifting 'virtually' is doing in your post. We hear
some things about suspensions: for example, that players are suspended for violating the NBA's drug policy, but, at least in most cases, we don't know the specific substance. While this is a big hole if our goal is 'full transparency from the league', it largely doesn't matter because most of the time the specific substance is incidental to the on-the-court product.)
I bring that up regarding referees because while we may not have a public-facing CBA to govern the exact scenario when a referee is put on a PIP, in some ways that isn't very important, because of what we can observe and subsequently infer about how things work based on what we do know, which is quite a bit. To wit
- We know that the NBA evaluates referee performance after each game with a game observation report, and we know that these observations are fed back to the referees regularly
- We know that the NBA's officiating staff holds monthly meetings with members of each team's coaching staff around the league to discuss refereeing particulars - safe to assume that this feedback is inevitably also being fed back to the referees
- We know that referees are constantly monitored for call accuracy, and we also know that they receive an even more comprehensive end-of-season review, which takes into account coaching staff input, soft skills, and the aforementioned call accuracy - this is how referees get 'put on notice' (see quote below)
- We know the Players Association can can submit monthly reports on the conduct of the referees to the league, and can name names in those reports
- We also know (same link) that the Players Association and the league meet quarterly to discuss the relationship between the players and the referees
- We also know that, of the pool of referees, the NBA picks 36 to call the playoffs and 12 to call the Finals - choices that are directly tied to the in-season feedback, call accuracy, & soft skills being measured across the season
- We also know being selected for the post-season has a significant impact on how much money referees wind up making at the end of the season, since they are paid per-game
- We also know that Tony Brothers's favourite band is Earth Wind and Fire (page 27) and that Scott Foster's most memorable assignment is Game 7 of the 2010 NBA finals (not joking, page 43)
So, because we have an idea of the information floor that the NBA has regarding each referee, the ways that referees are given feedback throughout the season, and the incentives for them to get things right, the points of emphasis we can also approximate which NBA referees are 'doing the best', according to the NBA's metrics, because:
We can see
how many games each referee works season on season, which pulls from
https://official.nba.com/referee-assignments/We can also evaluate how accurate each NBA referee is during their last two minutes, based on public information, here's a pair of good examples that I've found with a quick search:
https://www.jordanvani.com/post/nba-referee-performancehttps://medium.com/sports-x-analytics/using-data-science-to-breakdown-the-nba-l2-minute-report-8e9c4579243bAnd so on.
Re: put on notice.
. Officials who aren’t meeting the league’s accuracy and consistency standards will be put on notice and given one year to improve in their areas of weakness, per Monty McCutchen, senior vice president of referee development and training. Many are able to; those who are not are dismissed, an event McCutchen reports doesn’t happen every season necessarily, but is still a periodical occurrence.
Sorry for the novella, I did try to keep this as short as reasonably possible. It's all to say that there is a lot we
can find and infer about the process, even if it isn't 100% accessible or cleanly laid out in front of us.