Criteria In Detail:
Popularity: Charted singles and albums (with some consideration as to the era in which they took place to establish context - albums were not big in the 50's and early 60's for rock artists and most put no effort into them, black rock artists mostly did not pay full attention to them until the early 70's; certain styles received little radio airplay which negatively affect single success, such as metal and early rap; pre-1955 rock also was made for and appealed to a racially segregated market, so the R&B Charts are more accurate as to what was popular within the rock community at the time, but that has to be balanced to reflect that post-1955 rock on the pop charts was not only competing with other rock, but also all of pop music as a whole).
It also includes sales figures and headlining appearances and so forth but these are considered secondarily. However, as with chart success, era and style specific context is factored in. In terms of concerts not all artistic styles are created equal. A vocal harmony group, no matter how popular, won't fill stadiums because their music doesn't translate well to the venue. Rap is harder to duplicate live.
It is based on roughly a 80/20 split for US/UK. In cases where an artist undeniably has a very high level of worldwide popularity, that can be used as a tiebreaker.
Influence: Primary Influence, which is worth more, is for true innovation, the starting point of a new style or method of singing, songwriting, playing, performance, production, stage shows, arranging, etc., which consequently goes on to become widespread at some point in the future. The origins of the innovation are what matters most here, not necessarily who others credit with exposing them to it and so it is necessary to trace back all things to their origins as best as possible. Secondary Influence is for those who did NOT innovate, but whose application in their own work of an earlier innovation served to popularize it to a far greater extent. Because this is not the creative aspect of it, secondary influence, which is far more common to see and can be divided up between multiple artists over the years, is not worth as much.
Musical Impact: The reaction within the music industry as a whole to an artist's work. This differs from influence because not all artists are even able to be influenced by things they admire. Different styles, different abilities, different audiences and different musical goals and a sense of creative independence means that artists many times would prefer to follow their own path, but their appreciation for another artist's achievements elevates the stature of that artist in the industry. This attempts to accurately determine what music was turning the most heads within their own community at the time, what was seen as raising the creative bar and set new benchmarks to strive to surpass. It is the peer recognition factor of the criteria.
Cultural Impact: The myriad of ways in which artists affect the mass popular culture, as over the years music has altered virtually everything around us in one way or another at times - racially, sexually, in language, fashion and slang. It's changed the dominant marketplace for music as a whole from adults to teenagers, it's changed the way the music industry itself operated, created untold controversy and started national and international dialogue on a wide variety of topics that have frequently changed the viewpoints of generations to follow. It is not always intentional, but when it happens the societal parameters often shift in some ways. Basically, how far an artist's career penetrated into society. This is the hardest to get, simply because it is difficult to affect such change, but it something that often separates the elite from the merely great and is ultimately a major part of the lasting legacy of rock music as a whole.
Essentially the goal in this criteria was to, as objectively as possible and by removing musical taste entirely, determine which artists made the most impact in their field. It doesn't require an artist to take on a specific role that is optional to do in order to BE an artist. In other words, there's no separate category for things such as writing, playing a specific instrument, producing, or performing live. Yet those all can and do factor in more objectively in the existing criteria. An innovative guitarist gets influence points for introducing new techniques, an artist's songwriting sees his or her Musical Impact level raised as a result, an artist taking the reins of production changes the business models within rock and therefore has Cultural Impact within the industry.