Sunday, October 18, 2020

Running 360 Esports Reviews Using APEX - Part 1

Life's been weird since COVID reached the US in March. New York being one of the hardest hit first, saw a strong reaction from state government, and my small gaming business along with movie theaters, bowling alleys, and other entertainment venues were among one of the first shut down as non-essential. We've been unable to open since, and even when we are cleared may not open right away until the picture's looking a bit better.

A few months after the business closing, I was let go of my day job of 8 years as the airline industry had tanked. That series of events at the time felt brutal personally, but what I've learned now looking back is those are just bumps in the road. Myself and my family remaining healthy through the pandemic, when so many are not as lucky, is what's really the most important thing. I'm very grateful for that every day.

If 2020 is the bear from The Revenant, we are all Leonardo Dicaprio

One thing that has survived 2020 is the esports program we started in late 2016 at the shop. The League of Legends team kept at it practicing weekly and entering into tournaments, and we're just winding our season down now with worlds coming to an end. Every year we've changed things up, and we try to take the off-season as a time to review and understand what we learned, and make plans for the upcoming year.

I've conducted 360 reviews once before at the gaming center, and thought it may be good to apply to the esports program as a way of evaluating the players and coaches. For those that do not know a 360 review is when you evaluate yourself, your coworkers, your subordinates, and your supervisors. This gives a rounded feedback and helps to show areas each person may be overvaluing or undervaluing themselves. It also allows feedback to flow both ways, in this case the coach being able to evaluate the players, who in turn get a chance to evaluate the coach. APEX felt like the right tool for gathering data from the players and providing dashboards for both the players and coaches to explore that data. Here are the steps I took:

Step 1 - The Questions

I have a lot of time on my hands now so I spent some of that thinking about the game, the players and coaches we have, and what the core competencies are. League of Legends is such a complex game, partly what makes it so much fun to watch and play, like a giant chess game if only the chess pieces could be different every game. I ultimately settled on the following criteria for player evaluations:

  1. Communication - Both verbally and pings, and both in lane and during team fights.
  2. Team Fighting - It is like the game within the game, and requires deep understanding.
  3. Champ Proficiency - To do well in this game you need to have at least a few champs.
  4. Laning - The early-mid game, most players are able to master this first.
  5. Vision - What you can see, and what the enemy cannot, is vital to the game.
For coaching, we mainly had one coach for 2020, a player that reached Master rank for the first time this year. He wore many hats and I'm hoping to break up his responsibilities next year to help him focus on the areas he thrives at, and add more coaches to improve on other areas. I landed on the below criteria for evaluating the coach:

  1. Micro
  2. Macro/strategy
  3. Teamfight Analysis
  4. Vision
  5. Itemization/Runes
  6. Picks & Bans
  7. Video Review

Step 2 - Developing the Survey

I had admittedly not touched APEX in some months - after 13 years at it I didn't mind a little time away. But APEX seemed liked a good tool to develop the surveys so I took a crack at it tonight. I went with a flat table structure to save some time - one wide table to save all the feedback. My amazing web host MaxApex is always up to date with the latest version, and version 20 felt GREAT - no bugs or hiccups, and some nice new features like friendly URLs. Most of the questions I used the star rating item with a maximum of 10 stars.


The whole survey took me only two hours to code up, and I used a hidden page item to send a unique link to each of the players that would pull up a personally written thank you for them, and also help track who had submitted the survey. APEX is easy! It's like riding a bike it comes right back to you! After a few minutes of testing I fired off the links to the players confident that everything was working great.


So maybe I could have spent a little more time testing. Some custom columns I had set on the page for formatting were causing strange behaviors in various browsers.

I have half of the surveys submitted so far and am starting now on the player & coach facing dashboards, which I'll detail in Part 2 of this blog!

No comments:

Post a Comment