MCFC Analytics blogposts Summary #9


In the past week, I found the following posts written using the #MCFCAnalytics data

  1. Some interesting stuff by @PedroAfonso85 building on some previous work  to breakdown the importance of ball possession and some discussion about the oft discussed yet hard to quantify, momentum.
  2. @MarkTaylor0 analyzed Blocked shots to find if blocking shots is a talent.
  3. @hpstats visualized points difference “with/without” a player in  the starting lineup. Also from the same blog is profiling players based on their shooting
  4. @SportsViz has a video with examples of 3D-visualization of passes using the data from Bolton vs. City game

Previous Summaries

Summary #8

Summary #7

Summary #6

Summary #5

Summary #4

Summary #3

Summary #2

Summary #1

MCFC Analytics blogposts – Summary #8


Here is the list of interesting posts I found in the past week

  1. An interesting post on home advantage and how it manifests itself into football stats by @FbPerspectives. The post also has a link to a detailed paper from 2009 on home advantage.
  2. Guardian Data blog has an interactive visualization of the Bolton – City game by @jburnmurdoch. The viz has a pitch map + a radial diagram that captures the pass direction and length.
  3. The man in the yellow shirt – an analysis of the refs by @PedroAfonso85
  4. An interactive visualization of the direction of a player’s passes by @alekseynp . Some of the outliers are very interesting.
  5. Momentum in Bolton – City game. by @SoccerStatistic . This is a different approach from the previous attempts on visualizing momentum using this data set.

I did not publish anything last week, although I did start writing. Hopefully I will publish something later this week.

Previous Summaries

Summary #7

Summary #6

Summary #5

Summary #4

Summary #3

Summary #2

Summary #1

If I missed any, please post them in the comments section or tweet them to me!

MCFC Analytics – blogposts summary #7


I did not see too many new posts in the past week. I didn’t publish any as I was busy with a different project.

  1. An interactive viz of Bolton – Manchester City  match data by @JBurnMurdoch on @GuardianData blog
  2. @HPStats attempts at defining metrics to be able to cluster players based on their style. Here is a good first step on Passing
  3. @shots_on_target made a summary of vital stats regarding goals, shooting accuracy, penalties etc..
  4. Scouting report on Tim Howard by @footballfactman
  5. An interactive visualization of the full dataset by @PhilyB1976 I posted this in one of the first few summary posts but there is additional information on the site. worth revisiting!
  6. An

Previous Summaries

Summary #6

Summary #5

Summary #4

Summary #3

Summary #2

Summary #1

If I missed any, please post them in the comments section or tweet them to me!

MCFC Analytics-Summary of blogposts #6


This week I saw a few more new bloggers getting into the act with the data.

First up, there was this article by @RWhittall of TheScore.com where Richard talked about “soccer data abuse by some bloggers using the MCFC data”. The gist of the article is that some of the bloggers are extrapolating too much with their conclusions based on one year’s worth of data from one league. The other point made in the article is that the output of the majority of  the work in soccer analytics isn’t groundbreaking and it is just adding a data context to what we already knew.

While I see where Richard is coming from, I don’t quite agree either with his assessment of the state of soccer analytics or the “data abuse” bit.

Unquestionably, we haven’t even scratched the surface of what we can do with data in soccer. The majority of the research work in the soccer analytics is carried out in the private domain.  That is because soccer data is not a commodity like it is in other sports like Baseball. The MCFC & Opta project could be a significant step in the direction of making soccer data more accessible to a wider audience,  if it can get enough passionate people interested in the project. However, like in any type of writing in the public domain, there is the good and the not so good. One of the things we discussed with Gavin Fleig, Head of Performance Analysis at Manchester City, Simon Farrant, Marketing coordinator at Opta et al is to build a community that fosters communication, collaboration and open feedback among the members and the readers. This should help everyone get better in some time.

Without further ado, here are links to some interesting work I found in this past week.

@MarkTaylor0 has a comprehensive piece on the state of soccer analytics and where it stands vis-à-vis other sports like NFL and Baseball. – The case for data analysis in football. This is a must read.

Analytics posts

  1. @PedroAfonso85 has a couple posts using the advanced data set
  2. @ChrisJLilley continues with his positional analysis series with Strikers and Central attacking midfielders
  3. @FootballFactman ‘s piece talks about what to look for in goalkeepers of the premier league
  4. @shots_on_target talks about the correlation between points in fantasy football and attacking stats
  5. In my weekly opposition analysis series I analyzed at Sunderland using last season’s data.

Visualization posts

  1. Earlier today I saw Voetstat, a neat blog by @Voetstat_craig which has some visualizations of pass completion + heatmaps. There are multiple posts. I haven’t had a chance to read all of them yet.
  2. @TomBerthon has this visualization of how goals were scored in the Bolton – City game from last season

If I missed any links, post them in the comments section and tweet them with the hashtag #MCFCAnalytics. I will retweet them.

Previous Summaries

Summary #5

Summary #4

Summary #3

Summary #2

Summary #1

MCFC Analytics – Summary of blog posts #5


We had a great meeting this weekend to discuss how to move our community forward. We discussed some great ideas. As @MCFCGavinFleig pointed out on twitter, the next big announcements and steps forward will be public in late November/early December when the “CityAnalyticsCommunity” will be launched. Until then, keep blogging away with the data.

Here is a summary of the blog posts based on #MCFCAnalytics data.

Analytics posts

  1. @MarkTaylor0How passing sequences create chances – the title is self-explanatory. Great post
  2. @JDewittLong passing in the Premiership – John looks at the long passing and its correlation to finishing position in the league table. Interesting post. A question that came up when I read this post is, how is correlation to points or goals scored instead of position in the league table?
  3. @TheWestStandO digs deeper into Fernando Torres’ struggles in front of goal last season
  4. @ChrisJLilley defines metrics and rates the attacking midfielders, central midfielders and the defensive midfielders of last season.
  5. @We_R_PLComparison of Top scorers in EPL
  6. @Hpstats  – A better passing statistic this was posted in the comments of summary #4
  7. Fulham – opposition analysis by me

Visualization posts

  1. @AlexThamks – a neat viz of Assists, chances created & key passes per formation + the best 11 for each formation using Tableau Public
  2. @Tomberthon  – a visualization of the advanced data set and how to make sense out of it

Other

  1. @MarchiMax has a refined version #Rstats code for parsing the F-24 XML
  2. @DannyPage has implemented a Ruby on rails code for importing the F-24 XML

Past summaries

Summary #4

Summary #3

Summary #2

Summary #1

MCFC Analytics – Summary of blog posts #4


It has been about a month since the basic MCFC data set has been released and it is great to see lots of people churning out stuff using both the basic and advanced data sets.

Based on the tweets with #MCFCAnalytics tag, there are quite a few peoples’ projects are in progress. Good luck to all of you. Make sure you share your project/blog links with the hashtag.

Some people are looking for partners and contributors to the projects they are working on. If you are interested, please keep a tab on the #MCFCAnalytics tab and get in touch with folks directly.

Analysis posts

  1. @MarkTaylor0Analyzing the passes by comparing them to their expected pass completion rates using passes of James Milner in Bolton Vs. Manchester City from 2011-12 season.
  2. Mark also has post on how Man City and Bolton passed the ball
  3. @JdewittHow goals are scored in EPL
  4.  @ChrisJLilleyAnalyzing center-backs of the premier league
  5. @analysefooty (this blog!)Opposition analysis of Arsenal

Visualization posts

  1. @DanJHarrington – a very interesting visualizations of passes using Vector diagrams in Tableau Public
  2. @MarchiMax – a visualization of where the ball is a few seconds before a shot is taken
  3. @OngoalsscoredVisualization of the goalscorer’s body parts. Very neat!

If I missed any please post your links in the comments section.

Links to previous summaries

Summary #1

Summary #2

Summary #3

Feel free to tweet me or email me if you want to chat with me on something specific!

MCFC Analytics – Summary of blog posts # 3


Thanks for the amazing response to Summary of blog posts #1 & Summary of blog posts #2

I also want to thank people who have reached out to me via twitter with links to their blogs & posts.

Goalscorer ‘footedness’ by @DavidAHopkins measures the footedness or the foot favoured by Premier League goalscorers.

How do the more successful clubs keep the ball in EPL by @JDewitt talks about how the top teams in EPL keep possession. Also by John is Successful Passing and Winning

A sneak peek of a very interesting carto by @Kennethfield  Charlie Adam’s “passing wheel”

Football Philosophy – Long passes by @Poolq1984 explores the importance of long ball in football.

@We_R_PL has a nice post on how to use the MCFC dataset more efficiently. He also has spreadsheet which has the own goals calculated per team.

@footballfactman has a post on Darron Gibson using a mix of data from MCFC dataset, whoscored and statszone

The always excellent MarkTaylor0 has detailed post Analysing the quality of shots in Bolton – Manchester City game using the advanced dataset.

@ChrisJLilley has 3 posts on his blog using MCFC data

GK positional analysis

Premier league game changers Part I & Part II

@DanJHarrington has cranked up a lot of things using the advanced dataset

1.  an interactive tableau viz to see touches of each player in Bolton -City on the pitch.

2. Passing visualization using D3.js

3. Dan also has some interesting visualization work in progress. There is a cool video in the link showing ball movement.

Network passing diagrams by @DevinPleuler

Bolton – http://t.co/mcRQ0oHU

Man City – http://t.co/6mtGgJQS

Extracting data from XML

There have been some questions regarding this and some folks have come up with solutions

1. If you have MS Excel 2007 or a later version you can open the file in XML. The only issue with is that XML’s are nested and Excel converts this into a very flat format. So you will see multiple rows for the same events. For example: A successful pass has multiple rows indicating the direction, the x,y coordinates of where it is passed to. Read the data spec thoroughly to understand how the data is formatted in the XML. It will help understand the data much better.

2. Code for R users to extract the F-24 XML by @MarchiMax

3. Code snippets from @JBrisson to extract events from the F-24 XML

4. If you are into programming, most languages have XML parsers. A simple search will get you code snippets to start with.
If I missed any links, please let me know via Twitter or comment on the blog post. Always use #MCFCAnalytics tag in twitter so I can pick them up easily!

Visualizing momentum shifts in Bolton vs. Man City


This is an attempt to visualize the momentum shifts in Bolton vs. City with goals scored and substitutions using the #MCFC analytics advanced data tier – I.

I used possession as a proxy for momentum. The game is divided into 5 minute buckets. If a goal is scored in a bucket, the bucket will end at the minute of the goal scored.
E.g.: 0-4 is bucket #1. If a goal is scored in minute 7, then 5-6 is bucket #2. 7-11 is bucket #3 and so on.

Plots

Figure 1 – Overall cumulative possession difference vs. game time in minutes.

CumulativeAll

2. Figure 2 – Cumulative possession difference up until a goal is scored.
E.g.: Say 1-0 is scored in minute 27 and 2-0 is scored in minute 38. The cumulative possession difference is calculated from minute #1 through 27. After 1-0, cumulative possession difference is calculated from minute 28 onwards (the date of minute 1 through 27 is excluded).
This helps to see if there is any noticeable shift in the momentum of the game after a goal.

CumulativeMomentumShifts

Findings

  • Overall City has dominated possession. The cumulative possession delta was always negative (= in favor of City) in Figure 1.
  • When the cumulative possession difference was reset after each goal scored (Figure 2), we see that Bolton tried to take the initiative after City took the lead in Min 26. They really pushed hard after City scored the 0-2, pulling one back within 2 minutes of City’s 2nd goal.
  • Bolton continued to push for an equalizer until City scored the 1-3 right after the half-time.
  • Bolton enjoyed more possession as they searched for a goal and did a substitution at min 60 (an attacking midfielder for a holding midfielder) – it seems like the move paid off as they scored 2-3 in min 62.
  • Bolton continued to push for an equalizer. City subbed out Aguero for Tevez, both attacking players but Tevez is better at playing a deeper role and hold up the ball.
  • As the game progressed Bolton switched D.Pratley for Chris Eagles (probably a shift in attacking style) and City responded with a defensive move by subbing out Dzeko for Adam Johnson
  • Those two moves by City helped them restore control. Towards the end, City subbed out attacking midfielder David Silva for fullback Zabaleta, a defender to secure the result in the dying minutes.

This is a very quick and simple interpretation & visualization of the moment shifts. All feedback is welcome.

MCFC Analytics data – The story so far


I have been playing with #MCFCAnalytics data set for the past 4-5 days. I have been having a lot of fun with the data.

One of the key reasons is “ease of use”.

The data is provided in the very simple Comma Separated Values (CSV) format.  CSV is one of the simplest data formats where each column of data is separated by a comma. You may open this file in Notepad, excel or any text editor. I have worked a lot with data football or otherwise. I end up spending the majority of my time in getting the data into correct format. I was pleasantly surprised to find the MCFCAnalytics data in CSV format. I opened the file in excel, created a pivot table and I was on my way.

If you have ever used excel before, using this data set is very easy. Unzip and open the file in excel. In excel you can start playing with the data using a Pivot table . A pivot table helps you slice and dice the data the way you want.
For example :- if you want to see the # of goals conceded by Manchester City in each of it is 19 away games, you could do that with 3-4 clicks in the pivot table.

If you are comfortable with excel, for visualizations you may you use charts in excel or try Tableau Public. Tableau Public is free. It supports the CSV format. Tableau provides much slicker visualizations than excel charts but you might need a few days to get ramped up on it.

While the Lite data set doesn’t capture every event in every game, it is an exhaustive list of almost every stat about teams and players aggregated at a game level for all the 380 games of the 2011-12 EPL season. Playing with the Lite data set helps you get an idea of the metrics and KPIs available for analyzing performance. It leads you to more questions and in a way prepares you for working with a more extensive and complex data set.

For example :- I always wondered if there was a relation between final third passing and goals scored .I did some analysis and found out that there is a strong correlation between passing in the final third and the goals scored. Now I want to dig further and find out if there is a particular zone within the final third that has a stronger correlation to the goals scored. I need the (X,Y) data associated with each pass to figure it out.

That brings us to the most important aspect of data analysis. Before taking a deep-dive into the data, always ask yourself:
What is the question you want to answer using the data.

Without a question in mind you are bound to get lost or lose interest in the data very quickly. The question could be anything – from “Who took the most shots in EPL in 2012” to “is there a correlation between wins and shots taken” etc. In my example above if I never ventured to answer my first question, I could have never gotten to the second question.

I thank Gavin Fleig and Manchester City Football Club, Simon Farrant and Opta Sports Pro for starting this great initiative.

I have seen some interesting work produced by a number of people already.  I hope to see a lot more in the coming days and weeks.