Mental health in hip hop -- a data-driven preliminary peek

Some motivation

Suicide rates have risen sharply since the turn of the decade, and that increase is especially alarming for young people. It’s now the second most common way for people between the ages of 15 and 35 to die.

Luckily, this trend does seem to be getting attention in popular culture, perhaps most notably in hip hop. One obvious example was last year, when Logic released a track specifically aimed at suicide prevention, titled “1-800-273-8255”, the phone number for the National Suicide Prevention Lifeline. In the months following the release, the lifeline’s traffic rose enormously.

Logic - 1-800-273-8255 ft. Alessia Cara, Khalid

It makes sense that this was so powerful. Hip hop must have a lot of influence over the U.S. population, considering that it just became the most listened-to genre in the country. Additionally, many other prominent hip hop artists have recently taken to addressing mental health in their music.

I recently found myself captivated by this apparent uptick in mental health discussion in hip hop. It’s well documented that suicide spreads as a socially contagious phenomena, but what about rappers talking about suicide, and mental health in general?

Don’t sweat the technique

To help answer this question, the website Genius.com seemed particularly useful. Genius is not only a user-friendly database for song lyrics, but it also contains crowd-sourced annotations that explain the meaning behind the lyrics. This is useful from a computational perspective because it’s very difficult for a computer to detect symbolism and other literary devices rappers use to encode meaning. Take the highlighted Lupe Fiasco lyric and accompanying annotation, for example.

photo

I probably couldn’t find a way to get my laptop to detect that Lupe is convincing himself not to pull the trigger, but from the annotation, at least we can pull out the word “suicide”.

So wrote a Python script that pulls every annotation on every song for all of the listed hip hop musicians and hip hop groups on Wikipedia. Constructing this script sucked. It was an extreme challenge and is worthy of its own blog post, but I’ll probably never write one for that. I do, however, plan on doing the good human thing and making a Git repo out of it. We’ll see if that ever happens. The final collection of data contained about 600,000 annotations.

We’re not just making this up

From there, I flagged every annotation that talked about suicide, depression, loneliness, anxiety, or just had the phrase “mental health”. Being interested first in how rates of this discussion change over time, I counted up the number of these flagged annotations for each year, and then divided by the number of tracks for that year. This is what I came up with for the normalized rate of discussion (accompanied by the unnormalized rate and total number of tracks).

photo

photo

photo

Neat! Unlike a D&D game, this phenomenon is taking place in more than just our collective imaginations. But who is doing the most talking about mental health, and what shape does the distribution have? To answer this I counted up the flagged annotations for each artist, ranked them in descending order of how many such annotations they had, and plotted the number of annotations against their rank on a glog-scale to deal with the heavy tail.

photo

Now if you don’t want to go get the magnifying glass out of your fanny pack, which is probably all the way across the room, I can just tell you who’s in those icon-sized photos. Our leaders are Kid Cudi, Eminem, Death Grips, Kendrick, XXXTentacion, Aesop Rock, Kanye, Mac Miller, Tyler, and Tech N9ne.

Enter Mr. Solo Dolo

I also did plenty of staring at this distribution for individual years, and started wondering about how the diversity of artists talking about mental health (i.e. how much the distribution is dominated by a few artists versus how evenly spread out the distribution is) has changed over time, and how that correlates with the volume of the discussion. And how might a computational social scientist measure the diversity of a relative frequency distribution? I could think of one way: Shannon’s entropy. This of course only made sense for the years when the number of flagged annotations is reasonably high, so I chose to compute it for just the current millenium. The entropy (AKA diversity) is shown below, plotted alongside the normalized rate of discussion.

photo

My attention upon seeing this was drawn to the right-hand side of the figure, where entropy drops in 2008 and remains low from there on. The individual responsible for that initial drop is none other than Mr. Rager himself. 2008, 2009, and 2010 are all dominated by songs that were released either on Kid Cudi’s debut mixtape, “A Kid Named Cudi” or on his first studio album, “Man on the Moon: End of Day”. In the years that follow, various other artists take the lead, although he does take it back yet again when he drops his 2016 album, “Passion, Pain, and Demon Slayin’”. I can’t help but interpret that Cudi was a critical player in opening the floodgates to this now ubiquitous element of hip hop, which is somewhat satisfying knowing that his mission has always been to “help kids not feel alone and stop kids from committing suicide”. What this looks like to me is: Mr. Solo Dolo enters the scene, the hip hop community embraces the martian, and the rest is history.

If you’ve gotten this far, I applaud and thank you for bearing with my rambling and geeking out over all this stuff. That’s everything worth sharing so far, but there’s a ton more to explore here. I’ll be back soon with topic modeling, more information theory, and almost definitely wordshifts, so stay tuned. Or don’t. I don’t know what you want. ¯_(ツ)_/¯

PEACE