How “The Algorithm” Builds Toxic Mental Health Echo Chambers

CW: mental health, suicide, eating disorders

If you’re anything like me, you have somewhat of a love-hate relationship with “the algorithm”. On the one hand, I get shown content of the variety I’m partial to on the regular. I’m into houseplants and calligraphy, and the algorithm knows that, so I rather like coming across aesthetically pleasing calligraphy videos on YouTube. On the other hand, I’m a little creeped out that the algorithm knows me so well, and I know that it can serve to perpetuate harmful ideas (as discussed in Noble’s article). On a sillier level, I don’t exactly appreciate getting called out on the regular by other young adults with mental health issues on the internet. 

Actually, interacting (AKA, liking/commenting) with that last type of video can easily trigger another aspect of “the algorithm” that I’m less enthused about: the funneling of impressionable young people into misguided mental health spaces. These are online spaces (comment sections, users’ personal pages, group accounts) wherein often unqualified young adults and teens discuss mental health. Users will make videos prompting others to relate to symptoms of neurodevelopmental disorders or mental illnesses, poke fun at their own mental health challenges, and sometimes glamorize the idea of being deeply unhappy— even suicidal.

Right now, this subculture is having a bit of a moment on TikTok, but it’s certainly not anything new. I’m sure my classmates remember 2012-era Eating Disorder Tumblr

A mild example of what a search of "thinspo" on Tumblr yields.

A mild example of toxic eating disorder culture on Tumblr.

I’m not trying to say that this side of the internet is all bad, though. Users often also share tips or tricks that help make daily tasks easier to accomplish, or encourage people to seek professional help if they are struggling. Other users are actual medical professionals or therapists doing their best to offer useful advice. It’s also just nice to know that you’re not alone in your problems. I know I’ve also found solace knowing I’m not the only one experiencing feelings I thought were uniquely mine to bear, or that I’m not the only one who worries about [insert silly thing].

All I’m trying to say is that, when “the algorithm” aggressively directs users to these kind of mental health spaces and subsequently feeds them often misguided and toxic information, things can quickly get ugly. Vulnerable young people have been known to develop eating disorders or pick up inadvisable coping mechanisms as a result of interacting in such online spaces. And because they continue to interact with such content, these young people can find it extremely difficult to break out of these toxic bubbles. Instead, they get stuck in this nightmarish echo chamber full of other sad teens who are just trying to feel okay in a confusing, scary world. 

It’s this echo chamber effect created by “the algorithm” that worries me most. It certainly isn’t limited to mental health discourse: social and political echo chambers exist all over the internet. Laquintano and Vee describe how “the algorithm” affected the circulation of political information ahead of the 2016 election in their article. These spaces can similarly serve to promote misguided ideologies (such as glorifying cults).

Echo chamber | Cartoons | postregister.com

A political cartoon showing a modern example of how social media creates echo chambers. Illustration by Robert Ariall on postregister.com.

Generally though, echo chambers of any kind do one thing best: they echo. They repeat the same few ideas and opinions over and over and over again. And when those ideas are harmful, bad things happen. Real-world problems start to occur, and perhaps just as importantly, young people who’ve fallen prey to this algorithmic shepherding are prevented from seeing that there are other parts of life— online and off—  that are better than this. Even beautiful. This isn’t all there is. Some things matter way more important than the circumference of your wrists.

I don’t have a solution to this shepherding problem. Do we need more content censorship so that harmful information never ends up online in the first place? Or is that an infringement upon free speech? Should we “dial back” how aggressively the algorithm picks up on browsing patterns and herds us into groups? I don’t know. But I’m confident that we could all benefit from stepping outside our online bubbles, even if we don’t think we’re in a harmful or hateful space. Perspective is key: your slice of the internet is never all there is. The internet can be a tool for good, if we use it that way.

An American Sense of Reality

“To watch the TV screen for any length of time is to learn some really frightening things about the American sense of reality. We are cruelly trapped between what we would like to be and what we actually are.”
                                                                                              – James Baldwin


The singularly most omnipresent entity amongst the American populace is that of mass media. It leaks into every facet of our lives and defines how we perceive others and construct our own identities.

Adult reaching out to baby through phone screen

It has been proven through various studies that mass media is a powerful influence that commonly causes people to undergo an identity shift. An identity shift is defined as “choosing to change your current identity because you want to become a new person and experience a new life.”

The most susceptible group to media influence and identity shifts is adolescents. This is because the adolescent years are the most formative in identity formation for a human.

TikTok is a great example of a mass media venue that constantly encourages impressionable youths to undergo identity shifts. These identity shifts can be relatively tiny, such as a person basing more of their identity around a harmless fandom, or substantial, such as a person adopting an antagonistic language and attitude towards certain groups of people in order to mimic their favorite creator.

Kirkland & Jackson, in their work “‘We Real Cool’: Toward a Theory of Black Masculine Literacies,” offer another great example of the ability of mass media to influence adolescents’ identity. They specifically investigated the role rappers and rap media played in determining the language-in-use by “cool” African American adolescents. In specific, they traced how the group of “cool” children altered their language, social views, and clothing choices in order to align more closely with what rap media portrayed and perpetuated as cool.

Picture showing off a child's drawing that exemplifies Hip-hops's cultural influence on the way children speak

The pair also provide context on why specific mass media have a more significant influence on certain groups over others. In their study’s case, African American children formulated their “cool talk” and identities around African American rap artists and media because the community they inhabited deemed said rap artists as representative of what a “cool black man” and/or “black masculine cultural model” is.

I think moving forward as a society that it will become more and more important to encourage persons to distance themselves from media consistently in order to allow themselves the ability to maintain and reinforce their own personally constructed identity separate from overpowering external influences. Otherwise, I think that events such as the recent uptick in white supremacists specifically targeting racist media at adolescent boys in the hopes they will form their identity around normalized racism will become much more commonplace.

Playing the algorithm: How it can backfire

On YouTube, there is one universal rule for all creators: eventually, you’ll have to make an apology to address a controversy you may find yourself embroiled in. These scandals can range from mostly harmless missteps to being involved in actual criminal offenses. A very recent example of this is David Dobrik, who released two separate apology videos addressing a sexual assault incident he both facilitated and filmed, along with a variety of other allegations.

Like many creators, Dobrik knew that addressing the controversy could lead to more fans finding out about it. Therefore, he released his first apology, title “Let’s Talk” on his least followed channel, disabling likes and dislikes. More than likely, he was hoping that this would be enough of a response for fans asking for him to address the allegations, but not be seen by most people.

David Dobrik looking stupid

A screenshot from one of Dobrik’s apology videos. Notice how he left in him crying and how he is sitting on the floor, common tropes in the youtube apology genre.

Unfortunately for him, the video ended up on the YouTube trending page, and his clear attempt to manipulate the algorithm led to more people speaking out about the issue. He eventually had to make another apology, which still met some controversy. Dobrik has now lost all sponsorships and had to step away from his app, Dispo.

As Timothy Laquintano and Annette Vee discussed, automated systems greatly affect our writing and communication systems, and I believe this is a great example of this. Dobrik has thrived off the algorithm. He even sold merchandise with “clickbait” on it, showing how he works to manipulate YouTube’s automatic system. His name or face attached to a project automatically makes the algorithm more favorable to a piece of media, and he has famously not responded to scandals in the past to avoid negative associations with his name.

a red hoodie with the word "clickbait" on it

This has clearly led to his downfall, however. By playing the algorithm to boost his name recognition, Dobrik has made it even easier for others to call him out. He cannot hide his apology, even from automated systems. In my opinion, he is finally getting what he deserves.

The Internet and Democracy

When the World Wide Web was invented in 1989, an excitement gripped the United States as the internet went from a system primarily used by scientists to a system that could one day connect the world. Connection didn’t happen immediately. It took several years before email or the internet were widely available to everyone, and even then, there were barriers to access.

Thirty years later, most Americans walk around with access to the world’s information in their back pocket in the form of smartphones. But how connected is society? Is the internet actually driving us further apart?

Laptop Computer with Image of American Flag Covered in Code on ScreenIn the wake of last November’s contentious Presidential election, these questions have been at the forefront of mass media. Recently, an article in The Atlantic asked if democracy itself is at risk of failing as a result of partisanship on the World Wide Web. The internet is an open system that allows anyone to post nearly anything at any time. On the one hand, this open source format allows Americans to exercise their First Amendment rights in a manner the Founding Fathers could never have imagined.

But this open system also allows bad actors a platform that was not available to them in a world where print ruled. One example of this is the use of algorithms that “control” what a person might see on their social media feeds. In their article, “How Automated Writing Systems Affect the Circulation of Political Information Online,” Timothy Laquintano and Annette Vee mention a “Red Feed, Blue Feed” graphic created by the Wall Street Journal in which one can see the difference between a conservative or liberal Facebook feed “on a variety of issues,” thus highlighting the potential polarizing effect of the Web.

Algorithms, bots, and the Google search engine can all give the effect that humanity is not really in control of the internet at all. Fortunately, as The Atlantic article mentions, there are pockets of the internet that are so far free from manipulation, such as Wikipedia.

The question for American society is how to reclaim the parts of the internet controlled by trolls, bots, and corporations. In order to regain connection over division, tough decisions will need to be made on how to govern the internet without impinging on the rights of citizens. It won’t be easy, but it is necessary for the future of democracy.

Make it make sense: How AAVE is invalidated by the masses, yet used for capital gains.

English is one of the many languages that is not homogenous. It varies from culture, region, and ethnicity.

 

Cultural difference and influence are what makes humans unique and special. All stemming from different regions around the world, our style of clothing, the things we eat, and our language adapt to the elements around us.

With this in mind, there is a notion that African American Vernacular English (AAVE) somehow destroys the English language as far to say that it is inappropriate regardless of setting.

However, in a digital culture that’s consistently growing, AAVE is seen at the forefront of the way media agencies and companies communicate their advertising to their consumers.

 

This video demonstrates how quick companies are to capitalize on terms yet not acknowledge the creator by any regards. The mom states “on fleek” which was a term created and made popular by Black Viner Kayla Newman in 2014. As of today, Kayla has  yet to receive her coins.

The goal here isn’t necessarily to gate keep an entire multitude of lingo and terms made popular by black people, but to legitimize them as part of the way we talk while paying homage to its creators.

In Learning to Read by Civil Rights visionary and leader Malcolm X, he speaks on his frustration on not being able to convey his expression by literary means.

Image result for malcolm x illustration

“In the street, I had been the most articulate hustler out there – I had commanded attention when I said something. But now, trying to write simple English, I not only wasn’t articulate, I wasn’t even functional. How would I sound writing in slang, the way I would say it, something such as, “Look, daddy, let me pull your coat about a cat, Elijah Muhammad”.

Mr.Malcolm has been regarded as one of the great leaders of his time by his methods, teachings and lifestyle, yet somehow he was still placed in a system where he believed the way he spoke was invalidated by the masses.

The masses in question however, were those who conformed to the Eurocentric way of life that seeks to discredit anything that wasn’t rooted in their culture. So, it isn’t necessarily that Mr. Malcolm felt like the way he spoke was wrong, it was the people that felt that way and specifically those of European descent.

The English language grows daily. New terms, phrases, and ideas are formed all the time. It is about time companies, media outlets and the sort show appreciation to the founders. By doing so, it creates a safe space for words to be used without seeming forced or used for alternative intents.