Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Believe that journalism can make a difference

If you believe in the work we do at Vox, please support us by becoming a member. Our mission has never been more urgent. But our work isn’t easy. It requires resources, dedication, and independence. And that’s where you come in.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

Support Vox
Member Exclusive

There’s something off about this year’s “fall vibes”

Autumn is being eaten by a deluge of AI slop.

Vox_AI-generated_Fall_ALT
Vox_AI-generated_Fall_ALT
This is what came out when I prompted Canva’s AI tool to create a “view from cafe in autumn, quaint street, foliage, coffee, aesthetic, small town.” Interesting how it placed said foliage indoors!
Image generated by Rebecca Jennings using Canva
Rebecca Jennings
Rebecca Jennings is a senior correspondent covering social platforms and the creator economy. Since joining Vox in 2018, her work has explored the rise of TikTok, internet aesthetics, and the pursuit of money and fame online. You can sign up for her biweekly Vox Culture newsletter here.

A rain-soaked street at dusk, pictured through the window of a coffee shop. String lights hang between old brick buildings, a church steeple in the distance. In the foreground, a candlelit table with mugs of coffee, tea, and … a corked glass jug of beige liquid? Next to a floating hunk of sourdough? And also the table is covered in water?

This is the platonic ideal of “autumn,” according to one photo that’s gone viral both on X, where it’s been seen almost 12 million times, and Pinterest, where it’s the first picture that comes up when you search “fall inspo.” At first glance, you’d be forgiven for thinking it’s a tiny street in Edinburgh or the part of Boston that looks like Gilmore Girls. But like so many other viral autumnal vibes photos this year, the image, with its nonsensical details and uncanny aura, appears to be AI-generated.

AI “autumn vibes” imagery makes up a ton of the most popular fall photos on Pinterest right now, from a moody outdoor book display on yet another rain-soaked street to a sunlit farmers market to several instances of coffee cups perched on tousled bedspreads. All of them appear normal until you zoom in and realize the books don’t contain actual letters and the pillows are actually made of bath mat material.

It’s not just limited to Pinterest or “vibes”: AI-generated content is now infiltrating social media in ways that have a meaningful impact on people’s lives. Knitters and crocheters hoping to craft fall sweaters are being inundated with nonsensical AI patterns and inspo images on Reddit. A fake restaurant has gained 75,000 followers on Instagram by claiming to be “No. 1 in Austin” and posting over-the-top seasonal food items like a croissant shaped like Moo Deng. Meanwhile, folks hoping to curl up with a cozy fantasy novel or a bedtime story for their kids are confronted with a library of Chat GPT-generated nonsense “written” by nonexistent authors on the Kindle bookstore, while their YouTube algorithms serve them bot-generated fall ambiance videos. Autumn, it seems, is being eaten by AI.

Not everyone is — and please excuse the following pun — falling for it. When the fake cafe photo went viral on X, it caused a deluge of quote-tweets asking why the hell anyone needed to use AI when you could just as easily post one of the many actual photos taken in real cities that do, in fact, look like this.

The crux of the issue now is the sheer scale of it: Scammers and spammers can unleash a barrage of text and images with the click of a button.

Colloquially, all this garbage is widely considered “slop,” a term for the spammy AI-generated images, text, and videos that clog up internet platforms and make it more difficult and unpleasant than ever to be online. In reality, this moment of peak slop is the natural culmination of platforms that incentivize virality and engagement at all costs — no matter how low-quality the content happens to be. But the crux of the issue now is the sheer scale of it: Scammers and spammers can unleash a barrage of text and images with the click of a button, so searches for legitimate information or a casual scroll through social media require even more time and effort to bypass the junk. Misinformation about crucial news events and election coverage is spreading on platforms. Academic and literary publications are being spammed with low-quality submissions, making it harder to suss out genuine creative or scholarly work.

Of course, there are more urgent concerns regarding the rise of generative AI: its enormous energy consumption, for one, or the rampant creation of deepfake porn used to harass and abuse women. Considering all that, it’s easy to look at cute AI-generated fall pictures on Pinterest as a relative non-issue, a side effect of a technology that could (arguably) greatly benefit humanity.

Pinterest screenshot showing various autumnal scenes including fall foliage, coffee shops, farmers markets, and bookstores.
A screenshot of a Pinterest search for “autumn vibes.” At least three of these images appear to be AI-generated.
Pinterest

But as Jason Koebler, co-founder of the tech publication 404 Media explains, these images normalize AI slop and desensitize our ability to discern what’s real and what’s fake.

“The clogging of feeds and of search results is not just a side effect, but a main effect of all of this,” he told me. “It’s harder for a journalist writing an article to break through, or an artist painting a picture, or a musician making a song when they’re competing with not just a bunch of other humans making stuff, but humans who are using this automatic creation machine to make things at a scale that is impossible otherwise.” The problem is so bad that tools used to track the human usage of certain words online are no longer effective due to the prevalence of large-language models.

AI slop typically comes from people trying to make money by going viral on social media. Platforms like Facebook, Instagram, X, and TikTok all have programs that pay creators based on how much engagement their content receives, and AI makes it easier than ever to produce and test that content. That’s led to an entire cottage industry of people all over the world who teach paid courses on how to produce highly engaging AI slop, sharing information on the best prompts to generate the most attention-getting posts.

On Facebook, AI posters say they make around $100 per 1,000 likes, and some TikTokers are making $5,000 per month at their side hustles. It’s a decent amount for anyone but especially lucrative in countries where many AI content hustlers are based, such as India, Vietnam, and the Philippines. One Kenya-based creator told New York magazine that his process involves asking ChatGPT something like, “WRITE ME 10 PROMPT picture OF JESUS WHICH WILLING BRING HIGH ENGAGEMENT ON FACEBOOK” and then plugging those prompts into an image generator like Leonardo.ai and Midjourney.

Rather than being worried about their platforms being overrun with low-quality engagement bait, Meta and X seem unconcerned and even supportive of it. “There seems to be very little interest from any platform in taking action about this stuff,” Koebler says. “They are actively, in some cases, generating it themselves, and being like, ‘Look how cool this technology is!’”

Both Meta and X have invested heavily in AI, offering tools for users to add to the ever-increasing deluge of slop on their platforms. Meta’s official account even posted an AI photo of the northern lights over San Francisco on Threads — its top reply is a NASA engineer explaining why images like this spread false information and “muddy the waters of reality.”

AI slop will continue to exist as long as people are finding ways to make money from it, just like any practice on social media, from the merely irksome to the actually dangerous. Koebler guesses that AI spam got so popular because some of the platforms cracked down on content stolen from real creators, making AI the second-easiest option for spammers.

“People are just posting whatever they’re getting out of these AI generator machines, regardless of the level of quality,” he says, “because of the ways that virality and social media algorithms work, even if you have the world’s greatest piece of content, it might not go viral, whereas something that is not very good might, just because you won the luck of the draw.”

There’s a particular irony with AI-generated images of fall vibes, considering fall is disappearing from many parts of the US and AI emissions have become a major contributor to climate change.

And it’s not as if the internet is starving for aesthetically pleasing fall inspo: Every September, social media is flooded with images of pumpkin-strewn stoops, cozy blankets on comfy sofas, or small towns covered in yellow and orange leaves. For the past few years, we’ve christened these mini-moments online with names: Meg Ryan fall, which had its own outfit and playlist recommendations, or Christian girl autumn, where people unleashed their inner white woman by wearing wide-brimmed hats and knee-high boots to grab pumpkin spice lattes. (This year, it seems like the Gilmores’ fictional Connecticut town of Stars Hollow is providing much of the inspiration.)

It’s all very cutesy and wholesome, but even this type of human-made content is increasingly little more than a plot to get viewers to click on affiliate links to Amazon storefronts or ultra-cheap TikTok Shop junk. In this way, they’re not all that dissimilar from AI slop: Platforms are encouraging their users to be professional salespeople, whether they’re hawking unethically made clothing and home goods or spamming audiences with AI-generated inspo photos. Both are low-quality, quick-to-produce types of content that drive engagement and, therefore, revenue, even when regular users say they hate it.

Part of the joy in scrolling through fall photos, after all, is knowing that these places exist and you could theoretically visit them, that the world fundamentally changes in autumn, and that there’s only a small window of time to marvel at how beautiful it all is. An AI-generated image represents the precise opposite: It’s just one of the infinite possible arrangements of pixels for machines to keep churning out indefinitely.

More in Culture

9 actually good things that happened in 20249 actually good things that happened in 2024
Future Perfect

It wasn’t the easiest year, but 2024 was not without its bright spots.

By Bryan Walsh
A Bob Dylan mega-fan detangles the Timothée Chalamet biopic for usA Bob Dylan mega-fan detangles the Timothée Chalamet biopic for us
Culture

Veteran Minneapolis DJ Bill DeVille explains A Complete Unknown for fans and newbs alike.

By Aja Romano
The adorable reason why all of Amy Sedaris’s stuff has holes in itThe adorable reason why all of Amy Sedaris’s stuff has holes in it
Down to Earth

She’s an expert in funny, but her relationship with rabbits is very serious.

By Benji Jones
The latest chapter of It Ends With Us is an alleged Blake Lively smear campaignThe latest chapter of It Ends With Us is an alleged Blake Lively smear campaign
Culture

Justin Baldoni allegedly paid a team to take down his costar. Social media was primed to do it for free.

By Alex Abad-Santos
Christmas With the Kranks explains everything wrong with pop culture nowChristmas With the Kranks explains everything wrong with pop culture now
Culture

In 2004, critics demanded better than mediocre Christmas movies. Why are we so reluctant to do so now?

By Rebecca Jennings
The movies, shows, books, and music we couldn’t stop thinking about this year The movies, shows, books, and music we couldn’t stop thinking about this year 
Culture

Vox’s cultural obsessions of 2024.

By Vox Staff