AI-Generated Content: An Industrial-Scale Bete Noire Needing Regulation?

A viral anecdote that recently circulated across Chinese social media suggested a couple had leveraged generative AI to produce WeChat articles at scale, amassing over 2 million yuan (US$293,000) in annual income. The story was seductive in its simplicity: minimal effort, maximal yield and a seemingly frictionless path to money-spinning.

Within days, however, the narrative met a more sobering reality. Accounts tied to such practices were banned by Tencent's WeChat.

Rather than treating the incident as an isolated infraction, Tencent used it as a moral imperative. In a public statement delivered via a company channel, a Tencent spokesperson delineated a principle that is quickly becoming axiomatic within China's content governance framework: AI may augment human creativity, but it must not supplant it.

A deep anxiety has been shared across content platforms that an unregulated generative AI could precipitate a deluge of derivative, low-signal content, eroding both user trust and the economic viability of original creators.

Tencent's intervention can be best interpreted as a preventive measure against online misuse. The company's concern is less about the technology itself than about its propensity to facilitate what might be termed "content industrialization," or the mechanized production of articles optimized for viral impact rather than veracity or insight.

This is not without precedent. China's digital ecosystem has long contended with waves of attempts to monetize content, from clickbait to "pseudo-original" rewriting. Generative AI, however, introduces a qualitative shift. What once required coordinated human labor can now be executed by algorithms at a negligible cost.

The result is a potential glut of homogenous material: articles that differ in word but not substantively, saturating feeds with redundancy. In such an environment, differentiation becomes elusive, and the informational value of content declines rapidly.

Besides Tencent, the Xiaohongshu (RedNote) platform has concurrently adopted a more stringent stance toward AI-generated content, particularly in the context of commercial promotion.

RedNote has issued guidelines emphasizing authenticity and disclosure, proscribing the use of AI to fabricate narratives, such as product reviews, that simulate first-hand usage without any interaction. Enforcement has been neither perfunctory nor symbolic; non-compliant content has been removed and repeat offenders penalized.

What is notable here is the consistency of underlying logic across platforms. The objection is not to AI per se, but to its deployment as a vector for obfuscation, where automation masquerades as authorship and scale is achieved at the expense of substance.

In effect, Chinese platforms are converging on a regulatory point where AI is permissible as a tool of augmentation, but impermissible as an instrument of obfuscation.

Across the Pacific, the regulatory ethos appears more permissive – if not outright facilitative. Meta has embedded generative AI capabilities across its ecosystem, including Instagram, where AI-assisted content creation is increasingly normalized. Similarly, X has been positioned as a fertile ground for AI-native expression, from synthetic threads to algorithmically generated visuals.

This reflects an environment that is highly competitive and engagement-driven, where platforms are incentivized to lower creative barriers and accelerate content velocity. AI, in this scheme of things, is less a risk to be mitigated than a catalyst to be harnessed.

That said, Western platforms are not wholly indifferent to the attendant risks. Policies around labeling AI-generated content, particularly in political or advertising contexts, are gradually emerging. Yet enforcement remains comparatively diffuse, and the threshold for intervention is higher.

The divergence, then, is not one of awareness but of calibration. Chinese platforms have opted for preemptive constraints; Western platforms, for accommodation.

At its core, the debate over AI content moderation reduces to a question of signal integrity. What constitutes valuable content in an era where production is no longer a bottleneck?

Chinese platforms appear to privilege informational density and authentic authorship, seeking to curtail practices that dilute either. Western platforms, by contrast, are more tolerant of variability, prioritizing engagement metrics and creative plurality.

Neither model is without trade-offs. Excessive restriction may stifle innovation; excessive permissiveness may degrade quality. The challenge lies in finding a boundary that is neither overly prohibitive nor unduly lax.

From these divergent approaches, a set of provisional principles is beginning to crystallize.

For one thing, AI-native content is not inherently problematic. Its incorporation into content creation is both inevitable and, in many respects, desirable. It expands the creative toolkit and lowers barriers to entry. To categorically forbid AI-generated content would be both impractical and counterproductive.

Secondly, platforms should not suppress AI, but rather prevent its misuse. They bear a responsibility to curtail practices that exploit AI for content laundering. The objective is not to police creation, but to prevent the erosion of content quality through industrial-scale manipulation.

And thirdly, transparency and originality are non-negotiable. Encouraging AI-assisted creation must be contingent upon clear disclosure and a demonstrable contribution of human judgment. Labeling AI-generated content is not merely a compliance exercise; rather, it's a mechanism for preserving trust between creators, platforms and users. Concurrently, platforms must continue to encourage original thought to ensure that human perspective remains the fulcrum of value creation.

Tencent's recent intervention is, in this sense, less an isolated enforcement action than a bellwether. It signals an emergent consensus within parts of the industry that the future of content will be neither purely human nor purely machine, but a measured synthesis of both.

(The author is a Singapore-based journalist who writes about technology and co-founder of Tech Tech China, a technology media startup.)