All stories
AI

X Unveils 'Under the Hood' Tool and Open-Source Algorithm for Shadowbanning Transparency

X (formerly Twitter) is rolling out a new "Under the Hood" transparency tool and open-sourcing its ranking algorithm to allow users to understand why their posts might have reduced visibility, marking a significant, albeit complex, step towards addressing long-standing algorithmic bias accusations and potentially reshaping industry standards for content moderation transparency.

By TECH NEWS Editorial·Source:Engadget·4 min read·33m ago

This content was summarized and interpreted by AI; it may contain errors — please verify accuracy with the original sources. Learn more

Share

Listen to this story

0:00 / 0:00
X Unveils 'Under the Hood' Tool and Open-Source Algorithm for Shadowbanning Transparency

X (formerly Twitter) is piloting a new "Under the Hood" transparency tool that allows eligible users to scrutinize why their posts might be experiencing reduced visibility, commonly termed "shadowbanning." This feature, initially rolling out to a randomized group of accounts at least one year old with a minimum of ten posts in the last month, provides users with downloadable .json files containing aggregate statistics and "visibility-limiting labels" applied to their content or accounts. This initiative coincides with the company's continuous effort to open-source its ranking algorithm, a significant update to which landed on May 15, 2026, comprising over 18,000 lines of new code.

This dual move by X represents a bold, if somewhat convoluted, attempt to address long-standing accusations of algorithmic bias and opaque content moderation, particularly from users who have claimed their content was suppressed without notification. X's Vice President of Product, Keith Coleman, has lauded these changes as offering an "unprecedented level of transparency" into the platform's algorithmic workings. For creators and businesses reliant on X for reach, the "Under the Hood" tool promises unprecedented insight into how their content is processed, potentially enabling them to refine their strategies to better align with the algorithm's preferences.

The open-sourcing of X's ranking algorithm, particularly the January 2026 release of the complete Grok-powered replacement at github.com/xai-org/x-algorithm, is a stark departure from the industry norm. Unlike rivals such as Meta and TikTok, which maintain proprietary algorithms, X is exposing the actual Rust and Python code that determines content distribution. This 2026 iteration is a full rewrite from the previous Scala codebase, now featuring a runnable inference pipeline and eliminating hand-engineered features, instead learning relevance from user engagement sequences. The algorithm processes approximately 500 million daily posts, narrowing them down to about 1,500 candidates per session through a three-stage funnel involving candidate sourcing, scoring via a neural network called Heavy Ranker, and filtering based on moderation and diversity rules.

Crucially, the code reveals specific ranking signals: posts are heavily prioritized based on replies, bookmarks, and author reputation, rather than simply follower count. Early engagement within the first 30 to 60 minutes after posting is identified as the single largest driver of distribution. Furthermore, the algorithm explicitly penalizes external links, showing a 30-50% reach reduction by 2025, and effectively zero engagement for non-Premium accounts posting links by March 2026, pushing users to keep content native to the platform or embed links in replies. The Grox content-understanding system, integrated in May 2026, includes sentiment analysis, favoring constructive and positive messaging over negative or combative framing, even if the latter generates high raw engagement. Negative user actions, such as blocks, mutes, and reports, carry a disproportionately heavy weight, approximately -74 times that of a positive signal like a "like," indicating X's optimization for long-term user retention over short-term controversial engagement.

While the "Under the Hood" tool and open-sourced algorithm offer a new era of transparency, their practical impact on user trust and behavior remains to be fully seen. The complexity of a .json file filled with algorithmic labels may prove challenging for the average user to interpret, potentially undermining the goal of clear understanding. However, for power users, marketers, and researchers, this level of detail provides an unprecedented opportunity to dissect and understand the mechanics of virality and suppression on a major social platform. This transparency could foster a more informed user base, but it also risks an intensified "algorithmic gaming" as creators and marketers attempt to reverse-engineer optimal content strategies.

The move also places X at the forefront of the content moderation transparency debate, potentially setting a new, albeit demanding, standard for other social media giants. While other platforms utilize advanced AI and human moderation tools, they largely keep their core algorithms proprietary, arguing that their systems are effective as-is. X's approach, however, faces the challenge of demonstrating that transparency translates into a more equitable and trustworthy platform, rather than merely exposing the flaws of a system still grappling with balancing free speech, safety, and engagement at scale. The heavy reliance on sophisticated AI, including Vision-Language Models (VLMs) and an "LLM-as-a-judge" pattern for moderation, points to a future where artificial intelligence dictates much of online discourse, raising questions about the role of human oversight and the nuances of context. Ultimately, X's latest initiatives are a significant experiment in rebuilding user trust through radical transparency, an experiment whose long-term success hinges on both the clarity of its tools and the perceived fairness of its exposed algorithms.

Sources