Product Intro

01

What is Moderation Dashboard?

Moderation Dashboard is an all-in-one content moderation application built on top of Hive’s content moderation APIs, that recognizes and removes unwanted content with code-free interface while supports tailored auto-moderation rules and allows human moderators stays in the loop at the right time with no additional development required.

01. Auto Moderation - AI content screening

Hive’s Moderation Dashboard adopted pre-trained AI models that identifies uploaded contents and perform custom actions based on labeled categories to release human labor cost required for regulating user-generated-content platforms.

The dashboard simplifies the process with a no-code required user interface for customers to adjust the AI moderation models to align with their own content safety regulations.

02.Manual Moderation - Human in the Loop

While letting the AI do the majority of the job, the Moderation Dashboard also kept the human in the loop for the right time, such as making decision on ambiguous content, with no additional development.

Human Moderators can also access insights generated by our selected models and tools on high-risk content to inform decision-making.

03. Data Analysis & Performance monitoring

The dashboard also facilitates customer monitoring their content through an incorporated trend analysis segment. This empowers customer admins to gain insights into submission and content patterns, track down user behavior, content preferences, emerging trends to empower informed decision making and optimize platform's content policies for maximum engagement and impact.

At the same time, it aids admins in overseeing and optimizing manual moderation process and their moderators' performance.

Understand the Context

02

How does the growing market for user-generated content platforms post-COVID highlight the crucial role played by moderation dashboards?

The content moderation market has witnessed significant growth post-COVID, fueled by the surge in user-generated content on various social platforms. As online engagement soared, the demand for sophisticated moderation tools and services intensified. Industry players are increasingly investing in AI-driven solutions to efficiently manage the influx of the content. Hive as one of the major player in content moderation market, it becomes crucial to redesign and enhance our content moderation dashboard to improve efficiency, accuracy, and user-friendliness.

What are the project challenges?

Internally, the organization faces several challenges. First, limited resources constrain growth initiatives. Second, the onboarding process heavily depends on the product and sales teams, potentially creating bottlenecks. Third, high development costs and efforts, due to the absence of an agile structure, contribute to a chaotic design and development process. Additionally, the lack of effective marketing further hampers business expansion.

Self-Serve Product

Ensure that the redesigned dashboard can accommodate future growth and increasing content volume.

Agile & Scalable

Ensure that the redesigned dashboard can accommodate future growth and increasing content volume.

Standardized Design Process

Time and latency plays a big part in content moderation tasks. Streamline content review processes, reduce manual work, and increase the speed of moderation is essential for customer’s business.

Streamlined Marketing Strategy

Implement advanced AI-based content analysis tools to assist moderators’ customized needs in identifying and handling problematic content

Product Analysis & Market Research

03

Competitor Analysis

Customer Archetypes

The target market consists of startups seeking streamlined engineering development processes. They require efficient content moderation for user-generated or platform content and prioritize ease of installation. This audience seeks practical solutions to manage and maintain the quality of their content while minimizing technical complexities.

User Generated Content

Low Develop Cost

Value Proposition

Moderation Dashboard is an all-in-one content moderation application built on top of Hive’s content moderation APIs, that recognizes and removes unwanted content with code-free interface while supports tailored auto-moderation rules and allows human moderators stays in the loop at the right time with no additional development required.

Brand Attributes

Furthermore, we reviewed Hive's brand attributes and assessed how the moderation dashboard currently aligns with our brand mission. Subsequently, we established our post-redesign goals and expectations. Our primary focus areas include scalability, versatility, and seamless accessibility, aiming to enhance the dashboard's overall user experience in these key domains.

Product Goal

Optimize Nav Experience

Create a more intuitive and user-friendly content moderation dashboard that allows moderators to easily review and manage content.

Improved Efficiency

Time and latency plays a big part in content moderation tasks. Streamline content review processes, reduce manual work, and increase the speed of moderation is essential for customer’s business.

Increase Accuracy

Implement advanced AI-based content analysis tools to assist moderators’ customized needs in identifying and handling problematic content.

Enhance Customization

Integrate new features and tools tailored precisely to meet customer demands, ensuring seamless alignment with their moderation guidelines.

Audience Analysis & User Interview

04

User Group

Super Admin (Internal)

Background & Expertise:

  • Internal Hive Moderation Team
  • Proficient on engineering/AI
  • Proficient with product

Responsibility:

  • Manage moderation models and project status
  • Manage moderation projects
  • Review customer request and provide support

Admin

Background & Expertise:

  • Trust & Safety Team, Product Manager,
  • Some or proficient on engineering/AI
  • Familiar with moderation

Responsibility:

  • Manage Organization Account
  • Manage moderation projects and team
  • Review content trends & analysis

Moderator

Background & Expertise:

  • Trust & Safety Team,
  • No or some engineering/AI background
  • Outsource moderator

Responsibility:

  • Review and complete manual moderation Tasks ( Review content, make action)

Quantitative user insights and Customer Feedback

In order to get quantitative data on user behaviors we adopted a tool called Fullstory to help track down the unusual activities and also monitor trends and user preferences.​

With FullStory at our disposal, we can easily track how users navigate our dashboard and gather their thoughts. we efficiently monitor and analyze user interactions with different dashboard sections, capturing valuable insights into behavior trends and preferences.

Qualitative Interviews and User Test

To gather more firsthand insights into user behaviors, we conducted qualitative research, concentrating on a select group of interviewees with backgrounds closely aligned with our target user demographic.

Interview Method

Objectives:
What are user’s expectation on content moderation and how is Moderation Dashboard solving the problem?

We divided participants into an admin group and a moderator group, considering their backgrounds. Working alongside the product and sales teams, we tasked interviewees to engage with the product as customers. We recorded the entire process and screen activities to observe their behavior.

User Testing & Interview:

Insights 1

"Wish the docs are more instructional, finishing the setup in one demo session is quiet impossible."

Insights 2

Interviewees all finds the moderation categories' setting confusing, taking longer than expected to setup the dashboard.

Insights 3

Instead of the content categories, I would prefer to have them in severe level. Wish we can create our own categories.

Insights 4

"There are some tasks I am not sure what to do, and there's nothing I can do".

Insights 5

"The UI is little confusing, wish it is more clean and straightforward. Also the language and naming on dashboard is not very clear to me"

Insights 6

The current demo session is not enough for the customer team to onboard on the dashboard, the process can take weeks until they get familiar with it.

User Journey Map

After conducting the interviews, we constructed a comprehensive user journey map that encapsulates all pain points, expectations, and emotional responses throughout the dashboard's various stages. This map serves as a valuable tool in understanding user experiences, enabling us to pinpoint critical areas for improvement and optimization.

Design Process

05

Create

  • A streamlined user experience for content moderation.
  • Self-served onboarding and dashboard setup process tailored to diverse user needs.

Raise

  • Efficiency in content management and moderation.
  • Awareness of the content trends, user engagement through trend analysis and reporting

Reduce

  • Manual moderation workload through automated tools.
  • User exposure to harmful content.
  • Unclear Page division and navigation

Eliminate

  • Inefficient moderation processes.
  • Ambiguity in content filtering.
  • Redundant develop and internal team training

Core Flow

The initial phase of the redesign involves finalizing the fundamental dashboard flow, establishing the backbone of the entire product. This step not only provides a solid foundation for scaling up but also shapes our marketing strategies, ensuring a coherent and impactful product launch.

Sourcing the possible tools to add into the dashboard

Referring to the core flow, we initiated the process of sourcing from our model list, aiming to innovate and incorporate additional models that can elevate the overall experience, particularly for moderators. This strategic approach seeks to optimize the platform's functionality and customizabilit.

Navigation

Utilizing the core flow as the foundation, we deconstructed the tools and content into four pivotal sections: analysis, submission review, auto-moderation, and manual moderation, along with auxiliary dashboard features. This strategic framework enables us to expand the dashboard without compromising the essence of the product, mitigating the risk of user disorientation during minor feature updates.

Language & Naming

While dividing the content, we meticulously reviewed all section names to prevent confusion and errors. We also included clear descriptions visible to customers without AI moderation expertise, facilitating their understanding of the platform's functionalities.

Function Area/Division

To optimize user experience, we categorize information into specific pages, enabling swift data retrieval. Moreover, we've strategically positioned interactive sections close together, minimizing cursor movements across the screen and enhancing overall productivity.

Visual Hierarchy on Pages

Furthermore, we've enhanced the hierarchy and contrast on the page, ensuring that users easily identify the most critical information they require.

Brand Style

The moderation dashboard previously featured its own color and component system, which had become cluttered over time. With the ongoing design updates, our objective is to systematically restore the brand aesthetics and structure of the dashboard.

Optimization & Size

Given the diverse user groups employing various screen sizes and devices for task management, we want to ensure responsiveness is optimal for streamlining their processes.

Final Designs

06

Sample Design 1: Admin View - Onboarding

A key focus of the design is revamping the onboarding process to streamline learning and minimize the need for extensive communication between customers and the internal team. Before the customer receive any data from their empty analysis page, we transformed the landing page into an onboarding guide, providing step-by-step instructions for customers to set up moderation settings, effectively reducing communication costs.

Sample Design 2: Admin View - Analytics

In designing the Analytics screen, our emphasis was on identifying the crucial information required by administrators. We organized this information into two main sections: Content Trend and Moderation Performance. Our focus was on determining the most effective visualization methods for these data sets and facilitating action on high-priority tasks.

Sample Design 3: Admin View - Auto Moderation

We revamped the auto-moderation setup pages, consolidating all available settings in a single, accessible location. Additionally, we introduced a test mode and an analysis chart, empowering customers to assess the accuracy of their configured rules and ensure alignment with their safety guidelines.

Sample Design 4: Moderator View - Manual Moderation

The manual review feed is the most intricate segment of the moderation dashboard. To streamline the review process, we developed customized views tailored to specific audience needs, ensuring quick access to crucial information.​Moreover, we introduced a dedicated landing page for users, specifically moderators, allowing them to personalize their project page. This feature facilitates the assessment of task urgency and enables the application of filters based on categories and content formats.

Beyond the Product

07

Develop Process

We redesigned the product development process, that allows all the teams get a overview on the roadmap in advance, we also prioritize design & marketing, so we can be more prepared for product launch.

Sales Demo & Documentation

We revamped the demo session and streamlined the documentation to enable any sales member to conduct demos without depending on the product manager, simplifying the onboarding process.

Customer Support/Updates

To gather customer feedback and maintain customer engagement, we integrated a feedback feature directly into the dashboard. Furthermore, we incorporated product updates into the dashboard, ensuring they are prominently displayed for our customers to keep up with updated feature in the dashboard.

Marketing & Website

To enhance our marketing strategy, we started to send out marketing emails and update our blog before each release. Additionally, we established a website to provide potential moderation customers with essential information prior to their outreach.

Appendix

08

Key Take Away

During this project, I've garnered invaluable support from my collaborative team. I've acquired proficiency in quick decision-making and execution, leading design efforts for a multifaceted product, providing an opportunity to refine my design process. Notably, I've learned to constantly reference project goals and recognize the distinctive role design plays in setting a product apart from its competitors.

Process Documentation

Explore More

For better experience, please view details on desktop screen.