Papers
arxiv:2409.03753

WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild

Published on Sep 5, 2024
· Submitted by
Yuntian Deng
on Sep 6, 2024
Authors:
,
,

Abstract

WildVis is an interactive tool for large-scale conversation analysis, providing search and visualization capabilities in text and embedding spaces with optimizations for handling million-scale datasets.

The increasing availability of real-world conversation data offers exciting opportunities for researchers to study user-chatbot interactions. However, the sheer volume of this data makes manually examining individual conversations impractical. To overcome this challenge, we introduce WildVis, an interactive tool that enables fast, versatile, and large-scale conversation analysis. WildVis provides search and visualization capabilities in the text and embedding spaces based on a list of criteria. To manage million-scale datasets, we implemented optimizations including search index construction, embedding precomputation and compression, and caching to ensure responsive user interactions within seconds. We demonstrate WildVis's utility through three case studies: facilitating chatbot misuse research, visualizing and comparing topic distributions across datasets, and characterizing user-specific conversation patterns. WildVis is open-source and designed to be extendable, supporting additional datasets and customized search and visualization functionalities.

Community

Paper author Paper submitter

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

neat. thanks

needs WildChat updated to the WildChat-50M version, WildVision, all the LMArena HuggingFace datasets, ShareChat, ShareGPT datasets, and ShareLM.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2409.03753
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 2

Datasets citing this paper 23

Browse 23 datasets citing this paper

Spaces citing this paper 104

Browse 104 spaces citing this paper

Collections including this paper 4