For You Research

The For You Data Hub

The Hub is where shared feeds become research: a browser-based workbench that turns thousands of short videos into datasets, timelines, maps and findings, all built on data donation. You can use our hosted instance without installing anything.

Thinking about using the Hub in your own project? Email us at info@foryouresearch.net. We'd love to hear from you.

New accounts get access to a small, safe sample dataset, chosen so there is no participant privacy at stake while you look around. Ingesting your own participants' data and running the full pipeline isn't part of this preview. When you're ready for that, get in touch and we'll walk you through it.

Getting access

  1. Create an account. Go to the sign-up page and register with your email address, a username and a password.
  2. Wait for approval. New accounts are reviewed before they're enabled. You'll see "pending approval" until your account is activated; it shouldn't take more than 24 hours.
  3. Log in. You'll land in the app with the analysis tabs (Explore, Timelines, Video Analysis and Correlations) ready to use against the sample dataset. Ingestion and administration aren't part of this peek.

A short tour of the analysis tools

With the sample dataset open, here are some things you might try:

  1. Get an overview in Explore. Open the Explore tab to see how any variable is distributed across the study. Use the filter panel to slice the data, for example videos from a particular content category, or plays longer than a threshold, and switch to two-slice mode to compare groups side by side. Significance stars flag differences between the slices.
  2. Follow a participant in Timelines. Pick a collection (one participant's data) and watch how their feed composition evolves day by day. Filter chips isolate rising, falling, spiking or volatile categories, and "Show Findings" lists detected trends, anomalies and structural breaks.
  3. Drill into videos. From any chart in Explore or Correlations, click through to Video Analysis to watch the underlying videos, inspect their full metadata and AI annotations, and add your own tags and notes.
  4. Go deeper. Correlations charts relationships between numeric measures (with regression lines, group ellipses and a correlation heatmap). Researchers with full accounts also get Semantic Space, which maps every annotated video by meaning so you can explore the corpus's micro-genres.

Follow the Pipeline

What happens to a donated feed? Follow it through the Hub's five steps, Ingest → Enrich → Annotate → Analyse → Share, from raw data package to research finding. If you're a participant, this is exactly what happens to a donation; if you're a researcher, this is the toolbox you get.

Research participants donate data from TikTok, Instagram Reels and YouTube Shorts. The Data Hub parses the donated data packages into a single clean, queryable corpus, which you curate and structure into studies that cover the time period relevant to your research questions.

Data Management: ingesting new collections from different donation formats
Ingest: mixed donation formats become one corpus

Donated packages arrive stripped of the videos themselves and most metadata. The Hub recovers as much as it can (videos, captions, authors, music and engagement counts) through background scraping queues. Not every item can be recovered, and the Hub keeps track of what is still missing.

Scrape and Annotate: background queues recovering videos and metadata
Enrich: scraping back the videos and metadata

Google Gemini turns each video into structured research variables, such as content category, activities, objects, transcript, sensitivity and more. Machine annotation is useful, but it needs scrutiny, so we wrap it in versioning, testing and human evaluation, and then map the annotated corpus by meaning.

Structured, versioned prompts

Every field the AI fills comes from a declarative annotation contract that generates the Gemini prompt and response schema, editable in the browser. Each run is stamped with a content-derived version (model + prompt + schema + parameters); old versions are never overwritten, so the full annotation history stays archived and queryable, and each study pins the exact version it was built on.

Annotation contract and version history: prompt text and response schema, content-derived version stamps
Annotation contract & versions: prompt and schema, fully versioned

Tested and human-evaluated

Before a prompt goes live, candidate contracts run head-to-head on a fixed evaluation set with real Gemini calls, scored on agreement metrics. Human coders can be invited to blind-code the same videos, so machine annotations are measured against inter-coder reliability. Only a candidate that holds up in this testing graduates into the live dataset.

Annotation testing: candidate contracts compared against each other and human coders on a fixed evaluation set
Annotation testing: candidate prompts vs human coders on a fixed set

Map the whole corpus

Once annotated, every video becomes a 1536-dimensional embedding built from its variables and content, then projected into a readable 2D semantic space where similar videos sit together. The Hub clusters that space into fine-grained, automatically named "niches" - emergent micro-genres you can focus on, label, and colour by content category or popularity. Because it spans the entire annotated corpus, the map is a bird's-eye view of what the feed is made of, independent of any single study.

Semantic Space tab: 2D embedding map of annotated videos
Semantic Space: the annotated corpus, mapped by meaning

Different research paradigms in one place: time-series and statistics alongside qualitative video analysis.

Compare across the corpus

Explore compares variable distributions across a study, split into two filtered slices with significance testing. Build selections with checkboxes and range sliders, and click any bar to drill into the videos.

Explore tab: variable distributions split into two filtered slices
Explore: distribution comparison across data slices

Follow a feed over time

Timelines shows how a single participant's feed evolves day by day: smoothed per-variable timelines with trend, anomaly and structural-break detection, and filter chips for rising, falling or spiking categories.

Timelines tab: a participant's activity evolving day by day
Timelines: one participant's feed, day by day

Watch and annotate in context

Video Analysis is the qualitative workbench: watch videos in place, inspect the full enrichment and annotation record, and add your own notes close to the source, alone or with your team.

Video Analysis tab: watching and tagging an individual video
Video Analysis: watch, inspect and code individual videos

Zoom in on a single sitting

Sessions ranks individual viewing sessions, filterable by duration, plays, coverage, low-entropy stretches and binge count, and lays each one out as a session strip: detected binges, low-entropy sequences, and a video panel that opens straight into Video Analysis.

Sessions tab: ranked session list with session-strip timeline and detected binges
Sessions: one sitting, minute by minute, binges detected

Find structure and patterns

Correlations places one dot per collection-day on any two numeric axes, with group ellipses, regression lines and a full correlation heatmap, plus PCA-based measures computed per study.

Correlations tab: scatter plot with group ellipses
Correlations: scatter, ellipses and correlation heatmap

The Hub is built for teams. Fine-grained, role-based access lets you bring collaborators and students in with exactly the tabs, studies and permissions they should have, so a whole project can work from one shared corpus, safely.

Admin: role-based permission matrix controlling access per role
Share: role-based access for collaborators and students

Running it yourself

This instance is one deployment of the Hub, not the only one. The software is open source under the MIT licence, so you can run your own, which is what you want for a real study: it keeps your participants' data on infrastructure you control, under your own ethics approval.

  1. Get the code. Clone github.com/pwikstrom/foryou-research and follow the installation guide. A setup wizard writes your local configuration; the Hub runs on a laptop for small studies and on Google Cloud Run for larger ones.
  2. Bring your own keys. Enrichment and AI annotation call external services, so an instance needs its own credentials. The installation guide lists which ones and what they cost.
  3. Adapt it. Annotation prompts are declarative contracts you edit in the browser, and adding a platform is one ingestion class plus one scraper class. The docs folder covers architecture, configuration and the pipeline.
  4. Cite it. The repository carries a CITATION.cff with the archived DOI, so GitHub's "Cite this repository" button gives you a ready-made reference.

Feedback and bug reports

Development happens in the open, and reports from people using the Hub are the main way it improves.

  • Bugs and feature requests: search the issue tracker, then open an issue with what you did, what you expected and what happened instead.
  • Never in a public issue: participant data, or screenshots that identify a participant.
  • Security problems: report them privately, following the security policy, not as an issue.
  • Code: pull requests are welcome; start with the contributing guide.

Could the Data Hub be useful in your project?

The sample dataset is just a taste of what the Hub does. If you're thinking about ingesting your own participants' data, running the full pipeline and bringing in your team, write to us at info@foryouresearch.net. We'd be glad to show you the full pipeline and talk through what working together could look like.