Bigset Oss banner
tinyfish-io tinyfish-io

Bigset Oss

Development community

Description

Open-source BigSet — self-hostable live datasets populated by TinyFish web agents

Installation

This entry records only its repository, not the path inside it, so there is no exact command to give. Open the source below and copy the folder into ~/.claude/skills/, or the file into ~/.claude/agents/.

README

BigSet

Build and maintain any dataset from the live web, that refreshes regularly

GitHub Stars License Issues Follow TinyFish


⚠️ **BigSet is experimental.** It works, sometimes surprisingly well, but expect rough edges. We're building in the open and shipping fast. Things will break, improve, and change. [Issues](https://github.com/tinyfish-io/bigset/issues) and feedback are very welcome.


What Is BigSet?

You type a sentence:

*"YC companies that are currently hiring engineers, with their funding stage, location, and number of open roles."*

BigSet infers the schema automatically, sends autonomous agents to research it on the live web, verifies what they find against real sources, deduplicates, and hands you a structured dataset. Download as CSV or XLSX.

You can even set a refresh cadence (30 min, 6 hours, 12 hours, daily, weekly) and the agents re-run on schedule, pulling fresh data so the dataset never goes stale.

Built on [TinyFish](https://www.tinyfish.ai?utm_source=github&utm_medium=organic&utm_campaign=bigset-developer-2026q2) APIs.

Quick set up guide (~3 mins)

Watch the demo

✨ Why BigSet?

At the end of the day,