Cover image for Fish Audio Raised 52 Million Dollars for Voice AI: What the Open Core Bet Means for Builders

At a glance

Reading time

~200 words/min

Published

18 hours ago

Aug 9, 2026

Views

42

All-time total

Fish Audio Raised 52 Million Dollars for Voice AI: What the Open Core Bet Means for Builders

On 28 July 2026, Fish Audio announced a 52 million dollar seed round led by Coreline Ventures and Capital Today. Seed rounds of that size are unusual enough to notice. What makes this one worth reading carefully is the shape of the company underneath it: a voice AI startup roughly one year old, reporting 21 million dollars in annual recurring revenue, more than 8 million users, and a GitHub repository with over 31,000 stars. It began as a personal project trained on a single GPU and then given away. If you want the wider tooling picture first, I compared the runtimes in Local AI in 2026. That combination of open source distribution and rapid commercial revenue is the interesting part, and it has direct consequences for anyone deciding how to add speech to a product.

The short version

  • Fish Audio raised 52 million dollars in seed funding led by Coreline Ventures and Capital Today, at roughly one year old
  • The company reports growing from zero to 21 million dollars in annual recurring revenue with more than 8 million users
  • It has released five models in a year, four for speech generation and one for speech to text, but only three are open sourced
  • The current flagship, S2.1 Pro, is available through the paid API only, which is the open core boundary drawn in practice
  • For builders the practical question is not open against closed, it is which side of that line your requirements fall on

From one GPU to 21 million dollars in a year

The origin story is unusually specific. Shijia Liao, a former Nvidia researcher and now co-founder and chief executive alongside Rissa Cao, was dissatisfied with how flat and inexpressive commercially available synthetic voices sounded. He trained a voice generation model on a single GPU and open sourced the result. The company is based in Palo Alto and launched in 2025.

That detail about the single GPU matters beyond being a good anecdote. It is evidence of how far the cost of entry in speech synthesis has fallen. Building a competitive text to speech system a few years ago meant a data licensing budget, a research team and a cluster. The architectural shift towards treating speech as token prediction over a neural audio codec, which is to say applying the language model playbook to audio, collapsed that requirement dramatically. One researcher with one GPU and a good idea is now a viable starting position.

The open sourcing is what turned a good model into a company. More than 8 million people have used the open or hosted versions, and 31,000 GitHub stars represent a distribution channel that no amount of early stage marketing budget could have bought. The revenue followed the distribution rather than preceding it, which is the pattern that makes this round interesting to investors and instructive to everyone else.

What they actually ship

Five models in twelve months is a fast cadence, and the lineup tells you where the boundary between free and paid sits.

The Fish Audio model lineup and how you can use each
Model family Purpose Availability
Fish Speech and Fish Diffusion The original open speech generation work Open sourced
S1 Earlier generation speech synthesis Open sourced
S2 Later generation speech synthesis Open sourced
S2.1 Pro Current flagship, expressive and emotionally controllable realtime voice Paid API only
Speech to text model Transcription with multispeaker and emotion tags Released in the same period

Around the models sits a platform: a voice library the site advertises as holding more than two million voices, voice cloning, a voice changer, audio separation, audio translation, sound effects, and an end to end voice agent product. The marketing describes S2.1 Pro as "the most expressive, emotionally controllable real-time voice model" and the platform as supporting more than 30 languages, including English, Japanese, Korean, Chinese, French, German, Arabic and Spanish. The funding announcement cites a considerably higher language count for the open models, so treat language coverage as something to verify against your specific target languages rather than a single headline number.

Named partners and customers include HeyGen, Sanas, LiveKit and Retell, which is a telling list. Those are companies building avatars, accent conversion and realtime voice infrastructure, meaning Fish Audio is positioned as a component inside other people's voice products rather than only as an end user tool.

The open core boundary, stated plainly

Three speech generation models are open sourced. The best one is not. That is the entire commercial strategy in two sentences, and it is worth being clear eyed about rather than either celebrating or resenting it.

The open models are genuinely useful and genuinely yours. You can self host them, run them on your own infrastructure, keep audio and text inside your own network, and pay nothing per character forever. For a great many applications that is sufficient, and the existence of that option meaningfully constrains what the hosted service can charge.

The flagship is where the expressiveness and emotional control live, and it is behind a paid API. If your product depends on the highest quality output, you are a customer rather than a self hoster, and the open models function as an excellent demonstration of what the paid tier does better. This is the standard open core arrangement, executed cleanly.

i

Info

The question to ask yourself

Do not frame this as open versus proprietary. Ask instead whether the open models clear your quality bar for your actual content in your actual languages. If they do, self host and enjoy the economics. If they do not, budget for the API and stop treating the open weights as a fallback plan.

Choosing a side of the line

The decision is mostly determined by four things: quality requirements, privacy constraints, volume, and how much operational work you want to own.

Self hosting the open models against using the paid API
Dimension Self hosted open models Paid API
Output quality Good, one generation behind the flagship Best available from the vendor
Emotional and tonal control Limited The main reason to pay
Cost at high volume GPU time only, falls with utilisation Linear per character forever
Cost at low volume Poor, an idle GPU is pure loss Excellent
Data privacy Audio never leaves your infrastructure Governed by contract
Operational burden Drivers, memory, scaling, on call None
Vendor risk None, you hold the weights Real, pricing and terms can change

The vendor risk row deserves more weight than teams usually give it. A model you have downloaded cannot be deprecated, repriced or discontinued underneath you. For products with long support commitments, that durability is sometimes worth accepting a quality step down, and it is the strongest practical argument for building on the open tier even when you can afford the API.

Voice cloning in fifteen seconds, and what that obliges you to do

Fish Audio advertises voice cloning from roughly ten to fifteen seconds of reference audio. Testimonials on the site cite fifteen seconds. That is not a marketing exaggeration, it is where few shot cloning genuinely sits now across the field, and it is the single most consequential capability in the whole product.

The engineering uses are legitimate and valuable. Consistent brand narration without rebooking studio time. Voices recorded once by paid actors and reused across a catalogue. Accessibility features that read a user their own writing in a voice they chose. Localisation that keeps a recognisable voice across languages.

The obligation attached to that capability is equally real. Fifteen seconds of someone from a podcast, a conference recording or a voice note is enough to impersonate them convincingly. If your product lets users upload reference audio, you have shipped a voice cloning tool regardless of what you called the feature. Decide before launch how you verify that the uploader has rights to the voice, what you log about every generation, and what you refuse outright.

Warning

Build the consent path first

Verification of voice rights, an audit trail linking each clip to the account that requested it, and disclosure of synthetic audio to listeners are all cheap to design in and expensive to retrofit after an incident. Treat them as launch requirements rather than roadmap items.

The practical integration shape

Whichever side of the line you land on, the code that matters looks similar. Stream the output, because for anything a person waits on, time to first audio chunk decides how responsive the system feels and total generation time barely registers.

# Streaming synthesis. The exact client and parameter names differ between
# the hosted API and a self hosted deployment, but the shape is the same:
# request, then consume chunks as they arrive rather than awaiting a file.

async def speak(text: str, voice_id: str, sink):
    first_chunk_at = None
    started = time.perf_counter()

    async for chunk in client.tts.stream(
        text=text,
        voice_id=voice_id,      # a library voice, or your own cloned voice
        format="pcm",           # raw frames are cheapest to play immediately
        sample_rate=24_000,
    ):
        if first_chunk_at is None:
            first_chunk_at = time.perf_counter() - started
            metrics.timing("tts.time_to_first_chunk_ms", first_chunk_at * 1000)

        await sink.write(chunk)  # playback begins here, not at the end

Instrument time to first chunk from the client rather than the server. Server side timings routinely miss a hundred to three hundred milliseconds of buffering and playback startup, which is exactly the band where a voice interface stops feeling immediate.

💡

Pro tip

Cache generated audio on a hash of text plus voice plus parameters. Most applications repeat far more of their utterances than anyone expects, and served cache costs nothing whether you are paying per character or amortising a GPU.

Where the money is going

The stated plan is to expand beyond text to speech into what the company calls the full audio native stack: an audio understanding model, speech to speech, and voice native language models, alongside enterprise sales and deeper developer tooling with partners including LiveKit and Retell.

That direction is worth noting if you are architecting now. Speech to speech models take audio in and emit audio out without a text bottleneck, which preserves tone and emotion that a transcription step discards, and cuts latency by removing an entire stage. If you are building a cascaded pipeline of recognition, then a language model, then synthesis, understand that the industry is actively working to collapse it. Keep the boundaries in your own architecture clean enough that you could swap the middle out later.

! Common mistakes to avoid

  • Assuming everything from a company known for open source is open.

    Three of the speech generation models are open sourced and the current flagship is paid API only. Check which specific model your quality expectations were formed against before planning to self host it.

  • Evaluating quality on clean marketing copy.

    Test on your real text, including product names, numbers, URLs and abbreviations, and in your actual target languages. Headline language counts vary between sources and the tail is where quality drops.

  • Shipping voice cloning without a consent and provenance path.

    Fifteen seconds of reference audio is enough to impersonate someone. Verify rights, log every generation against an account, and disclose synthetic audio before launch rather than after.

  • Optimising total generation time instead of first chunk latency.

    Stream everything and measure time to first audio byte at the client. Perceived responsiveness is set by when sound starts, not when it finishes.

  • Treating a hosted API as permanent infrastructure.

    Pricing and model availability change. If your product has long support commitments, weigh the open tier seriously, since weights you hold cannot be deprecated underneath you.

? Frequently asked questions

How much did Fish Audio raise and who led it? +

A 52 million dollar seed round announced on 28 July 2026, led by Coreline Ventures and Capital Today. Participants reported consistently across coverage include 359 Capital, Parable, Play Time, Alphalist Partners, Carya Venture Partners and HF0, with individual outlets naming a few others.

Are the Fish Audio models actually open source? +

Partly. Of the four speech generation models released in the first year, three are open sourced and can be self hosted. The current flagship, S2.1 Pro, is available only through the paid API.

How much reference audio does voice cloning need? +

Around ten to fifteen seconds of clean speech. Audio quality matters far more than quantity, and adding longer but noisier reference material usually makes the result worse rather than better.

Should I self host or use the API? +

Self host if the open models clear your quality bar and you have privacy requirements or enough volume to amortise a GPU. Use the API if you need the flagship expressiveness or your volume is too low to justify dedicated hardware.

What hardware do I need to self host? +

A single modern GPU handles these models comfortably at inference. Size for concurrency rather than for a single request, and enable batching before concluding you need larger hardware.

What is the company building next? +

An audio understanding model, speech to speech, and voice native language models, plus enterprise sales and deeper integrations with infrastructure partners such as LiveKit and Retell.

What this round actually signals

Strip away the funding headline and the useful signal is this: a one year old company reached 21 million dollars in recurring revenue by giving away capable models and charging for the best one. Speech synthesis has moved from a vendor relationship you negotiate to a component you choose, and the choice now has a genuine free option that is good enough for a large share of real work. Decide which side of the open core line your requirements sit on, build the consent and provenance path before you launch rather than after, stream your audio, and measure latency where the user actually hears it. The technology stopped being the hard part some time ago.

Note

Specs in this post

Version numbers, pricing and model behaviour describe the state of things at the time of writing and move quickly. Check the official docs for anything you are about to depend on in production.

Bishrul Haq

Written by

Bishrul Haq

Software engineer writing practical tutorials on Laravel, PHP, Python, and the tools behind real projects. More about me

Newsletter

Want more posts like this?

Get practical software notes and tutorials delivered when something new is published.

No spam. Unsubscribe anytime.

How did this land?

Comments

0
Log in or sign up to join the discussion and react to this post.

No comments yet. Be the first to share your thoughts.

Related posts

Important functionalities of Pandas in Python : Tricks and Features

Pandas is one of my favorite libraries in python. It’s very useful to visualize the data in a clean structural manner. Nowadays Pandas is widely used in Data Science, Machine Learning and other areas.

6 years ago

How to get data from twitter using Tweepy in Python?

To start working on Python you need to have Python installed on your PC. If you haven’t installed python. Go to the Python website and get it installed.

6 years ago

Predicting per capita income of the US using linear regression

Python enables us to predict and analyze any given data using Linear regression. Linear Regression is one of the basic machine learning or statistical techniques created to solve complex problems.

6 years ago

Essential Sorting Algorithms for Computer Science Students

Algorithms are commonly taught in Computer Science, Software Engineering subjects at your Bachelors or Masters. Some find it difficult to understand due to memorizing.

6 years ago

Python 3.14 for Real Projects: Free Threading, JIT, t-Strings, and Zstandard

What actually matters in Python 3.14 for production officially supported free-threaded builds, the experimental JIT, t-strings for safe interpolation, stdlib Zstandard, and a low-risk adoption plan.

1 month ago