Chris Lu
Co-founder at Copy.ai
Initially, the stack started off as just raw GPT-3. People were like, "Oh, aren't you just a wrapper around GPT-3?"
At the beginning, I would've been like, "Yeah, we are. We launched it in two weeks. What do you expect?"
Today, we have something like 20 or 30 distinct fine-tuned models running and they all help out with different parts of the process. We’ve basically had to build out an entire monitoring and A/B testing stack to allow us to experiment a lot faster, deploy new models faster, and then get feedback on it really quickly.
We have the advantage of a massive user base, which means we can get feedback really quickly. You run a test for a day and you'll get to statistical significance.
Copy.ai is a generative AI copywriting and marketing tool.