Greylock Partners reposted this
'If you implement observability with something like Braintrust inside of your internal AI gateway it’s really effective. What a lot of great companies do is they add logging into their AI gateway. What that means is if you’re a new team and you don’t know what evals are, you can get access via this gateway and start using the model and everything gets logged for you. What will eventually happen is if your product starts working you’ll say ‘I’d like to do evals’ and you can see all of the logs from people using your product to get started crafting this into something you can use to make your product better.' cc Ankur Goyal