Self-hosting & scaling models

Self-hosting & scaling models

0 Ocena
0
Odcinek
245 of 373
Czas
41min
Język
Angielski
Format
Kategoria
Literatura Faktu

We’re excited to have Tuhin join us on the show once again to talk about self-hosting open access models. Tuhin’s company Baseten specializes in model deployment and monitoring at any scale, and it was a privilege to talk with him about the trends he is seeing in both tooling and usage of open access models. We were able to touch on the common use cases for integrating self-hosted models and how the boom in generative AI has influenced that ecosystem.

Sponsors:

Fastly • – Our bandwidth partner. • Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.comFly.io • – The home of Changelog.com • — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog • and check out the speedrun in their docs • . Typesense • – Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can’t get any faster!

Featuring:

• Tuhin Srivastava – GitHub • , X • Chris Benson – Website • , GitHub • , LinkedIn • , X • Daniel Whitenack – Website • , GitHub • , X Show Notes:

Baseten Upcoming Events:

• Register for upcoming webinars here • !


Słuchaj i czytaj kiedy chcesz

Witaj w nieskończonym świecie literatury

  • 7 dni za darmo
  • Czytaj i słuchaj jak chcesz i ile chcesz
  • Ponad 500 000 tytułów
  • Tytuły dostępne wyłącznie w Storytel oraz Storytel Originals
  • Łatwa rezygnacja w dowolnym momencie
Wypróbuj
Cover for Self-hosting & scaling models

Możesz polubić także ...